Add AMD GPU support on Linux

[einfachtorben]

This PR adds the capability to run ollama on AMD GPU's on Linux.

I Tested it on ARCH Linux with an AMD Radeon RX 6800 XT

[doordormeta]

I had to add privileged:true flag at line 124

`

ollama-gpu-amd:

profiles: ["gpu-amd"]

<<: *service-ollama

image: ollama/ollama:rocm

devices:

  - "/dev/kfd"
 
  - "dev/dri"

privileged: true`

Tested on Pop OS with rx 5600xt

[deftdawg]

This should be "/dev/dri", no?

[einfachtorben]

It should probably be that yes. I'll have to check what my local copy of this says, maybe it would work without it, but still it's better with it in

[deftdawg]

Tried it, would only work if started from /... added the / to he front. Works, thanks for this btw.