Well, I dont know what you are running, but on Debian or Fedora it automatically installed Drivers and picked the GPU. I had a Problem like this ones, where it had wrong Drivers (but it was in an NVIDIA GPU).
Well, I dont know what you are running, but on Debian or Fedora it automatically installed Drivers and picked the GPU. I had a Problem like this ones, where it had wrong Drivers (but it was in an NVIDIA GPU).
I run the 32b Version on my 6700xt with an R9 3700x using ollama. It runs well but it gets a bit slower on complex problems. I once ran an 70b Llama model, but it took a long time to finish.
Nah its normal, been hoping since 6 years. I keep an external hard drive with important info, so i can nuke my system without worry.
Like others have said, Bazzite is a good option.The auto driver install is amazing. Had no problems with Bazzite, not like PopOs(some Driver issues with older NVDIA GPU). Only thing is the ISO’s are really large (>6Gb).
I study electeical engineering and my Uni runs Debian on the Workstations and in general, all the Profs give either programms which natively run on Linux or alternatives.
You can use the Terminal or something like AnythingLLM. It has a GUI and you can import pictures and Websites.