Quantcast
Channel: Debian User Forums
Viewing all articles
Browse latest Browse all 2849

Graphical Environments & Desktops • Re: Trying to install Nvidia Drivers for Ollama

$
0
0
Please use code tags for terminal text, config files etc. Fixed it for you this time.

You need to add non-free-firmware to your sources when using Nvidia drivers.
Otherwise I know nothing about Ollama docker.
Thank you so much for that! I am trying to set up a machine learning environment in Docker, and that works best with GPU support.

Here is what my sources looks like now:

Code:

deb https://deb.debian.org/debian bookworm main contrib non-freedeb https://deb.debian.org/debian bookworm-updates main contrib non-free non-free-firmwaredeb https://deb.debian.org/debian-security bookworm-security main contrib non-free
Here is what I did after that:

1. apt update
2. sudo apt install nvidia-utils-515
3. reboot

I had the same error inside of ollama. Also, nvidia-smi is still not found. I tried this command:

Code:

sudo apt install nvidia-utils-515
But I got this error:

Code:

E: Unable to locate package nvidia-utils-515
I tried a bunch of things to alleviate this error, but I am to the point where I am hesitant to throw more random commands at it. Any ideas as to what the current problem is?

Statistics: Posted by adamcodes716 — 2024-11-05 14:12



Viewing all articles
Browse latest Browse all 2849

Trending Articles