Thank you so much for that! I am trying to set up a machine learning environment in Docker, and that works best with GPU support.Please use code tags for terminal text, config files etc. Fixed it for you this time.
You need to add non-free-firmware to your sources when using Nvidia drivers.
Otherwise I know nothing about Ollama docker.
Here is what my sources looks like now:
Code:
deb https://deb.debian.org/debian bookworm main contrib non-freedeb https://deb.debian.org/debian bookworm-updates main contrib non-free non-free-firmwaredeb https://deb.debian.org/debian-security bookworm-security main contrib non-free
1. apt update
2. sudo apt install nvidia-utils-515
3. reboot
I had the same error inside of ollama. Also, nvidia-smi is still not found. I tried this command:
Code:
sudo apt install nvidia-utils-515
Code:
E: Unable to locate package nvidia-utils-515
Statistics: Posted by adamcodes716 — 2024-11-05 14:12