Files
infrastructure/llm-server/host/ansible/roles/rocm_container_probe
spektr 92c846f527 LLM-Server: ausführbares Projekt in die Hauptverzeichnisse host/, llm/ und encoding/ aufgeteilt.
Grundkonfiguration des Servers liegt nun unter llm-server/host/ansible/
(vorher llm-server/ansible/), der LLM-Stack-Platzhalter unter llm-server/llm/
und der Encoding-Workload unter llm-server/encoding/. Dokumentation und
Pfadverweise (ansible.cfg roles_path, .venv-Tiefe, Markdown-Links) angepasst;
Linkvalidator meldet broken_local_links=0.

Generated by Mistral Vibe.
Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
2026-10-19 14:42:14 +02:00
..

Rootless ROCm container probe

This verification role pulls one immutable amd64 manifest of the official llama.cpp server-rocm image into the gnai-testing rootless Podman store. It verifies the OCI image revision and build version, then runs rocminfo and llama-server --list-devices in ephemeral containers.

The probe uses the same security-relevant options planned for the permanent Quadlet: /dev/kfd, only the discovered AMD render nodes and GroupAdd=keep-groups. It sets no graphics-architecture override, publishes no port, mounts no model and removes the probe container after execution. The pinned image remains in the Testing store for the subsequent llama.cpp deployment.

Success proves that ROCm sees two gfx1030 agents and that llama.cpp exposes both as usable ROCm devices to the rootless Testing container. It does not yet prove model loading, multi-GPU splitting or inference.