Files
infrastructure/llm-server/host/ansible/roles/rocm_container_probe
spektr 8480d53349
ci-static / secret-scan (push) Successful in 21s
ci-static / yamllint (push) Successful in 31s
ci-static / ansible-syntax (push) Successful in 27s
ci-static / markdown-links (push) Successful in 20s
ci-static / secret-scan (pull_request) Successful in 21s
ci-static / yamllint (pull_request) Successful in 44s
ci-static / ansible-syntax (pull_request) Successful in 1m3s
ci-static / markdown-links (pull_request) Successful in 23s
llama.cpp v1.0.0: Image-Pin auf server-rocm-v1.0.0-b12359-b1b770d heben (GNAI-010 0.20)
- inference_engine + rocm_container_probe: Digest sha256:4bbbd2e3... (amd64-Manifest
  sha256:abb28972...), Build b12359, Revision b1b770d90..., OCI-Version
  v1.0.0-b12359-b1b770d. v1.0.0 (Release 13.11.2026) loest ueber nightly-tag.txt
  auf b12359 auf; moving tag server-rocm zeigt auf denselben Digest. Semver-Policy
  upstream ab v1.0.0 — passt zur Digest-Pinning-Konvention.
- Kompatibilitaet gegen b12359 llama-server --help geprueft (Image lokal gepullt):
  alle 26 Exec=-Flags des Quadlets existieren; einzige entfernte Option
  --defrag-thold (#30565) wird nicht verwendet. ENTRYPOINT /app/llama-server
  unveraendert. Server-Haertung #32113/#32115/#32098 greift nicht (kein
  server-seitiges --tools/MCP, keine privaten Media-URLs, OpenWebUI ist
  Non-Browser-Client). libllama.so.1/36 entfernte Symbole betreffen nur native
  Bindings — wir sind HTTP-only.
- Neue Optionen bewertet (GNAI-010 0.20): FP8-KV f8_e4m3 (auf gfx1030 emuliert,
  Benchmark vor Adoption, Default q8_0), --moe-cache-cpu-share (nur MoE),
  --sleep-idle-seconds (kontraproduktiv), --api-key (optional), die Opt-out-Flags
  --allow-unauthenticated-tools/--media-allow-private-urls bleiben aus.
- Doku: GNAI-010 v0.20 + Abschnitt 3.1, GNAI-008 v0.23 + Probe-Abschnitt,
  Host-README Pin-Block (alter Pin als historisch markiert).
- Quadlet Exec bleibt unveraendert. Rollout auf 10.0.0.90 steht noch aus.

Generated by Mistral Vibe.
Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
2026-11-14 15:04:14 +01:00
..

Rootless ROCm container probe

This verification role pulls one immutable amd64 manifest of the official llama.cpp server-rocm image into the gnai-testing rootless Podman store. It verifies the OCI image revision and build version, then runs rocminfo and llama-server --list-devices in ephemeral containers.

The probe uses the same security-relevant options planned for the permanent Quadlet: /dev/kfd, only the discovered AMD render nodes and GroupAdd=keep-groups. It sets no graphics-architecture override, publishes no port, mounts no model and removes the probe container after execution. The pinned image remains in the Testing store for the subsequent llama.cpp deployment.

Success proves that ROCm sees two gfx1030 agents and that llama.cpp exposes both as usable ROCm devices to the rootless Testing container. It does not yet prove model loading, multi-GPU splitting or inference.