Files
infrastructure/llm-server/llm
spektr 7ec8a970b7 GNAI-001 M4 abgeschlossen: Backup/Reboot/Alarmgrenzen (GNAI-008 14.6)
Rolle ai_backup: woechentlicher Timer, NFS-Ziel (Encoding-Pipeline-
Anbindung, Betreiberentscheid), Archiv ohne GGUF-Weights (SOURCE.yml-
Reproduzierbarkeit), SHA256-Sidecar, Retention 8; Restore-Nachweise
R1 (Baum-Diff) und R2 (environment-state restore) bestanden. Echter
Hostreboot: Recovery-Service bringt Production selbststaendig hoch.
Verfuegbarkeitsmetrik gn_ai_active_env (Textfile, 30 s) mit Regel-
vorschlag fuer die GNMON-Suite. M4 damit vollstaendig abgenommen.

Generated by Mistral Vibe.
Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
2026-11-06 07:34:52 +01:00
..

LLM serving stack

This directory will hold the executable infrastructure for the LLM serving stack on ghostnet-ki: rootless llama.cpp with ROCm, separated into Production and Testing environments.

It is created with the internal LLM vertical slice (roadmap milestone 2 in GNAI-001). The planned architecture, deployment and serving configuration are documented under ../../docs/platform/llm-server/ai/.