spektr
ca79cc404a
inference_engine_ctx_size_override auf null (GNAI-008 7.5, GNAI-010 10.3); 131072 aktiv seit 01.11.2026, kein OOM (VRAM 14,3/14,7 GiB von je 16 GiB). Generated by Mistral Vibe. Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
LLM serving stack
This directory will hold the executable infrastructure for the LLM serving
stack on ghostnet-ki: rootless llama.cpp with ROCm, separated into
Production and Testing environments.
It is created with the internal LLM vertical slice (roadmap milestone 2 in
GNAI-001). The planned
architecture, deployment and serving configuration are documented under
../../docs/platform/llm-server/ai/.