Files
infrastructure/llm-server/llm
spektrandMistral Vibe 4887dc0d15
ci-static / secret-scan (push) Successful in 21s
ci-static / yamllint (push) Successful in 36s
ci-static / ansible-syntax (push) Successful in 1m19s
ci-static / markdown-links (push) Successful in 20s
ci-static / secret-scan (pull_request) Successful in 20s
ci-static / yamllint (pull_request) Successful in 31s
ci-static / ansible-syntax (pull_request) Successful in 42s
ci-static / markdown-links (pull_request) Successful in 21s
M6: open_webui-Rolle startet den Container bei Quadlet-Aenderung neu (Handler)
Generated by Mistral Vibe.
Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
2026-11-11 19:34:20 +01:00
..

LLM serving stack

This directory will hold the executable infrastructure for the LLM serving stack on ghostnet-ki: rootless llama.cpp with ROCm, separated into Production and Testing environments.

It is created with the internal LLM vertical slice (roadmap milestone 2 in GNAI-001). The planned architecture, deployment and serving configuration are documented under ../../docs/platform/llm-server/ai/.