spektr
92c846f527
Grundkonfiguration des Servers liegt nun unter llm-server/host/ansible/ (vorher llm-server/ansible/), der LLM-Stack-Platzhalter unter llm-server/llm/ und der Encoding-Workload unter llm-server/encoding/. Dokumentation und Pfadverweise (ansible.cfg roles_path, .venv-Tiefe, Markdown-Links) angepasst; Linkvalidator meldet broken_local_links=0. Generated by Mistral Vibe. Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
507 B
507 B
LLM serving stack
This directory will hold the executable infrastructure for the LLM serving
stack on ghostnet-ki: rootless llama.cpp with ROCm, separated into
Production and Testing environments.
It is created with the internal LLM vertical slice (roadmap milestone 2 in
GNAI-001). The planned
architecture, deployment and serving configuration are documented under
../../docs/platform/llm-server/ai/.