LLM-Server: ausführbares Projekt in die Hauptverzeichnisse host/, llm/ und encoding/ aufgeteilt.
Grundkonfiguration des Servers liegt nun unter llm-server/host/ansible/ (vorher llm-server/ansible/), der LLM-Stack-Platzhalter unter llm-server/llm/ und der Encoding-Workload unter llm-server/encoding/. Dokumentation und Pfadverweise (ansible.cfg roles_path, .venv-Tiefe, Markdown-Links) angepasst; Linkvalidator meldet broken_local_links=0. Generated by Mistral Vibe. Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
This commit is contained in:
@@ -0,0 +1,10 @@
|
||||
# LLM serving stack
|
||||
|
||||
This directory will hold the executable infrastructure for the LLM serving
|
||||
stack on `ghostnet-ki`: rootless `llama.cpp` with ROCm, separated into
|
||||
Production and Testing environments.
|
||||
|
||||
It is created with the internal LLM vertical slice (roadmap milestone 2 in
|
||||
[GNAI-001](../../docs/GNAI-001-PLAN_Project-Roadmap.md)). The planned
|
||||
architecture, deployment and serving configuration are documented under
|
||||
[`../../docs/platform/llm-server/ai/`](../../docs/platform/llm-server/ai/README.md).
|
||||
Reference in New Issue
Block a user