spektr
92c846f527
Grundkonfiguration des Servers liegt nun unter llm-server/host/ansible/ (vorher llm-server/ansible/), der LLM-Stack-Platzhalter unter llm-server/llm/ und der Encoding-Workload unter llm-server/encoding/. Dokumentation und Pfadverweise (ansible.cfg roles_path, .venv-Tiefe, Markdown-Links) angepasst; Linkvalidator meldet broken_local_links=0. Generated by Mistral Vibe. Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
11 lines
507 B
Markdown
11 lines
507 B
Markdown
# LLM serving stack
|
|
|
|
This directory will hold the executable infrastructure for the LLM serving
|
|
stack on `ghostnet-ki`: rootless `llama.cpp` with ROCm, separated into
|
|
Production and Testing environments.
|
|
|
|
It is created with the internal LLM vertical slice (roadmap milestone 2 in
|
|
[GNAI-001](../../docs/GNAI-001-PLAN_Project-Roadmap.md)). The planned
|
|
architecture, deployment and serving configuration are documented under
|
|
[`../../docs/platform/llm-server/ai/`](../../docs/platform/llm-server/ai/README.md).
|