# LLM serving stack

This directory will hold the executable infrastructure for the LLM serving
stack on `ghostnet-ki`: rootless `llama.cpp` with ROCm, separated into
Production and Testing environments.

It is created with the internal LLM vertical slice (roadmap milestone 2 in
[GNAI-001](../../docs/GNAI-001-PLAN_Project-Roadmap.md)). The planned
architecture, deployment and serving configuration are documented under
[`../../docs/platform/llm-server/ai/`](../../docs/platform/llm-server/ai/README.md).