Files
infrastructure/llm-server/llm
spektr efb41d229b LLM-Server: Bench-Image um Task-Extras ergaenzt (math, ifeval)
lm-eval[api,math] plus langdetect und immutabledict: minerva_math500 braucht
sympy/math_verify/antlr4, leaderboard_ifeval langdetect und immutabledict.
Beide Tasks per Smoke-Test gegen die Engine verifiziert (Datensatz-Download,
Generierung, Scoring, Sample-Speicherung).

Generated by Mistral Vibe.
Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
2026-11-03 06:01:37 +01:00
..

LLM serving stack

This directory will hold the executable infrastructure for the LLM serving stack on ghostnet-ki: rootless llama.cpp with ROCm, separated into Production and Testing environments.

It is created with the internal LLM vertical slice (roadmap milestone 2 in GNAI-001). The planned architecture, deployment and serving configuration are documented under ../../docs/platform/llm-server/ai/.