Files
infrastructure/llm-server
spektr 89e42ecd9b LLM-Server: Effizienz-Auswertung fuer Benchmark-Ergebnisse (GNAI-009 5.2)
eval-efficiency.py/.sh in der benchmark-Rolle: liest die Per-Sample-Logs
von lm-eval, zaehlt die exakt generierten Tokens je Antwort ueber den
/tokenize-Endpunkt der Engine (Qwen-Tokenizer, keine Schaetzung), zieht
den Score und aggregiert Score, Median/Mean/Max-Tokens sowie die
Effizienzkennzahl Score je Median-Token. Smoke-Test auf den AIME-2-Ergebnissen:
Score 1.0, Median 645 generierte Tokens je Aufgabe.

Generated by Mistral Vibe.
Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
2026-11-02 06:44:44 +01:00
..

LLM server ghostnet-ki

This host root contains the executable infrastructure for the physical server at 10.0.0.90, split into one main directory per task area:

Directory Purpose
host/ shared server baseline: Ansible control project, host roles and inventories
llm/ LLM serving stack (created with the internal AI vertical slice)
encoding/ CPU-based video encoding workload and its Ansible control project
monitoring/ host-wide monitoring: metrics collector and dashboard

Reusable roles that are also consumed by other host projects live under ../shared/ansible/.

The versioned architecture and operating documentation remains under ../docs/platform/llm-server/ and mirrors the same task areas (host/, ai/, encoding/).