Files
infrastructure/llm-server
spektr 9a33973fcb LLM-Server: Benchmark-Timeout auf 2700 s angehoben (Befund aus AB3-Phase 1)
Swift 1.0 xhigh Thinking lief auf einer AIME-Aufgabe ueber 30 Minuten und
sprengte lm-evals Request-Timeout: die 32768-Token-Ausgabegrenze des Profils
benoetigt bei ~18 t/s etwa 30,2 Minuten. 2700 s deckt Cap-Grenzen plus
Prefill ab; max_retries auf 1 reduziert (sequenzielle Requests, ein
Timeout-Wiederholungsversuch wuerde nur die gleiche Generierung wiederholen).

Generated by Mistral Vibe.
Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
2026-11-02 08:17:22 +01:00
..

LLM server ghostnet-ki

This host root contains the executable infrastructure for the physical server at 10.0.0.90, split into one main directory per task area:

Directory Purpose
host/ shared server baseline: Ansible control project, host roles and inventories
llm/ LLM serving stack (created with the internal AI vertical slice)
encoding/ CPU-based video encoding workload and its Ansible control project
monitoring/ host-wide monitoring: metrics collector and dashboard

Reusable roles that are also consumed by other host projects live under ../shared/ansible/.

The versioned architecture and operating documentation remains under ../docs/platform/llm-server/ and mirrors the same task areas (host/, ai/, encoding/).