Files
infrastructure/llm-server
spektr bc37972a09 GNAI-009 v0.5: Swift 1.5 als dritter Kandidat + Benchmark-Design; Rollen erweitert
Betreiberbeschluss 01.11.2026: Swift 1.5 Q6_K aufgenommen (GNAI-009 3.4,
Artefakt gepinnt: Revision 14bfe4b, SHA-256 cd2eb65 aus HF-Blob-Metadaten,
22,2 GiB). Testmatrix um S-Reihe und AB3/AB4 erweitert (AB3 isoliert die
Thinking-Optimierung Swift 1.0 vs 1.5, AB4 ist der Praxisvergleich).
Benchmark-Design ergaenzt: lm-evaluation-harness gegen die interne Engine-API
(AIME, GPQA Diamond, MATH-500, IFEval) plus Kernkennzahl Score je
Median-Reasoning-Token aus der getrennten reasoning_content.

model_store: drittes Artefakt; inference_engine: Profil swift15
(Unit gnai-testing-llama-swift15, Alias swift-1.5-qwen3.8-27b-q6k).

Generated by Mistral Vibe.
Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
2026-11-01 17:46:47 +01:00
..

LLM server ghostnet-ki

This host root contains the executable infrastructure for the physical server at 10.0.0.90, split into one main directory per task area:

Directory Purpose
host/ shared server baseline: Ansible control project, host roles and inventories
llm/ LLM serving stack (created with the internal AI vertical slice)
encoding/ CPU-based video encoding workload and its Ansible control project
monitoring/ host-wide monitoring: metrics collector and dashboard

Reusable roles that are also consumed by other host projects live under ../shared/ansible/.

The versioned architecture and operating documentation remains under ../docs/platform/llm-server/ and mirrors the same task areas (host/, ai/, encoding/).