Files
infrastructure/llm-server
spektr 43f6e72d06 GNAI-010 v0.13: Swift 1.5 Q6_K bereitgestellt und technisch abgenommen (10.9)
Drittes Profil nach GNAI-009 3.4: Download 22,2 GiB SHA-256-verifiziert,
S0-Bring-up 64k, S1 128k (n_ctx_slot=131072, VRAM 15,1/14,9 GiB), Health,
Alias, Thinking- und Tool-Call-Tests bestanden, Prefill-Leiter 684/676/576/423
t/s (Unsloth-Niveau, Swift 1.0 deutlich darunter), Kontext-Negativtest sauber.
Stabilitaetsstunde laeuft parallel; group_vars auf 128k zurueckgestellt.
Swift 1.5 bleibt bis zur AB-Bewertung aktives Profil.

Generated by Mistral Vibe.
Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
2026-11-02 03:49:39 +01:00
..

LLM server ghostnet-ki

This host root contains the executable infrastructure for the physical server at 10.0.0.90, split into one main directory per task area:

Directory Purpose
host/ shared server baseline: Ansible control project, host roles and inventories
llm/ LLM serving stack (created with the internal AI vertical slice)
encoding/ CPU-based video encoding workload and its Ansible control project
monitoring/ host-wide monitoring: metrics collector and dashboard

Reusable roles that are also consumed by other host projects live under ../shared/ansible/.

The versioned architecture and operating documentation remains under ../docs/platform/llm-server/ and mirrors the same task areas (host/, ai/, encoding/).