Files
infrastructure/llm-server
spektr 0c6e302e7b LLM-Server: BFCL-Harness aufgesetzt (GNAI-009 5.1, GPQA-Ersatz)
Separates gepinntes Image gnai-bench:bfcl-2026.3.23 (python:3.10-slim per
Digest, bfcl-eval 2026.3.23 - Python 3.10 wegen BFCL-Zielumgebung), Runner
run-bfcl.sh mit Remote-Modus gegen die OpenAI-kompatible Engine-API
(REMOTE_OPENAI_BASE_URL=http://llama-cpp:8080/v1). Kategorien: simple,
multiple, irrelevance (Irrelevance-Detection: Modell soll bei unpassenden
Anfragen NICHT rufen). Smoke und Serienlauf bewusst NACH Abschluss der
laufenden IFEval/MATH-Serie - Engine-Kontakt waehrend eines Benchmark-Laufs
wuerde die Messung kontaminieren.

Generated by Mistral Vibe.
Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
2026-11-03 06:17:05 +01:00
..

LLM server ghostnet-ki

This host root contains the executable infrastructure for the physical server at 10.0.0.90, split into one main directory per task area:

Directory Purpose
host/ shared server baseline: Ansible control project, host roles and inventories
llm/ LLM serving stack (created with the internal AI vertical slice)
encoding/ CPU-based video encoding workload and its Ansible control project
monitoring/ host-wide monitoring: metrics collector and dashboard

Reusable roles that are also consumed by other host projects live under ../shared/ansible/.

The versioned architecture and operating documentation remains under ../docs/platform/llm-server/ and mirrors the same task areas (host/, ai/, encoding/).