Nach mehreren Live-Funden: - bfcl-eval braucht soundfile (qwen_agent Dependency) - CLI ist zweiteilig: bfcl generate + bfcl evaluate (nur evaluate bewertet vorab generierte Responses) - Kategorien sind sprachspezifisch: simple_python statt simple - Model-Handler muss api_inference sein: gpt-4o-2024-11-20-FC nutzt die OpenAI-SDK und respektiert OPENAI_BASE_URL/OPENAI_API_KEY - Container-Name muss --replace verwenden - Kategorie-Default auf simple_python,multiple,irrelevance korrigiert Smoke-Test gegen unsloth-Engine: 193 Requests in 48 min, laeuft. Generated by Mistral Vibe. Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
LLM server ghostnet-ki
This host root contains the executable infrastructure for the physical server at
10.0.0.90, split into one main directory per task area:
| Directory | Purpose |
|---|---|
host/ |
shared server baseline: Ansible control project, host roles and inventories |
llm/ |
LLM serving stack (created with the internal AI vertical slice) |
encoding/ |
CPU-based video encoding workload and its Ansible control project |
monitoring/ |
host-wide monitoring: metrics collector and dashboard |
Reusable roles that are also consumed by other host projects live under
../shared/ansible/.
The versioned architecture and operating documentation remains under
../docs/platform/llm-server/ and
mirrors the same task areas (host/, ai/, encoding/).