Files
infrastructure/llm-server
spektr 4fea6f75bc LLM-Server: BFCL-Integration finalisiert - smoke-laufend
Nach mehreren Live-Funden:
- bfcl-eval braucht soundfile (qwen_agent Dependency)
- CLI ist zweiteilig: bfcl generate + bfcl evaluate (nur evaluate bewertet
  vorab generierte Responses)
- Kategorien sind sprachspezifisch: simple_python statt simple
- Model-Handler muss api_inference sein: gpt-4o-2024-11-20-FC nutzt die
  OpenAI-SDK und respektiert OPENAI_BASE_URL/OPENAI_API_KEY
- Container-Name muss --replace verwenden
- Kategorie-Default auf simple_python,multiple,irrelevance korrigiert

Smoke-Test gegen unsloth-Engine: 193 Requests in 48 min, laeuft.

Generated by Mistral Vibe.
Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
2026-11-03 13:31:37 +01:00
..

LLM server ghostnet-ki

This host root contains the executable infrastructure for the physical server at 10.0.0.90, split into one main directory per task area:

Directory Purpose
host/ shared server baseline: Ansible control project, host roles and inventories
llm/ LLM serving stack (created with the internal AI vertical slice)
encoding/ CPU-based video encoding workload and its Ansible control project
monitoring/ host-wide monitoring: metrics collector and dashboard

Reusable roles that are also consumed by other host projects live under ../shared/ansible/.

The versioned architecture and operating documentation remains under ../docs/platform/llm-server/ and mirrors the same task areas (host/, ai/, encoding/).