welberr
b4e5a1af7d
Remove RoutingConfig.default_strategy: the field was never read by resolve_route() or any other code path, creating a false impression that routing behaviour was configurable. Also removed from all three example config files. Fix _benchmark_quality_score: the previous implementation used max() for correctness signals and then *added* speed bonuses on top, allowing the score to accumulate past 1.0 before the final clamp. Speed bonuses were therefore dead weight whenever pass_rate or quality_score was already ≥ 0.65. Replace with an explicit weighted average: correctness (pass_rate / quality_score) carries 0.65 and a normalised speed component carries 0.35. When no correctness signal is available the speed component carries full weight. Score is always in [0, 1] without needing a clamp. Add test_benchmark_quality_score_stays_bounded_and_weighted to lock in the corrected behaviour: bounded at 1.0, correctness-dominant, speed- only case non-zero, empty input zero, speed bonus never hurts. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| control.example.yaml | ||
| control.singlebox.example.yaml | ||
| control.singlebox.p40.example.yaml | ||
| node.example.yaml | ||
| node.singlebox.llamacpp.example.yaml | ||
| node.singlebox.llamafile.example.yaml | ||
| node.singlebox.ollama.example.yaml | ||
| node.singlebox.p40-triple.example.yaml | ||
| roles.example.yaml | ||
| roles.singlebox.p40.example.yaml | ||