AI: add enable_thinking reasoning toggle plumbed to llama.cpp

New optional SamplingOverride forwarded to llama-server as
chat_template_kwargs.enable_thinking (gates Qwen3-style reasoning
blocks). None leaves the template default; other backends ignore it.
Wired through the agentic-insight and chat-turn request bodies/handlers.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
Cameron Cordes
2026-06-17 18:14:44 -04:00
committed by Cameron
parent 7684220f52
commit 475072810e
8 changed files with 55 additions and 0 deletions
+1
View File
@@ -336,6 +336,7 @@ async fn main() -> anyhow::Result<()> {
args.top_p,
args.top_k,
args.min_p,
None, // enable_thinking: leave model/template default
args.max_iterations,
None,
Vec::new(),