Thinking & retries
Configure thinking modes and budgets, Anthropic context management, graceful option degradation, and rate-limit retry backoff per model.
Open /provider-settings to tune thinking mode and budget per model. Or edit config directly:
{
"thinking": {
"mode": "adaptive"
}
}Thinking modes
| Mode | What it does |
|---|---|
off | No thinking blocks |
adaptive (or auto) | Model decides when to think (Claude 4+) |
enabled | Fixed budget thinking - specify tokens |
Budgets when mode is enabled: 1024, 2048, 5000, 10000, 20000.
Context management (Anthropic)
Advanced Anthropic features, applied on supported models:
- Clear Thinking - on by default; preserves all thinking blocks (
keep: "all") so the prompt cache prefix stays stable. - Clear Tool Uses - opt-in; clears old tool content once input passes 65% of the context window (minimum 120k tokens).
- Compact - opt-in; API-side compaction at 80% of context, on models with a 200k+ window.
Graceful degradation
If a provider rejects an option (unsupported thinking mode, unknown parameter), Empryo retries with reduced options automatically. You don't see the error.
Retries on rate limits
Getting 429s? Bump retry config:
{
"retry": {
"maxAttempts": 5,
"baseDelayMs": 3000
}
}Delays double each attempt: 3s, 6s, 12s, 24s, 48s.
| Field | Default | Range |
|---|---|---|
maxAttempts | 3 | 1–10 |
baseDelayMs | 1000 (chat) / 2000 (agents) | 250–60000 |