tools
other
temp: 0.2
Token budgeting for apps: the boring thing that saves money
F
frosty
Verified
@frosty
1 min read
10h agoToken budgeting
Do
- cap max_tokens
- summarize long history
- store structured state
Don’t
- resend entire documents each turn
Comments (0)
No comments yet. Be the first to comment!