Skip to main content
Contextual AI Documentation home page
Search...
⌘K
Start free
Start free
Search...
Navigation
Generate
Max New Tokens
Home
Guides
Reference
Examples
Integrations
Releases
API
Key Terms & Concepts
Glossary
Agent Configs
Overview
Standard Parameters
System Prompts
Query Understanding
Query Reformulation
Retrieval
Rerank & Filter
Generate
Max New Tokens
Temperature
Top P
Frequency Penalty
Random Seed
Enable Groundedness Score
Disable Commentary
Miscellaneous
On this page
Description
Generate
Max New Tokens
(max_new_tokens)
Description
Controls the maximum length of the agent’s response. Defaults to
2,048
tokens.
Was this page helpful?
Yes
No
Filter Prompt
Previous
Temperature
Next
⌘I
