Max tokens (Agent Attribute): Difference between revisions
Jump to navigation
Jump to search
Created page with "{{LLM attributes | <onlyinclude> {{LLM attributes|type=row|attribute=NUM_PREDICT|unit=number|defaultvalue=5000|description=The maximum amount of tokens the LLM can predict, value is used to stop the LLM at a certain point.}} </onlyinclude> }} {{article end |notes= |seealso= * Chat Channel#Attributes |api= *Api session items chatchannels *Api session event editor chatchannel set attribute }}" |
No edit summary |
||
| (7 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
{{ | {{Agent attributes | ||
| <onlyinclude> | | <onlyinclude> | ||
{{ | {{Agent attributes|type=row|attribute=MAX_TOKENS|unit=number|defaultvalue=5000|description=The maximum number of tokens the Agent's [[Generative AI (GenAI)|LLM]] can generate before stopping.}} </onlyinclude> | ||
}} | }} | ||
{{article end | {{article end | ||
|notes= | |notes= | ||
|seealso= | |seealso= | ||
* [[Chat | * [[Agent Attributes]] | ||
* [[Chat panel]] | |||
|api= | |api= | ||
*[[Api session items chatchannels]] | *[[Api session items chatchannels]] | ||
*[[Api session event editor | *[[Api session event editor chat set attribute]] | ||
}} | }} | ||
Latest revision as of 15:01, 7 October 2026
| Attribute | Unit | Description | Default value |
|---|---|---|---|
| MAX_TOKENS | number | The maximum number of tokens the Agent's LLM can generate before stopping. | 5000 |