Num predict (LLM Attribute): Difference between revisions
Jump to navigation
Jump to search
Created page with "{{LLM attributes | <onlyinclude> {{LLM attributes|type=row|attribute=NUM_PREDICT|unit=number|defaultvalue=5000|description=The maximum amount of tokens the LLM can predict, value is used to stop the LLM at a certain point.}} </onlyinclude> }} {{article end |notes= |seealso= * Chat Channel#Attributes |api= *Api session items chatchannels *Api session event editor chatchannel set attribute }}" |
No edit summary |
||
| Line 1: | Line 1: | ||
{{LLM attributes | {{LLM attributes | ||
| <onlyinclude> | | <onlyinclude> | ||
{{LLM attributes|type=row|attribute=NUM_PREDICT|unit=number|defaultvalue=5000|description=The maximum amount of tokens the LLM can predict, value is used to stop the LLM at a certain point.}} </onlyinclude> | {{LLM attributes|type=row|attribute=NUM_PREDICT|unit=number|defaultvalue=5000|description=The maximum amount of tokens the LLM can predict, value is used to stop the [[Large Language Model (LLM)|LLM]] at a certain point.}} </onlyinclude> | ||
}} | }} | ||
{{article end | {{article end | ||
Latest revision as of 15:44, 29 June 2026
| Attribute | Unit | Description | Default value |
|---|---|---|---|
| NUM_PREDICT | number | The maximum amount of tokens the LLM can predict, value is used to stop the LLM at a certain point. | 5000 |