Num predict (LLM Attribute): Difference between revisions
Jump to navigation
Jump to search
Created page with "{{LLM attributes | <onlyinclude> {{LLM attributes|type=row|attribute=NUM_PREDICT|unit=number|defaultvalue=5000|description=The maximum amount of tokens the LLM can predict, value is used to stop the LLM at a certain point.}} </onlyinclude> }} {{article end |notes= |seealso= * Chat Channel#Attributes |api= *Api session items chatchannels *Api session event editor chatchannel set attribute }}" |
No edit summary |
||
| (One intermediate revision by the same user not shown) | |||
| Line 1: | Line 1: | ||
{{LLM attributes | {{LLM attributes | ||
| <onlyinclude> | | <onlyinclude> | ||
{{LLM attributes|type=row|attribute=NUM_PREDICT|unit=number|defaultvalue=5000|description=The maximum | {{LLM attributes|type=row|attribute=NUM_PREDICT|unit=number|defaultvalue=5000|description=The maximum number of tokens the [[Large Language Model (LLM)|LLM]] can generate before stopping.}} </onlyinclude> | ||
}} | }} | ||
{{article end | {{article end | ||
Latest revision as of 12:57, 8 July 2026
| Attribute | Unit | Description | Default value |
|---|---|---|---|
| NUM_PREDICT | number | The maximum number of tokens the LLM can generate before stopping. | 5000 |