Num predict (LLM Attribute): Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
| Line 1: | Line 1: | ||
{{LLM attributes | {{LLM attributes | ||
| <onlyinclude> | | <onlyinclude> | ||
{{LLM attributes|type=row|attribute=NUM_PREDICT|unit=number|defaultvalue=5000|description=The maximum | {{LLM attributes|type=row|attribute=NUM_PREDICT|unit=number|defaultvalue=5000|description=The maximum number of tokens the [[Large Language Model (LLM)|LLM]] can generate before stopping.}} </onlyinclude> | ||
}} | }} | ||
{{article end | {{article end | ||
Latest revision as of 12:57, 8 July 2026
| Attribute | Unit | Description | Default value |
|---|---|---|---|
| NUM_PREDICT | number | The maximum number of tokens the LLM can generate before stopping. | 5000 |