Num predict (LLM Attribute)
Jump to navigation
Jump to search
| Attribute | Unit | Description | Default value |
|---|---|---|---|
| NUM_PREDICT | number | The maximum number of tokens the LLM can generate before stopping. | 5000 |
| Attribute | Unit | Description | Default value |
|---|---|---|---|
| NUM_PREDICT | number | The maximum number of tokens the LLM can generate before stopping. | 5000 |