Num predict (LLM Attribute)
Jump to navigation
Jump to search
| Attribute | Unit | Description | Default value |
|---|---|---|---|
| NUM_PREDICT | number | The maximum amount of tokens the LLM can predict, value is used to stop the LLM at a certain point. | 5000 |
| Attribute | Unit | Description | Default value |
|---|---|---|---|
| NUM_PREDICT | number | The maximum amount of tokens the LLM can predict, value is used to stop the LLM at a certain point. | 5000 |