Top p (LLM Attribute)
| Attribute | Unit | Description | Default value |
|---|---|---|---|
| TOP_P | number | Top-P sampling (nucleus sampling) selects a group of tokens whose cumulative probability is at least P. | 0.95 |
| Attribute | Unit | Description | Default value |
|---|---|---|---|
| TOP_P | number | Top-P sampling (nucleus sampling) selects a group of tokens whose cumulative probability is at least P. | 0.95 |