Top k (LLM Attribute)
| Attribute | Unit | Description | Default value |
|---|---|---|---|
| TOP_K | number | Top-P sampling is an adaptive version of Top P (LLM Attribute). Instead of fixed number of tokens, it cuts off based on cumulative probability. | 64 |
| Attribute | Unit | Description | Default value |
|---|---|---|---|
| TOP_K | number | Top-P sampling is an adaptive version of Top P (LLM Attribute). Instead of fixed number of tokens, it cuts off based on cumulative probability. | 64 |