Top k (LLM Attribute): Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
| Line 1: | Line 1: | ||
{{LLM attributes | {{LLM attributes | ||
| <onlyinclude> | | <onlyinclude> | ||
{{LLM attributes|type=row|attribute=TOP_K|unit=number|defaultvalue=64|description=Top- | {{LLM attributes|type=row|attribute=TOP_K|unit=number|defaultvalue=64|description=Top-k sampling is an adaptive version of [[Top p (LLM Attribute)]]. Instead of fixed number of tokens, it cuts off based on cumulative probability of the [[Large Language Model (LLM)|LLM]].}} </onlyinclude> | ||
}} | }} | ||
{{article end | {{article end | ||
Revision as of 12:50, 1 July 2026
| Attribute | Unit | Description | Default value |
|---|---|---|---|
| TOP_K | number | Top-k sampling is an adaptive version of Top p (LLM Attribute). Instead of fixed number of tokens, it cuts off based on cumulative probability of the LLM. | 64 |