Chat Channel: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
|||
| Line 4: | Line 4: | ||
Chat Channel attributes can be used to guide the behavior of the underlying LLM [[Neural Network]]. | Chat Channel attributes can be used to guide the behavior of the underlying LLM [[Neural Network]]. | ||
{{ | {{LLM attributes|suppresscategory=true|allowselflink=true| | ||
{{:temperature ( | {{:temperature (LLM Attribute)}} | ||
{{:top_p ( | {{:top_p (LLM Attribute)}} | ||
{{:top_k ( | {{:top_k (LLM Attribute)}} | ||
{{:num_predict ( | {{:num_predict (LLM Attribute)}} | ||
{{:timout_sec ( | {{:timout_sec (LLM Attribute)}} | ||
{{:think_mode ( | {{:think_mode (LLM Attribute)}} | ||
{{:cachable ( | {{:cachable (LLM Attribute)}} | ||
{{:project_info ( | {{:project_info (LLM Attribute)}} | ||
}} | }} | ||
Revision as of 15:00, 29 June 2026
Chat Channels define the conversation with AI Agents. Each channel can have multiple Chat Messages.
Attributes
Chat Channel attributes can be used to guide the behavior of the underlying LLM Neural Network.
| Attribute | Unit | Description | Default value |
|---|---|---|---|
| TEMPERATURE | number | Temperature controls the randomness of text that is generated by LLMs during inference. A value >1 is more creative, <1 is more strict behavior. | 1 |
| TOP_P | number | Top-P sampling selects a group of LLM tokens whose cumulative probability is at least P. | 0.95 |
| TOP_K | number | Top-K sampling limits the LLM to choosing from the K most likely tokens at each step. | 64 |
| NUM_PREDICT | number | The maximum amount of tokens the LLM can predict, value is used to stop the LLM at a certain point. | 5000 |
| THINK_MODE | boolean | With think-mode enabled the LLM returns both the reasoning and final answer. | 1 |
| PROJECT_INFO | boolean | Whether to include some basic info about the project that is accessible by the LLM. | 1 |