Chat Channel
Chat Channels define the conversation with AI Agents. Each channel can have multiple Chat Messages.
Attributes
Chat Channel attributes can be used to guide the behavior of the underlying Large Language Model (LLM) Neural Network.
| Attribute | Unit | Description | Default value |
|---|---|---|---|
| TEMPERATURE | number | Temperature controls the randomness of text that is generated by LLMs during inference. A value >1 is more creative, <1 is more strict behavior. | 1 |
| TOP_P | number | Top-P sampling selects a group of LLM tokens whose cumulative probability is at least P. | 0.95 |
| TOP_K | number | Top-K sampling limits the LLM to choosing from the K most likely tokens at each step. | 64 |
| NUM_PREDICT | number | The maximum amount of tokens the LLM can predict, value is used to stop the LLM at a certain point. | 5000 |
| TIMEOUT_SEC | sec | The maximum amount of time the LLM can take, value is used to stop the LLM at a certain point. | 600 |
| THINK_MODE | boolean | With think-mode enabled the LLM returns both the reasoning and final answer. | 1 |
| CACHEABLE | boolean | Debug value, when deactivated the LLM Tools can no longer cache wiki pages. | 1 |
| PROJECT_INFO | boolean | Whether to include some basic info about the project that is accessible by the LLM. | 1 |