Num predict (LLM Attribute)

From Tygron Support wiki
Revision as of 15:44, 29 June 2026 by Maxim@tygron.com (talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search
Attribute Unit Description Default value
NUM_PREDICT number The maximum amount of tokens the LLM can predict, value is used to stop the LLM at a certain point. 5000

See also

API Endpoints

Retrieved from "https://support.tygron.com/w/index.php?title=Num_predict_(LLM_Attribute)&oldid=87834"