Num predict (LLM Attribute)

From Tygron Support wiki
Revision as of 12:57, 8 July 2026 by Maxim@tygron.com (talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search
Attribute Unit Description Default value
NUM_PREDICT number The maximum number of tokens the LLM can generate before stopping. 5000

See also

API Endpoints

Retrieved from "https://support.tygron.com/w/index.php?title=Num_predict_(LLM_Attribute)&oldid=90265"