OptionalallowOptionalapproveReturn false to decline a tool call before it runs.
OptionaldeviceForce a device. Default 'auto'.
OptionaldtypeForce a dtype, such as 'q4'.
OptionaleveryMinimum time between frames. Default 1500 ms.
OptionallanguageSpeech models: spoken language, or 'auto'.
OptionalmaxMaximum model calls when tools are on. Default 3.
OptionalmaxMaximum new tokens per step. Default 512.
OptionalmodelModel ID, alias, manifest, or an ordered list to try.
OptionalonOptionalonReceives load events while the model downloads and compiles.
OptionalonSpeech models: audio over 30 s is cut at pauses and transcribed window by window. Called as each window finishes, with its segments in absolute seconds and how many windows are done, for progress bars.
OptionalpresetFixed-prompt models such as Florence-2: caption, ocr, detect, or { find }.
OptionalschemaFill a Zod schema. The result's object is typed from it.
OptionalsignalAbort download or inference.
OptionalstopStop when the output contains one of these strings.
OptionalsystemOptionaltemperature0 (default) decodes greedily. Higher values sample.
OptionaltimestampsSpeech models: return timestamps.
OptionaltoolsTools the model may call.
Optionaltop
Allow preview and experimental models.