OptionalcacheServer only: where model files are cached. Default $EDGEWISE_CACHE or ~/.cache/edgewise.
Log what Edgewise decides (device, dtype, fallbacks).
Base URL model files are downloaded from. Default https://huggingface.co.
Only allow models whose licence is in this list. Empty means allow all.
Maximum models kept loaded at once. Least recently used models are unloaded first.
Memory that loaded models may use together, in bytes. Before a load, least recently used models are
unloaded until the new one fits. 'auto' (default) picks a budget from the device: about 2 GB on
phones and low-memory devices (where a model that alone exceeds it throws OutOfMemoryError), and a
soft limit elsewhere. A number is a strict budget. 'off' disables it. Sizes are estimates; see
memoryUsage().
With device: 'auto', choose a variant on another device when it needs at most half the memory,
for example speech models on WebAssembly instead of WebGPU. 'auto' (default) turns it on for
phones and devices with 4 GB of memory or less.
Server only: use a GPU through vgpu when a hardware adapter is present.
OptionalwasmBrowser only: where ONNX Runtime loads its .wasm files from. Defaults to the jsDelivr CDN.
Point it at your own copy of onnxruntime-web/dist/ to self-host.
Allow preview and experimental models everywhere.