edgewise v0.4.1

API reference

The full reference, generated from the source with TypeDoc, is at API reference →.

Entry points#

ImportContains
edgewisethe six verbs, mic, audioSource, tool, question builders, configure, capabilities, registry, defineModel, preload, unload, errors
edgewise/helpershelpers built on the verbs
edgewise/reactReact hooks
edgewise/ai-sdkVercel AI SDK providers
edgewise/testmock models
edgewise/workerworker mode: serveWorker, connectWorker

configure()#

OptionDefault
hubhttps://huggingface.cowhere model files download from
cacheDir$EDGEWISE_CACHE or ~/.cache/edgewiseservers
wasmPathsjsDelivrbrowsers: where ONNX Runtime loads .wasm from
maxLoadedModels4models kept in memory
memoryBudget'auto'bytes loaded models may use together, 'auto' or 'off' (Performance)
preferLowMemory'auto'trade speed for memory across devices; on for phones
allowPreviewfalseallow preview and experimental models
licenses[] (all)licence allow-list
serverGpu'auto''auto', 'off' or 'force'
fallbacksee Errors
debugfalselog decisions

Lifecycle#

ts
import { cache, persist, preload, storage, unload, loadedModels, memoryUsage } from 'edgewise';

await preload(['text:default'], { onProgress });   // download and compile ahead of time
await persist();                                 // browsers: ask to keep the cache when space is low
await storage();                                 // { quota, usage }
await cache.list();                              // cached files
await cache.delete('lfm2.5-350m');               // remove a model's files
await unload();                                  // release all loaded models

Edgewise 0.4.1 · MIT licence · Edit this page