@built-in-ai/web-llm
Overview
WebLLM model provider for Vercel AI SDK v6
The @built-in-ai/web-llm package enables you to run WebLLM compiled models directly in the browser with seamless integration with the Vercel AI SDK v6.
What's Included
- Language Models: Text generation with Llama, Qwen, Phi, and more
- Tool Calling: Function calling with JSON format support
- Structured Output: Generate validated JSON objects
- Agents: Multi-step autonomous workflows
- Web Worker Support: Off-main-thread execution for better UX