Latest posts tagged with #WebLLM on Bluesky
WebGPU LLM: Build a No-Server, No-Keys Offline AI Chat in Your Browser (WebLLM Tutorial, GGUF… No Server, No API Keys, No Backend Continue reading on Medium »
#ai-on-device #technology #webllm #ai #programming
Origin | Interest | Match
Between #WASM, #DuckDB, #WebLLM, and some amazing progress on SQL specific LLMs, this could be an interesting era of lots of questions answered, and some answered correctly. Context truly is king.
Thats pretty wild😳. I just tried the new #Qwen3 0.6B Model with #WebLLM for structured-output tool-calling. And it works surprisingly good. With and without "thinking" enabled.
The model ist just 335MB🤯
ICYMI: Local chatbot capabilities arrive for web applications, reducing data privacy concerns: WebLLM and new browser APIs enable offline-capable chatbots that keep sensitive data on users' devices while maintaining functionality. #Chatbot #DataPrivacy #WebApplications #WebLLM #BrowserAPIs
ICYMI: Local chatbot capabilities arrive for web applications, reducing data privacy concerns #Chatbot #DataPrivacy #WebApplications #WebLLM #BrowserAPIs
ICYMI: Local chatbot capabilities arrive for web applications, reducing data privacy concerns #Chatbot #DataPrivacy #WebApplications #WebLLM #OfflineFunctionality
ICYMI: Local chatbot capabilities arrive for web applications, reducing data privacy concerns: WebLLM and new browser APIs enable offline-capable chatbots that keep sensitive data on users' devices while maintaining functionality. #Chatbot #DataPrivacy #WebApplications #WebLLM #OfflineFunctionality
Great series of posts by @christianliebel.com on web.dev, covering the capabilities and limitations of LLMs running in the browser, and a walkthrough on building an on-device chatbot.
#WebAI #PromptAPI #WebLLM #GenAI
Local chatbot capabilities arrive for web applications, reducing data privacy concerns #Chatbots #DataPrivacy #WebApplications #WebLLM #BrowserAPIs
Local chatbot capabilities arrive for web applications, reducing data privacy concerns: WebLLM and new browser APIs enable offline-capable chatbots that keep sensitive data on users' devices while maintaining functionality. #Chatbots #DataPrivacy #WebApplications #WebLLM #BrowserAPIs
Check out my three-part article series about the benefits of on-device large language models and learn how to add AI capabilities to your web apps: web.dev/articles/ai-... #GenAI #WebLLM #PromptAPI
Local #GenAI Processing: Implementing #WebLLM with #Blazor #WebAssembly
www.telerik.com/blogs/local-... by @edcharbeneau.bsky.social
Open source and novel approches in the #WebAI field serms promising 👍
WebLLM is a great initiative to start using LLM in the browser/client device itself. It opens up new avenues for innovative solutions for sure 👍
webllm.mlc.ai
Source: WebAI Conference
#WebLLM #Opensource
Have you tried webllm.mlc.ai?
You can basically use any <10B LLM directly in the browser using #WebLLM. .
Local AI Chat: Browser-Native Language Models with Privacy Focus 🔒
#WebLLM Chat brings #AI conversations to your browser using #WebGPU - runs locally for complete #privacy and #offline use. Built on #opensource tech, supports #customLLM and image analysis. More at chat.webllm.ai
As always, I had a great time at DWX! Here are my slides from my talk about local, offline-capable #GenerativeAI models via #WebLLM, #PromptAPI, #WebGPU, and #WebNN: www.thinktecture.com/contribution... #pwa #dwx2024
#Blogged: Solving bundler issues when adding #WebLLM to your app labs.thinktecture.com/solving-bund... #ai #genai #generativeai #webapps
#Blogged: How to deal with “cannot find function” errors after updating #WebLLM. labs.thinktecture.com/solving-cann... #ai #genai #generativeai #webapps
are there any applications out there using
#WebLLM?
#Blogged: Adding AI functions to Angular apps: local and offline-capable (German content) www.thinktecture.com/ai/ai-funkti... #angular #webllm #generativeai
