Skip to content

Issues: mlc-ai/web-llm

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

75 Open 241 Closed
75 Open 241 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Error: Cannot initialize runtime because of requested maxComputeWorkgroupStorageSize exceeds limit. requested=32768, limit=16384.
#644 opened Nov 29, 2024 by badduck32
Trying to use the CreateServiceWorkerMLCEngine using Vite project but it doesn't work
#641 opened Nov 27, 2024 by v7Chord
1
Phi-3.5-vision-instruct-q4f16_1-MLC
#640 opened Nov 27, 2024 by raulgupta
2
Some questions regarding the WebLLM tool
#639 opened Nov 27, 2024 by jasonsu123
4
Embedding load failing
#638 opened Nov 25, 2024 by djaffer
Is it possible to store a loaded engine in react to avoid multiple reloads when refreshing the app?
#636 opened Nov 22, 2024 by jvjmarinello
2
Direct BNF support
#634 opened Nov 22, 2024 by Bainainai
1
Compiling Custom Model Fails to Load Into Web-LLM
#633 opened Nov 21, 2024 by Justin-Cignal
Transitive dependency of @webgpu/types for Typescript.
#631 opened Nov 17, 2024 by erikh2000
1
Use q3f16 models
#630 opened Nov 16, 2024 by bil-ash
Structured JSON Generation
#629 opened Nov 13, 2024 by AvivSham
1
Support for llama3.2-vision?
#625 opened Nov 7, 2024 by tgirotto
Loading LLM inside Electron window is very slow at the Compiling GPU Shader on Windows
#621 opened Oct 30, 2024 by StevenHanbyWilliams
2
Service worker engine hangs forever if client is lost while streaming results
#620 opened Oct 26, 2024 by Bainainai
@Neet-Nestor
Save/restore intermediary state for prompt caching
#619 opened Oct 19, 2024 by Bainainai
[FEATURE REQUEST] Add support for NPUs?
#612 opened Oct 12, 2024 by Iternal-JBH4
1
MLX engine support
#611 opened Oct 11, 2024 by onderceylan
WebLLM always processes on Intel UHD Graphics, not on NVIDIA T1200
#609 opened Oct 10, 2024 by b521f771d8991e6f1d8e65ae05a8d783
9
Introducing: papeg.ai
#608 opened Oct 10, 2024 by flatsiedatsie
2
Revamp Navbar and Footer for Improved UI
#605 opened Oct 7, 2024 by Mefisto04
4
Add Input Field for Custom Font Value Alongside Slider
#604 opened Oct 7, 2024 by Mefisto04
5
Molmo support
#587 opened Sep 30, 2024 by win4r
1
Accuracy of Phi-3.5 Vision Models in Web-LLM is way off
#586 opened Sep 30, 2024 by atlury
4
webLLMGlobal reference
#585 opened Sep 29, 2024 by lestan
2
Usage Stats in Intermediate Steps
#559 opened Sep 12, 2024 by jdp8
3
ProTip! Type g i on any issue or pull request to go back to the issue listing page.