Software & Apps
Janus Pro 1B running 100% local in-browser on Webgpu, run by transformers.js: loadalllama

A few hours ago, Dereseehek releases Janus Pro (1B & 7B), a multimodal LLM to make visual understanding and image generation. So, I have added support for the Transformer.Js model, which means that the model can run now 100% local in webgpu browser! I think this makes it the fastest way to run local model: Visit a website! I hope you enjoy! 🙂
Important Links:
– Online Demo: https://buggingface.co/spaces/webmlmmunity/janus-pro-wobgpu
– Onnx model: https://buggingface.co/onnx-munity/janus-proalsx
– source code: https://bitub.com/hugingface/transformers.js-examples/tree/main/janus-pro-wobgpu
https://external-preview.redd.it/cWlzM29xamVobWZlMRI2sWnlfg2FDSrRjInkFzMs3EdEEOYCx8go5Q48Mfdn.png?overlay-align=bottom,left&crop=1076:563.35078534,smart&overlay-height=15p&overlay=%2Fwatermark%2Ft5_81eyvm.png%3Fs%3Df3ac604eab03ae47aff3fe0d5ffe1c3ce7aeb3c1&width=1076&height=563.35078534&auto=webp&s=5d94fdc039e19d7057aa3347307905a77cf33bd2
2025-01-28 17:04:00