Pdufour Debuts Browser-use-wasm To Automate Web Browsers Locally

browser-use-wasm is a client-side tool that lets vision-language models automate web browsers without a backend server. It captures screenshots of a webpage and uses an AI model to decide what actions to take, such as clicking or typing. This entire process runs directly inside your web browser.
A developer named pdufour created this tool to run browser automation fully self-contained in a single browser tab. They combined several technologies like WebGPU and WASM to make the model process visual inputs locally. This approach completely removes the need for a remote server to handle the heavy lifting.
Project capabilities and ideal users
- Runs entirely client-side without backends.
- Captures webpage screenshots for vision processing.
- Supports clicking, typing, and dropdown changes.
- Uses the ShowUI-2B model by default.
- Requires Chrome or Edge with WebGPU support.
- Offers a small embed API for applications.
People who need to automate web tasks locally will find this tool useful. It allows users to run AI agents directly on their own hardware to maintain privacy. Developers can also easily integrate this technology into their own web applications.
Development challenges and feedback
The developer notes that browser automation is very difficult and currently only a limited set of actions work reliably. Testing tools like Mind2Web and MiniWob helped improve the accuracy of the clicks and inputs. The creator shared the project online to gather feedback and ideas for future development.
"This code is super super alpha and a lot of stuff is probably broken but I thought I would share with Reddit to ask for feedback and see if people had any ideas on how to develop this further." — Source: Reddit