barehands
Move things on your screen with your bare hands. A webcam-powered, hand-tracked interface for your AI. No headset. No controllers.
What is it?
What it is
A webcam‑based hand‑tracking interface that turns your bare hands into a gesture‑controlled UI for browsing notes, images, and 3D models on a virtual glass board, using MediaPipe and three.js in a browser.
Why it exists
To enable hands‑free, natural manipulation of digital content (notes, media, models) without headsets or controllers, allowing users to interact with AI‑augmented workflows through gestures.
Who should use it
Developers, tech enthusiasts, and AI users (especially Claude Code users) seeking a hand-tracked augmented reality interface
Who should avoid it
Users without a webcam or reliable internet connection; those uncomfortable with basic terminal commands
How it works
A quick walkthrough in plain English
How barehands works
Step 1 of 3
You interact with it
Open barehands, send a request, or connect it to your stack.
Features
Advantages
- No installation required beyond Python server
- Works with any AI system
- Safety features (media jail, allowlist)
- Customizable UI elements
- Supports commercial use
- Active community support
- Modular architecture (swap components)
- Gesture tuning for different hand sizes
- Multi-format media support
- Transparent development process
Disadvantages
- Requires Python environment
- Limited to Chrome browser
- Webcam dependency
- AGPL license restrictions
- Potential performance issues on low-end hardware
- Gesture calibration needed
- No built-in AI (requires external integration)
- Limited to 2D screen space
- No mobile support
- Initial setup complexity
Installation
native
git clone https://github.com/jaredrhod/barehands cd barehands python3 server.py
FAQ
How do I install and run barehands?
Install by cloning the repository and running python3 server.py (or python server.py on Windows). Then open http://127.0.0.1:8794/stage.html in Chrome, allow camera access, and wave your hands. The server uses standard library Python and loads MediaPipe and three.js from CDNs automatically.
Can I use my existing Claude Code session with my AI agent?
Yes. Simply clone the repo and run the setup wizard by telling your agent: "read barehands.md and set me up." The wizard interviews you, creates the configuration, and wires your assistant directly into the barehands system.
Where should I place my notes and media files for the board?
Create an `media/` folder and organize files within subdirectories like `media/misc/` for images, `media/fx/` for transparent props, `media/models/` for 3D models, or `media/holo/` for holographic items. Only files inside `media/` can appear on the board—these act as a safety jail.
How do I connect an external AI assistant to control the board?
There are two methods: (1) The ring acts as a face—write status strings like "thinking", "idle", or "speaking" to `state/state` in the `state/` directory. (2) The board acts as a stage—use `bin/board.sh` with a JSON payload (e.g., `{"a":"present","title":"THE PLAN","body":"..."}`) to present content, or call `add_card`, `add_img`, `hand`, `explode`, `yank`, `hover`, etc., via `bin/board-state.sh` to stage elements for your AI to interact with.
What hand gestures can I use to manipulate objects on the board?
Barehands supports multiple natural gestures: quick taps (pinches) open and close, pinch-drags move objects, holding still while carrying rotates 3D models in 3D space, two-handed scaling, flicking throws objects away, clapping sweeps the board clean, and the "claw" gesture (open hand → claw shape → aim → shake → snap) allows you to rip virtual objects apart.
Is there support for recording or streaming the board?
Yes, advanced usage includes streaming via OBS. Use `stage.html?role=render` for a transparent mirror of the camera feed, adjust parameters like `&cursors=0` to hide finger rings, `&ss=2` for 2x resolution, and `?portrait=1` for vertical 9:16 framing. For high-quality self-view, use `&res=3840x2160` for 4K capture.
Featured in Videos
YouTube tutorials and walkthroughs for barehands
Alternatives
Similar projects ranked by category, topics, and text overlap.
