NyandSign — Hand Sign Control

What is NyandSign? NyandSign is a Chrome extension that detects hand signs with your webcam and lets you control media playback and browser actions hands-free. It uses Google MediaPipe's on-device AI to recognize hand signs in real time. All processing happens locally in your browser, and your camera feed is never sent to any external server. Use hand signs to control media on sites like YouTube, Spotify, and Netflix, or switch to Browser Control mode for scrolling, back/forward navigation, tab switching, and zoom. Any regular webcam works, and supported electric glasses camera devices can also be used. With XREAL Eye, you can choose between the high-resolution RGB camera and the low-resolution 6DoF monochrome camera. KEY FEATURES 🖐️ 12 Recognizable Hand Signs Fist, Peace, Three, Four, OK, Aloha (shaka), Rock, Point Right, Point Left, Point Up, Thumbs Up, and Thumbs Down — each sign can be mapped separately for each operation mode. 🎬 Media Control Mode ▶⏸ Play / Pause 🔊🔉 Volume Up / Down 🔇 Mute ⏩⏪ Seek Forward / Backward (10 seconds) ⏭⏮ Next / Previous Track ⏫⏬ Playback Speed Up / Down 2× 2x Speed 1× Reset Playback Speed 🌐 Browser Control Mode ↕ Hold to Scroll — hold the assigned sign and move your hand up, down, left, or right to scroll ↟↡ Page Top / Page Bottom ↩↪ Back / Forward ⇥⇤ Next Tab / Previous Tab ⇡⇣⇠⇢ Cursor Up / Down / Left / Right ↻ Reload ＋− Zoom In / Zoom Out 100% Reset Zoom 🟡 Pointer Control Mode Display a virtual cursor inside the page, hold an assigned hand sign, and move your hand to move the cursor. Use a separate click sign to click links, buttons, and other page elements. This is implemented as an in-page virtual cursor within what a Chrome extension can control; it does not move the operating system mouse cursor itself. ⚡ Fully Customizable Switch between Media Control, Browser Control, and Pointer Control modes Customize hand sign mappings separately for each mode Adjustable gesture hold time to reduce accidental triggers Repeatable actions for continuous volume, seek, scroll, and zoom control Wake sign mode — require an activation sign before commands are accepted Wake sign options — Open Hand (either side), Open Hand (palm only), or always active Two-hand signs — toggle operation ON/OFF or switch operation modes Built-in tutorial — explains the basic flow and core operation modes 📌 PiP (Picture-in-Picture) Mode When fullscreen video makes the side panel intrusive, switch to a compact popup window. In PiP, Media Control mode uses a green border, Browser Control mode uses a blue border, and Pointer Control mode uses an amber border, so you can tell which mode is active at a glance. 🎯 Target Tab Control Send gesture actions to a specific tab. Pin a target tab to control background media or a specific page while browsing elsewhere. 👓 Electric Glasses Camera Support NyandSign supports XREAL Eye UVC0 (RGB) and UVC1 (6DoF monochrome) camera selection. Because Windows may show similar labels for both cameras, NyandSign detects the camera profile from actual resolution and capabilities instead of relying only on the display name. UVC1 uses its native 512x378 resolution and applies preview aspect correction, light smoothing for grainy monochrome video, contrast correction, and brightness compensation. When Chrome exposes camera controls, NyandSign also tries to apply exposure/brightness controls. 🔒 100% Local & Private All hand tracking runs on-device using WebAssembly. Your camera feed never leaves your browser. No cloud processing, no data collection, no accounts required. 🌐 Bilingual English and Japanese (日本語) interface support. BENEFITS OF INSTALLING NyandSign Hands-free convenience — Control media and pages while cooking, exercising, eating, or when your hands are occupied. Accessibility — Provides an alternative input method for users who have difficulty using a keyboard or mouse. Electric glasses camera support — Designed to work with supported XREAL / Nreal camera devices. With XREAL Eye, you can choose UVC0 (RGB) or UVC1 (6DoF monochrome) to balance recognition quality and device load. Distraction-free viewing — PiP mode lets you enjoy fullscreen content without a visible side panel while keeping hand sign control active. Flexible controls — Configure media and browser actions separately, and map your most-used actions to the signs that feel natural to you. No additional software — Everything runs as a lightweight Chrome extension. No desktop apps, drivers, or accounts needed. WHY THESE PERMISSIONS ARE NEEDED NyandSign requests the minimum permissions required to function. Here is exactly what each permission does and why it is necessary: activeTab Allows the extension to interact with the currently active tab when you click the extension icon. This is needed to inject the content script into the page you are viewing, so media actions and browser-page actions such as scrolling can reach the page. tabs Allows the extension to read tab titles and manage tab-related actions. This is used for the Target Tab feature and for actions such as Next Tab and Previous Tab. Tab information is only used locally in the side panel and is never transmitted anywhere. scripting Allows the extension to inject a small content script into web pages. This script is the bridge between NyandSign and the page: it receives gesture commands and applies them to media elements or page scrolling. Without this permission, gestures could be detected but could not control the page. storage Allows the extension to save your settings, including hand sign mappings, operation mode, volume preferences, and display options, in Chrome's built-in storage. Your configuration persists across browser restarts. If Chrome Sync is enabled, Chrome itself may sync this settings data across your devices. NyandSign does not send it to its own external servers. sidePanel Allows the extension to display its interface as a Chrome side panel. The side panel is the primary UI where you see…