Bro-Pilot · AI Assistant & Autonomous Goal Agent

BroPilot is a local-first, privacy-respecting AI browser pilot, autonomous goal agent, smart web clipper, and research assistant designed for deep web research and on-device AI execution. Run complete AI models directly inside your browser tab using WebGPU (WebLLM), connect to your own local inference hardware (Ollama, Apple Silicon MLX, vLLM), or configure your favorite cloud AI providers with your own private API keys. ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ KEY CAPABILITIES: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1. 🖼️ SEARCH + IMAGE & PAPERBANANA INFOGRAPHICS: • Synthesize publication-ready technical architecture diagrams, process pipelines, and scientific flowcharts directly from any webpage or web search query. • Powered by local FLUX.2 Klein 4B, Qwen-Image 2.1, and on-device vector engines adhering to Nature and NeurIPS visual standards. • In-Tab Fullscreen Viewer: Click any generated diagram to inspect in high-resolution directly on your current tab with 125% zoom toggle, download options, and quick close. 2. 🎯 AUTONOMOUS BROWSER GOAL AGENT: • Give high-level goals in plain English (e.g., "Compare enterprise cloud pricing across top three providers and export a comparison table"). • Dual-Perception AI: Navigates complex websites using viewport visual understanding paired with accessibility trees. • Viewport Boundary Lights: In-page glowing perimeter lights and real-time status HUD keep you informed of every step. • Safety Safeguards: Pauses and asks for human confirmation before sensitive actions (payments, form submissions, or deletions), with an instant emergency stop button. 3. 🎙️ HANDS-FREE VOICE ASSISTANT & TTS-NATURAL PERSONAS: • Speak naturally with hands-free voice prompt dictation powered by in-browser Whisper WebGPU. • Expressive read-aloud responses with TTS-Natural personas, including natural Indian English and Hindi personas (Swara, Kabir, Priya) with native currency expansion (₹, Rs., Lakh, Crore) and global presets. 4. 100% LOCAL & IN-BROWSER AI (WebGPU): • Run open-source language models (Qwen 2.5, Llama 3.3, SmolLM2, Gemma) directly inside your browser with WebGPU hardware acceleration. • Persistent Model Caching: Download weights once via IndexedDB/OPFS and run completely offline with zero server round-trips. 5. 🍎 LOCAL HARDWARE INFERENCE BRIDGE: • Connect seamlessly to local runners: Ollama (http://127.0.0.1:11434), Apple Silicon MLX (http://127.0.0.1:8080), or custom OpenAI-compatible endpoints. • Automatic memory offloading (keep_alive: 0) when switching models to prevent GPU VRAM memory bloat. 6. 📝 AI AUTO FORM-FILLER & DEVELOPER TOOLS: • Smart Form-Filler: Automatically scans in-page forms and batch-populates inputs from your secure local profile with synthetic event dispatch. • Terminal Bridge: Connect browser workflows to your local development terminal (bash/zsh) for verified command execution. 7. 📑 SMART WEB CLIPPER & RESEARCH VAULT: • Clean Article Extraction: Strips clutter, ads, navigation bars, and overlays via Readability algorithms. • Keyboard Shortcuts: Press Command+Shift+S (Ctrl+Shift+S) to clip and save articles in clean Markdown with YAML frontmatter. • Instant Summarization: Generate executive summaries, key takeaways, and structured outlines with one click. • Context Menu Actions: Highlight text and right-click to "Clip selection to Research" or "Ask BroPilot about selection". 8. ⚡ MODELFIT HARDWARE PROFILER: • Automatically inspects local system memory, CPU cores, and WebGPU shaders to recommend safe model sizes and quantization levels (FP8, INT4, Q4_K_M), preventing out-of-memory browser crashes. 9. 🌐 OPTIONAL MULTI-CLOUD PROVIDERS: • Direct support for Google AI Studio (Gemini 2.5/2.0 Flash), GitHub Copilot (OAuth device sign-in), OpenRouter, Anthropic, and OpenAI using your own private API keys. • Direct client-to-provider requests with zero intermediary proxy logging. ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ PRIVACY & SECURITY GUARANTEES: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ • Zero Data Sale: We never sell, rent, monetize, or transfer your browsing data to advertisers or third parties. • Zero Remote Telemetry: No analytics trackers, behavioral profiling scripts, or advertising SDKs. • 100% Local Storage: All notes, vault profiles, conversation histories, and session tokens remain on your machine in isolated extension storage (chrome.storage.local). • Manifest V3 Compliant: Strict Content Security Policy (script-src 'self' 'wasm-unsafe-eval') blocking remote code injection. ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ HOW TO USE: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1. Open any webpage, documentation page, or research article. 2. Press Command+Shift+A (Ctrl+Shift+A) or click the extension icon to toggle the sidepanel. 3. Select an in-browser WebGPU model or connect to your local Ollama/MLX instance in Options. 4. Clip articles, ask grounded questions, generate PaperBanana visual diagrams, or launch autonomous goal browsing. ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ DOCUMENTATION & OPEN SOURCE: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ • Public Repository: https://github.com/kp-algomaster/bropilot • Privacy Policy: https://github.com/kp-algomaster/bropilot/blob/main/PRIVACY.md • Issues & Feedback: https://github.com/kp-algomaster/bropilot/issues