Pikachu Pair Programming Agent
Team consisting of four University of Waterloo students and Shopify interns skilled in LLMs, prompt/meta‑prompting, ML evals, Python, TypeScript/React, NLP and fintech.
YouTube Video
Project Description
Real-time AI Pair Programming Assistant with Multimodal Intelligence and Visual Feedback
An advanced voice and text-enabled AI coding companion powered by Gemini 2.0 Flash Live, featuring bidirectional WebSocket streaming for ultra-low latency interactions. This intelligent agent provides comprehensive development assistance through an extensible tool ecosystem including:
• Contextual Code Intelligence - Dynamic file system access with security-scoped permissions for reading project files and external repositories
• Web-Scale Knowledge Integration - Live Google Search integration for real-time documentation lookup and research
• Smart Clipboard Management - Automated prompt generation and clipboard injection for seamless workflow integration with IDEs
• Selection tool - Model can automatically detect what the user is currently selecting for further context
• Session Persistence - In-memory session management with optional resumption capabilities for uninterrupted development sessions
• Electron-Based Desktop Overlay - Always-on-top, click-through interface featuring an animated Pikachu character with thought bubbles, particle effects, and customizable screen borders
Built on Google’s ADK (Agent Development Kit) with FastAPI backend, delivering production-grade async streaming architecture for both audio and text modalities. Perfect for developers seeking an intelligent, context-aware coding partner with both conversational intelligence and practical IDE integration.