Prompt Compass

Prompt Compass revolutionizes prompt management by routing requests to the most cost-effective model while enhancing security. Key capabilities include: * Optimal prompt routing to minimize cloud expenses * Automatic PII leak detection and blocking * Jailbreak attempt prevention * Ultra-lightweight ~0.57 MB footprint * Real-time, on-device decision making in ~5 ms This robust system significantly reduces cloud expenses by ensuring each prompt is handled by the cheapest suitable model, achieving savings up to 96%. It operates as a critical guardrail, proactively identifying and neutralizing potential PII leaks and malicious jailbreak attempts before they reach any external Language Model, all within milliseconds and directly on-device. This ensures high privacy and rapid response times. Designed for developers and organizations utilizing language models, Prompt Compass offers flexible integration through an npm SDK, VS Code/Cursor extension, and a free tier to get started. Its minimal resource consumption allows deployment in diverse environments, from mobile devices to CDN edge workers, making it an ideal solution for balancing cost, security, and performance in language model interactions.