ProxAI

ProxAI provides precise control over API expenditures by acting as a transparent reverse proxy. Key features include: * Enforces hard hourly and daily spending limits per client * Requires only a base_url change, no SDK modification * Compatible with multiple providers including OpenAI, Anthropic, and Mistral * Returns a 429 error before upstream call if cap is exceeded * Self-hostable with a small footprint (single Go binary, ~10 MB Docker image) This tool ensures that your API usage never exceeds your predefined budget, preventing unexpected charges. It operates by intercepting requests and immediately blocking them if a spending cap has been reached. This "circuit breaker" functionality means your maximum liability is your set cap, not an overextended credit card bill. Integration is straightforward, requiring only a simple change to your SDK's base URL, making it quick to deploy without complex code alterations. ProxAI is ideal for developers, startups, and enterprises who need to manage and monitor their API costs effectively across various providers. Whether you're running prototypes, batch processing, or integrating large language models into production applications, this tool provides real-time oversight and protection against cost overruns. It's particularly useful for teams looking to maintain strict budget discipline while experimenting with or deploying external services.