Pre-requisite Reading
I had earlier talked about how Claude Code can be jail-broken by customising its config and leveraging AI Gateway was one of the options. I come from a containerization first mindset and when I tried this with CCR earlier it didn't work because of a bug in it. This prompted me to explore other options and I tried Bitfrost this time that worked like a charm. This post has reference implementation of leveraging Bitfrost AI Gateway with Claude Code as its dependent service. The `docker-compose.yaml` is below for your reference on how I leveraged it for my development purpose.
-- --
Disclaimer: While I got things working with Bitfrost, I did experience sudden HTTP 400 Errors of request failures, in spite of changing the providers. This happened a couple of times for reasons unknown, even where those requests worked without using this AI Gateway. So, I would recommend you do your own beta testing in your self-hosted environment as PoC before making it mainstream.