Nano GPT logo
NanoGPT

Suggestions and bugs

Share what you'd like to see next in NanoGPT or upvote ideas from the community.

Add a suggestion

Let us know what would make NanoGPT more useful to you.

Paste screenshots with Ctrl+V.

If unchecked, only the NanoGPT team will see this request.

New suggestions need approval before going public, and sharing lets others upvote your idea.

Showing

Status

Owner

Prompt Caching for more models
Pending

Many providers do offer prompt caching nowadays and utilizing that yields great discounts. Unfortunately, through NanoGPT, we can't benefit from those (except with Claude, which is the most inconvenient to implement). That remains a big advantage of OpenRouter. For me personally, the most interesting providers are Moonshot AI, Google (Gemini) and DeepSeek. I am aware there are some suggestions like this already, but they can't be voted on, so this is my way of expressing demand. I'm also aware this might hurt your profits, if you only pay discounted rates while you charge base costs, but that would also mean the pricing isn't fair.

Team reply

1/29/2026

Thanks! So a few aspects to this. We actually implemented it for OpenAI yesterday, and want to add it for more models (likely Gemini next).

For Deepseek and co this is a bit more complicated. We generally do not run these models through the direct provider (Deepseek/Moonshot), mostly for privacy reasons. Some open source providers do offer prompt caching, so when those are used then we can pass it on, but this is a bit more complicated because they are not always the cheapest providers generally.

So have to figure out what we do there. Maybe people pass a "caching" header for those models/providers, or something.

Team reply

2/26/2026

We now haev this for Gemini as well - Milan

Updated 2/26/2026

2