Nano GPT logo
NanoGPT

Suggestions and bugs

Share what you'd like to see next in NanoGPT or upvote ideas from the community.

Add a suggestion

Let us know what would make NanoGPT more useful to you.

Paste screenshots with Ctrl+V.

If unchecked, only the NanoGPT team will see this request.

New suggestions need approval before going public, and sharing lets others upvote your idea.

Showing

Status

Owner

Custom HuggingFace support
Accepted

Your application already supports over 500 LLMs, and the Custom CivitAI update got me thinking - it would be incredible if users could access HuggingFace models through NanoGPT. Because RAM and GPU prices are rising, an AI rig is impossible for the average consumer, myself included. Adding this feature would be perfect because users could access more models and use them without getting expensive hardware. The basic idea would be to find a HF URL, like https://huggingface.co/mradermacher/Huihui-GLM-4.7-Flash-abliterated-i1-GGUF (a currently inaccessible model) that contains GGUFs and then to paste and submit it. Like Custom CivitAI, the LLM would have to be resolved to be used, but once finished you could start using it. Likely all users would enjoy this feature.

Team reply

1/29/2026

Thanks! We'd love to add something like this but as far as we know this is not possible to add in a cheap way - as in while this is possible for image models there is no "load on demand" for text models. Maybe we are wrong - if you did find it somewhere we'd definitely love to know! - Milan

Author

1/29/2026

Take a look at https://synthetic.new and their documentation. It appears that they offer this service using vLLM. It might not hurt to look at their API and see if it can be integrated, even if it's more expensive than a normal provider

Updated 1/29/2026

2