Quantize ONNX Models with ONNX Runtime
Smaller INT8 ONNX models don't guarantee faster inference—pick dynamic or static quantization based on model type, data, and hardware.
NanoGPT Blog
Updates, guides, and insights
Showing
How to Build Tool-Using AI Workflows with the Responses API
A practical guide to custom tools, public MCP servers on supported OpenAI models, streaming tool calls, and stored response chains in NanoGPT's Responses API.
Hybrid storage scaling: key AI tradeoffs
Compare local, cloud, hybrid, and selective-sync AI storage—tradeoffs in speed, privacy, cost, and sync.
Use Your Own AI API Keys Without Losing a Safety Net
How NanoGPT's automatic BYOK preference uses your saved provider keys first, falls back to credits when appropriate, and lets you choose stricter behavior when needed.
Qwen3.8 Max Preview: What We Know Before the Benchmarks
Qwen3.8 Max Preview is available before its benchmark table. Here is what is confirmed, what remains unverified, and how to compare it fairly with Qwen3.7 Max.
Doubao Seed Character vs Aion 3: Which Roleplay Model Should You Use?
Compare Doubao Seed Character, Aion 3.0, and Aion 3.0 Mini for character chat, roleplay, long-form storytelling, image input, and price.
Fugu Ultra Benchmarks: When Multi-Agent AI Is Worth the Cost
See how Sakana AI's Fugu Ultra uses multiple AI agents, what its coding and reasoning benchmarks show, what it costs, and when the premium makes sense.
How to Choose an AI Web Search Tool
Compare Linkup, Brave, Tavily, Exa, Kagi, Perplexity, Valyu, Sofya, and Firecrawl by cost, search depth, page content, filters, and best use case.
Muse Spark 1.1 Benchmarks: How Good Is Meta's New Model?
Muse Spark 1.1 brings strong coding results, a 1M-token context window, and inexpensive cached input. Here is where Meta's new model stands out—and where it still falls short.
AI for Roleplay and Long-Form Storytelling with Aion 3.0
Use Aion 3 for immersive roleplay and longer stories with practical prompts for characters, scenes, continuity, pacing, and creative boundaries.