Quantize ONNX Models with ONNX Runtime
Smaller INT8 ONNX models don't guarantee faster inference—pick dynamic or static quantization based on model type, data, and hardware.
NanoGPT Blog
Updates, guides, and insights
Showing
228 posts found for 'models'
How to Build Tool-Using AI Workflows with the Responses API
A practical guide to custom tools, public MCP servers on supported OpenAI models, streaming tool calls, and stored response chains in NanoGPT's Responses API.
Hybrid storage scaling: key AI tradeoffs
Compare local, cloud, hybrid, and selective-sync AI storage—tradeoffs in speed, privacy, cost, and sync.
Use Your Own AI API Keys Without Losing a Safety Net
How NanoGPT's automatic BYOK preference uses your saved provider keys first, falls back to credits when appropriate, and lets you choose stricter behavior when needed.
Doubao Seed Character vs Aion 3: Which Roleplay Model Should You Use?
Compare Doubao Seed Character, Aion 3.0, and Aion 3.0 Mini for character chat, roleplay, long-form storytelling, image input, and price.
Fugu Ultra Benchmarks: When Multi-Agent AI Is Worth the Cost
See how Sakana AI's Fugu Ultra uses multiple AI agents, what its coding and reasoning benchmarks show, what it costs, and when the premium makes sense.
Muse Spark 1.1 Benchmarks: How Good Is Meta's New Model?
Muse Spark 1.1 brings strong coding results, a 1M-token context window, and inexpensive cached input. Here is where Meta's new model stands out—and where it still falls short.
AI for Roleplay and Long-Form Storytelling with Aion 3.0
Use Aion 3 for immersive roleplay and longer stories with practical prompts for characters, scenes, continuity, pacing, and creative boundaries.
GPT-5.6 Sol vs Terra vs Luna: Which One Should You Use?
Compare GPT-5.6 Sol, Terra, and Luna by quality, speed, price, coding performance, and long-context reliability—and see which tier fits your work.
How to Choose the Right Reasoning Effort for AI Models
Learn when to use low, medium, high, or maximum AI reasoning effort—and why more thinking is not always the better choice.