DeepSeek V4 Pro and Flash are now available on Vercel AI Gateway
TL;DR
Vercel AI Gateway now supports DeepSeek V4 Pro and V4 Flash, exposing both 1M-token context models behind the standard gateway interface with built-in observability and rate limiting.
What changed
Vercel added DeepSeek V4 Pro and V4 Flash to the AI Gateway. Both models support a 1 million token context window and are accessible through the gateway's unified API alongside existing providers, with the standard observability, rate limiting, and key management Vercel already exposes.
Why it matters
For developers, this collapses integration cost. You can route a percentage of traffic to DeepSeek V4 without changing application code, just gateway config. That makes real $/M token comparisons cheap to run: shadow the new models, compare outputs and latency on production-like prompts, then shift weight when the numbers justify it. The 1M token window is the headline capability for codebase-scale analysis, long document ingestion, and large RAG bundles where chunking strategies have been hurting answer quality.
What to watch for
Validate tool-calling and structured output reliability before you treat V4 Pro as a drop-in for your current reasoning model; MoE models occasionally regress on strict JSON schemas. Use the gateway's built-in metrics to catch tail latency, especially on prompts above 200K tokens where MoE routing overhead shows up. Set explicit per-model budgets in the gateway and watch your token spend daily for the first week, since aggressive context use can offset the lower per-token price.
Who this matters for
- Developers: Add the DeepSeek V4 model IDs to your gateway routing config and shadow-test them against your current provider for $/M tokens and p95 latency.
Harsh’s take
Developers, the gateway pattern is winning and you should commit to it. Hard-coding a single provider in your inference path was always a liability; with V4 Pro and Flash now in Vercel AI Gateway, swapping models is a config change, not a refactor. If your code still imports a vendor SDK directly in your hot path, fix that this sprint.
The interesting workload is long-context. 1M tokens through a gateway with observability means you can finally do whole-repo or whole-corpus prompts in production without writing your own metrics layer. Wire fallback routes from V4 Pro to V4 Flash on latency budget and stop overpaying for reasoning you are not using.
by Harsh Desai
About Vercel
View the full Vercel page →All Vercel updatesGo deeper
More AI news
- Daily RoundupPixelship agent on Replicate, Gemini 3.6 Flash batch on OpenRouter, and agent tools for builders
New agentic image tools and trending multimodal models arrived alongside expanded Gemini agent features and deployment options for production use.
- Daily RoundupKimi K3 on AI Gateway, mage-flow on Replicate, and agent tools for builders
Vendors added model access, regional routing, and Slack hooks while new image and agent products appeared on Replicate and Product Hunt.
- Weekly DigestHermes Agent 80% latency cuts and 51 updates, OpenClaw Mac app, and durable export tools
Hermes Agent rolled out dozens of stability, speed, and integration fixes across three days while OpenClaw added a Mac app and remote server catalog.