The editorial argues that Astra's most substantive change isn't raw intelligence but a shift in product philosophy — conceding that ambiguous prompts deserve questions rather than confident guesses. Frames this as a UX decision and 'the right one' after three years of one-shot racing.
Argues that when given a poorly constrained or ambiguous prompt, users don't want the model one-shotting assumptions. Says 'real AGI should act more like a coworker' — someone who asks before charging ahead.
Ran his pelican-on-a-bicycle SVG benchmark and found the 'max' tier took 4 minutes 2 seconds and cost 63.206 cents for a single generation. The visible quality improvement over GPT-5.6 doesn't obviously justify the roughly 40x latency premium.
Points out that OpenAI's own scorecard notes the responses-API harness would put Sol around ~30%, while the published GPT-5.6 Sol number sits at 7.8%. That discrepancy makes the headline ARC-AGI-3 improvement look, at minimum, misleadingly presented.
Argues that 'the biggest constraint when working with models is not their intelligence, but their speed' because instructions are inherently ambiguous and new facts constantly arrive. Faster iteration beats a smarter single shot in real workflows.
OpenAI shipped GPT-6 Astra on Friday, publishing a system card at deploymentsafety.openai.com/gpt-6-astra and lighting up access on OpenRouter simultaneously. The launch comes with three tiers — standard, pro, and 'max' — and a system prompt architecture that pushes the model toward clarifying user intent rather than steamrolling ambiguous requests.
Simon Willison got access and ran his standard pelican-on-a-bicycle SVG benchmark. The 'max' tier took 4 minutes 2 seconds to generate a single SVG and cost 63.206 cents per run — a data point that lands harder than any benchmark chart. He posted a side-by-side grid comparing Astra's pelicans against GPT-5.6's, and the improvement is visible but not obviously worth the 40x latency cost.
On the benchmark front, OpenAI is touting major gains on the Artificial Analysis Coding Agent Index and improved scores on ARC-AGI-3. But the ARC-AGI-3 story is already contested. HN commenter intenex pointed out that OpenAI's own scorecard notes the responses-API harness would put Sol 'in the ballpark of ~30%,' while the published GPT-5.6 Sol number sits at 7.8% — a discrepancy that makes the headline improvement look, at minimum, aggressively framed.
The most substantive change in Astra isn't intelligence — it's product philosophy. After three years of models racing to one-shot everything, OpenAI has quietly conceded that the right behavior for an ambiguous prompt is to ask a question, not guess confidently. HN user jumploops captured the shift: 'If I give a poorly constrained/ambiguous prompt, I don't want the model one-shotting assumptions left and right... real AGI should act more like a coworker.' That's not a benchmark. It's a UX decision, and it's the right one.
The speed conversation is more uncomfortable. Commenter tappio argued that 'the biggest constraint when working with models is not their intelligence, but their speed' — because instructions are always ambiguous, new facts emerge during implementation, and iteration count matters more than one-shot correctness. Astra Max, at 4 minutes per response, is a bet in the opposite direction: that if you make the model smart enough, you can afford fewer turns. The pelican data suggests OpenAI hasn't earned that bet yet. A 40x latency multiplier for a marginally better SVG is not a product; it's a research artifact you can rent by the token.
There's also the Chollet-shaped elephant in the room. HN user astrobiased noted the parallel to Francois Chollet's *On the Measure of Intelligence* — most frontier progress still looks like skill acquisition optimization, not generalization. Broader benchmark coverage, more domains absorbed, better tool-use plumbing. That's real engineering value. It's not, however, the thing the marketing keeps implying it is. Astra is a better product than GPT-5.6. It is not a phase change, and the ARC-AGI-3 numbers being disputed on launch day is exactly the kind of signal that should make you slow down before rewriting your architecture around it.
The coding-agent numbers are more interesting than the AGI numbers, and probably more relevant to anyone reading this. If Astra actually holds up on the Artificial Analysis Coding Agent Index under real workloads — not just benchmark harnesses tuned for it — that changes the math on autonomous agents doing multi-file refactors, PR reviews, and long-running background tasks. That's where the 4-minute latency stops looking absurd. Nobody cares if a background agent takes 4 minutes to open a PR. Everybody cares if your IDE completion takes 4 minutes.
If you're building on OpenAI's API today, three practical things change.
First, the pricing tier question got harder. Astra Max at ~63 cents per run means the interactive/agentic distinction is now a first-class architecture decision, not a config flag. You need a router: cheap fast model for the loop, Astra standard for structured tasks, Astra Max for the once-a-day 'plan the migration' call. Anyone shoving Max into a hot path is going to blow their budget before the end of the sprint.
Second, the clarifying-question behavior is going to break some of your prompts. Systems that assumed the model would produce output — any output — on the first turn are now going to get questions back. That's actually good for quality, but if your orchestration expected a single-turn contract, you have refactoring to do. Test your agent loops before flipping the model version.
Third, don't rewrite anything based on ARC-AGI-3 marketing. Wait for independent replications of the Coding Agent Index numbers, ideally on your own tasks. The gap between 'benchmark under ideal harness conditions' and 'production behavior on your codebase' is where most frontier-model migrations quietly fail. Simon's pelicans exist precisely because generic benchmarks stopped telling you anything useful about how a model behaves on the specific weird thing you actually do.
The honest read on Astra is that it's an incremental release dressed as a phase change. The genuinely new thing — asking clarifying questions instead of guessing — is a product decision worth copying, and it's the part that will probably influence how the rest of the industry ships models next. The 4-minute Max tier is a research demo you can pay for. The benchmark contest is going to keep being noisy. If you build for the middle tier and treat Max as a specialty tool, Astra probably earns a spot in your stack. If you're waiting for the model that makes your agents actually reliable in production, keep waiting — this isn't it, and OpenAI's own launch behavior suggests they know.
System Card: <a href="https://deploymentsafety.openai.com/gpt-6-astra" rel="nofollow">https://deploymentsafety.openai.com/gpt-6-astra</a><p>Related ongoing threads:<p><i>
→ read on Hacker NewsI finally got access. Here are the pelicans! https://tools.simonwillison.net/markdown-svg-renderer?url=ht...The "max" one at the bottom took 4 minutes 2 seconds and cost 63.206 cents.For comparison, here those new Astra pelicans are in a grid with the GPT-5.6 pelicans: https
I think the thing I'm most excited about is the increase in _user prompting_.If I give a poorly constrained/ambiguous prompt, I don't want the model one-shotting assumptions left and right.The demos of Fable/GPT-6 are impressive, but "real AGI" should act more like a co
I feel that for some time now, the biggest constraint when working with models is not their intelligence, but their speed. It does not matter how smart the model is, it will make mistakes, because the instructions are ambiguous and new facts are found during implementation. The biggest problem I
The ARC-AGI-3 scorecard is extremely misleading given that it clearly states itself that "with [the responses API] harness, we estimate Sol would score in the ballpark of ~30%." but it shows a score of 7.8% for GPT-5.6 Sol presumably since if they updated the percentage for GPT-5.6 Sol to
Top 10 dev stories every morning at 8am UTC. AI-curated. Retro terminal HTML email.
I can’t help but notice how much this echoes Francois Chollet’s On the Measure of Intelligence: https://arxiv.org/abs/1911.01547Most of frontier-model progress still looks like skill acquisition optimization: broader benchmark coverage and performance, more domains absorbed into