The editorial frames Astra's behavioral shift — refusing to one-shot ambiguous prompts — as the first frontier model where restraint is treated as a feature, not a failure. This addresses the dominant failure pattern in production agent systems and is more important than raw capability gains.
Argues that a 'real AGI' should behave like a co-worker who asks questions when a prompt is poorly constrained, rather than confidently making assumptions. Sees Astra's clarifying-question behavior as the correct model of how agents should handle ambiguity.
Running his pelican-on-a-bicycle SVG benchmark, Willison found a single max-tier generation took 4 minutes and cost 63.2 cents — a 100x+ jump over GPT-5.6 for output that's visibly better but nowhere near proportionally so. The result frames Astra's top tier as economically hard to justify for most workloads.
Points out that the ARC-AGI-3 scorecard itself notes competing models would reach around 30% under the Responses API harness, yet the leaderboard still cites the older 7.8% figure. Argues the fine print undermines the celebratory framing of Astra's score and gets lost when the chart is screenshotted.
OpenAI's launch positions Astra as a substantial step forward on agentic workloads, highlighting major gains on the Artificial Analysis Coding Agent Index and a notable ARC-AGI-3 result. The company is pushing the agent-behavior narrative — including the clarifying-question behavior — as the defining story of the release.
Submitted the OpenAI launch post which cleared 2,200 points, amplifying the framing that Astra is a significant frontier release worth broad developer attention. The submission foregrounds the system card and the coding-agent benchmark threads as the key artifacts.
Surfaced the OpenRouter availability of GPT-6 Astra, treating the immediate multi-provider rollout as evidence of a serious frontier launch. The submission's traction reflects developer interest in getting hands-on API access quickly.
OpenAI shipped GPT-6 Astra today, with API access rolling out through OpenRouter and the standard OpenAI endpoints. The launch thread on Hacker News cleared 2,200 points within hours, and the system card is live at deploymentsafety.openai.com/gpt-6-astra. There are three tiers — standard, pro, and max — with pricing that scales aggressively at the top end.
Simon Willison, who has been running his "pelican riding a bicycle" SVG benchmark against every frontier model release for the last two years, got access and posted results within the first day. The max-tier pelican took 4 minutes 2 seconds to generate and cost 63.206 cents — a single SVG. For comparison, GPT-5.6's pelicans came in at fractions of a cent and completed in seconds. The quality gap is visible but not proportional to the 100x-plus cost delta.
OpenAI is also pushing Astra hard on agent benchmarks. The model shows major gains on the Artificial Analysis Coding Agent Index and posted a notable score on ARC-AGI-3, though — as commenter `intenex` flagged on the HN thread — that ARC-AGI-3 scorecard is being read more charitably than the fine print supports. The scorecard itself states that with the Responses API harness, a competing model would land around 30%, yet the leaderboard still shows the older score of 7.8%. It's the kind of asterisk that gets lost in screenshots.
The interesting shift in Astra isn't the raw capability jump — it's the behavioral one. Multiple early users landed on the same observation: Astra asks clarifying questions instead of guessing. Commenter `jumploops` put it directly: "If I give a poorly constrained/ambiguous prompt, I don't want the model one-shotting assumptions left and right... 'real AGI' should act more like a co-worker." This is the first frontier model where refusing to guess is treated as a feature rather than a failure mode.
That matters because the dominant failure pattern in production agent systems for the last eighteen months has been exactly this: a model receives an underspecified task, silently picks a plausible interpretation, and executes twelve tool calls down the wrong path before anyone notices. The fix has been elaborate prompt scaffolding — "if unclear, ask a question first" prepended to every system prompt, sometimes reinforced with structured output schemas that force a `clarification_needed` field. Astra bakes that behavior in.
The community reaction also surfaces a deeper critique. Commenter `astrobiased` pointed at François Chollet's *On the Measure of Intelligence* (arXiv:1911.01547), noting that "most of frontier-model progress still looks like skill acquisition optimization: broader benchmark coverage and performance, more domains absorbed into training." It's a fair charge. Every model release since GPT-4 has been a bigger sponge, not a smarter one. Astra's user-prompting behavior is one of the first releases where the pitch is *how* the model reasons, not *what* it knows.
But then there's `tappio`'s point, which cuts against all of this: speed is now the real constraint, not intelligence. "It does not matter how smart the model is, it will make mistakes, because the instructions are ambiguous and new facts are found during implementation." In a tight agent loop — read file, plan, edit, test, re-plan — a model that takes 4 minutes per turn is unusable regardless of quality. The max tier of Astra may produce beautiful code, but it produces it at a cadence that breaks most agentic workflows. The bulk of real-world value will come from the standard tier, where latency is measured in seconds rather than minutes.
The ARC-AGI-3 dust-up is worth watching too. OpenAI's marketing team has gotten aggressive about which harnesses they benchmark against, and the ARC team's public accounting has become the closest thing the industry has to an independent auditor. When the scorecard's own footnotes contradict the headline number, that's not a minor formatting issue — it's a signal that comparative claims from the lab announcements should be treated as marketing until reproduced.
If you're building agents, three things change this week. First, revisit your clarification scaffolding. If you've been prompting "ask before acting" into every system message, test whether Astra needs it. Early reports suggest the model will interrupt and ask on its own for underspecified inputs. That could let you delete a lot of defensive prompt engineering — or it could break workflows that assumed the model would always return *something* executable. Either way, it's a behavior change worth budgeting an afternoon for.
Second, tier your model calls harder than you already do. The 100x cost delta between standard and max Astra means the "just use the best model everywhere" pattern is now a burn-rate problem. Route the model selection off the task type, not the model marketing. Use max for one-shot synthesis where quality dominates cost — long editorials, complex refactors, one-turn coding tasks. Use standard for anything inside a loop. If your framework doesn't make model routing a first-class configuration, this is the release that forces the refactor.
Third, treat vendor benchmark claims with a fresh coat of skepticism. The ARC-AGI-3 asterisk is a reminder that leaderboard positions are increasingly a function of which harness and which prompt template the lab chose to run. Independent evaluations — Simon's pelicans, Artificial Analysis, ARC-AGI direct — are the only numbers that generalize. If a launch post cites its own internal benchmark and doesn't show head-to-head against Anthropic's or Google's latest on a shared harness, assume the framing was chosen to flatter.
Astra is the first model release in a while where the *behavior* is more interesting than the *capability*. If OpenAI has genuinely trained the model to push back on ambiguous prompts, that's a structural change to how agent frameworks get built — the model becomes an active participant in scoping rather than a passive executor. But we won't know if it's real until developers have run it in loops for a few weeks and reported how often the "ask a question" behavior fires appropriately versus how often it stalls a workflow that just needed the model to pick something plausible and move on. Expect a wave of "Astra in production" postmortems within the month. Read those before you commit the max tier to your budget.
System Card: <a href="https://deploymentsafety.openai.com/gpt-6-astra" rel="nofollow">https://deploymentsafety.openai.com/gpt-6-astra</a><p>Related ongoing threads:<p><i>
→ read on Hacker NewsI finally got access. Here are the pelicans! https://tools.simonwillison.net/markdown-svg-renderer?url=ht...The "max" one at the bottom took 4 minutes 2 seconds and cost 63.206 cents.For comparison, here those new Astra pelicans are in a grid with the GPT-5.6 pelicans: https
I think the thing I'm most excited about is the increase in _user prompting_.If I give a poorly constrained/ambiguous prompt, I don't want the model one-shotting assumptions left and right.The demos of Fable/GPT-6 are impressive, but "real AGI" should act more like a co
I feel that for some time now, the biggest constraint when working with models is not their intelligence, but their speed. It does not matter how smart the model is, it will make mistakes, because the instructions are ambiguous and new facts are found during implementation. The biggest problem I
The ARC-AGI-3 scorecard is extremely misleading given that it clearly states itself that "with [the responses API] harness, we estimate Sol would score in the ballpark of ~30%." but it shows a score of 7.8% for GPT-5.6 Sol presumably since if they updated the percentage for GPT-5.6 Sol to
Top 10 dev stories every morning at 8am UTC. AI-curated. Retro terminal HTML email.
I can’t help but notice how much this echoes Francois Chollet’s On the Measure of Intelligence: https://arxiv.org/abs/1911.01547Most of frontier-model progress still looks like skill acquisition optimization: broader benchmark coverage and performance, more domains absorbed into