StandardsAboutContact
The Weights
Gemini 4 Argon for Robots: Wait for Independent Tests

Gemini 4 Argon for Robots: Wait for Independent Tests

Google reports 87% on its own ERQA test, but Artificial Analysis's robot-arm test ranks Argon third at 55.3 of 100.

Wait. Gemini 4 Argon's 87 percent on ERQA is Google's own result, while Artificial Analysis's AA-Robotics v0.1 ranks it third with 55.3 of 100 on a real robot arm. Google's demo prompts also supply skills and scaffolding. Evaluate it in simulation, not closed-loop hardware.

The Weights Desk · 4 min read

The verdict on Gemini 4 Argon is Wait. Google's launch post claims 87 percent on the ERQA embodied-reasoning benchmark and says that outperforms every other frontier model. The independent number is weaker: Artificial Analysis's AA-Robotics v0.1 puts Argon third at 55.3 of 100. The pitch of one model for control, simulation and data evaluation is plausible, but the published evidence does not yet show it. This piece reads the primary pages; we did not run the model ourselves.

The 87 percent is a vendor number

Google's post states that, using pure reasoning, Argon scores 87 percent on ERQA. The Decoder reports the chart's comparison scores as 82.3 percent for Claude Opus 5.5, 81 percent for GPT-6 Astra and 74 percent for Claude Fable 5.1, on 400 questions without helper tools. The benchmark repository is public, but the run and the model selection are Google's. Until a third party reproduces the score, treat it as a vendor claim.

The independent robot test is less flattering

Artificial Analysis describes AA-Robotics v0.1 as a research preview in which each model controls a physical 6-axis arm, identified as a Hiwonder NexArm, through eight tabletop tasks. It reports GPT-6 Astra at 69.4, GPT-6.1 Sol at 64.6 and Gemini 4 Argon at 55.3. The test is early and narrow, but it is the only hardware result we found that Google did not run itself.

The demos come with scaffolding

Google publishes full prompts for each demo. The Spot prompt begins by invoking a 'spot-mobile-manipulation skill', so a pre-built capability already exists. According to The Decoder, the cup-righting demo supplies a camera image with a centimeter-grid overlay and commands such as grasp and lower until contact, and the simulation prompts carry long prohibition lists. That shows the demos need engineering support. It does not show how the model performs without it.

Simulation gains lack an attempt count

For the party-props demo, Google's post says simulation data lifted real-world success from 56 percent to 75 percent and cut completion time from 35 to 24 seconds. It does not state how many real attempts sit behind those rates. The 4,500-plus episodes it cites are simulated. A percentage without a denominator is a lead, not evidence, so reproduce it before relying on it.

The bottom line: Wait

Wait. Test Gemini 4 Argon in simulation and on training-data scoring, where mistakes are cheap, using your own tasks and logging every prompt aid you add. Do not move it into closed-loop control on real hardware until a third party reproduces the ERQA result and its AA-Robotics score of 55.3 improves. Google's post lists access through Google AI Studio and the paid Gemini API tier, so a bounded trial is possible. Re-check when AA-Robotics or an independent group publishes new runs.

Should teams adopt Gemini 4 Argon for robot control now?
Not for production. The headline benchmark is Google's own, and the one independent robot-arm test we found ranks it third. Trial it in simulation on your own tasks first.
What is the one number that decides the verdict?
55.3 of 100 on AA-Robotics v0.1, third place behind GPT-6 Astra (69.4) and GPT-6.1 Sol (64.6), set against Google's own 87% on ERQA.
Is the 56% to 75% success-rate gain solid evidence?
Not yet. Google's post reports it for the party-props demo but gives no count of real-world attempts behind it. The 4,500+ episodes it cites are simulated, not hardware trials.
  1. Google wants Gemini 4 Argon to be the only AI model robots need — The Decoder
  2. Gemini 4 Argon for robotics — Google Developers Blog
  3. AA-Robotics v0.1 — Artificial Analysis
  4. ERQA benchmark repository — ERQA repository