NVIDIA 开源机器人视频标注数据引擎 Flora，称成本比 GPT-6 Astra 低至 125 倍
摘要
NVIDIA 开源数据引擎 Flora，用于为机器人视频生成动作分段描述、逐步执行评分和任务成败判定三类标注，模型已在 Hugging Face 发布。
摘要由模型根据原文撰写，以原文为准。
正文 · 原文
Ad
Log InSubscribeDE Switch to GermanPrimary Menu
Log InSubscribeDE Switch to GermanPrimary Menu
The Decoder
Opens discord in a new tabOpens LinkedIn in a new tab
Copy the url to clipboardShare this articleGo to comment section
Nvidia open-sources Flora to make robot video labeling 125x cheaper than GPT-6 Astra
Jonathan KemperView the LinkedIn Profile of Jonathan Kemper
Oct 25, 2026
Nvidia
Topics
- Up to 125x cheaper by Nvidia's own estimates
- Flora finds actions better, but Astra often describes them more precisely
- Almost no other model catches mid-episode errors
Labeling one hour of robot video for 72 cents instead of $88 is what Nvidia promises with Flora, its open data engine. But the comparison with GPT-6 Astra isn't quite as lopsided as the price tag suggests.
Large AI models for robots learn from videos that need text annotations, and according to Nvidia's GEAR research lab, this requires three types of labels. First, descriptions of what action happens when in the video, used to select training data. Second, ratings of how well a robot progresses step by step, so it can learn through trial and error. And third, judgments on whether a task was completed successfully, used to monitor robots during deployment. Most existing tools only provide one of these types. Large language models like GPT-6 Astra can generate several, but they're too expensive for the massive volumes of video involved.
Flora breaks videos down into time segments, describes each action, and evaluates the execution and outcome of an episode. | Image: Nvidia
According to the paper, Flora covers all three. Nvidia says the system is already running during training of its GR00T models, annotating up to 200,000 hours of video per day across 512 GB300 GPUs. The models are available on Hugging Face.
Video 1 Flora consists of three fine-tuned Qwen3.5 models. A 9B model splits videos into action segments, and a 27B model describes them while factoring in what happened before and after each action. A second 27B model called Flora-Rewarder takes on three roles depending on the prompt. It rates an episode's success on a scale of 1 to 5, classifies each half-second step as normal, suboptimal, or failure, and assigns scores based on self-defined rubrics.
A segmentation model and a captioning model produce timestamped descriptions, while a single reward model generates all three types of ratings. | Image: Nvidia
Up to 125x cheaper by Nvidia's own estimates
In a test with 50 videos, Flora scored slightly better than GPT-6 Astra according to Nvidia, even though OpenAI's model was allowed to use its full reasoning capacity. Labeling one hour of video runs about 72 cents with Flora by Nvidia's estimate, compared to roughly $88.50 with GPT-6 Astra. Claude Opus 5 scored much worse in the same test and still cost about $42 per hour.
Flora hits 57.1 percent annotation quality at $0.72 per video hour according to Nvidia, while GPT-6 Astra reaches 53.7 percent at $88.49. | Image: Nvidia
The Flora cost figures are projections, though, not production measurements. Nvidia calculated them based on an assumed rental price of $10 per GPU per hour.
Flora finds actions better, but Astra often describes them more precisely
On the public WGO-Bench, Flora is best at detecting action boundaries but trails Astra in overall score and falls behind Gemini 3.8 Flash in pure description accuracy. According to the researchers, the gains come mainly from temporal localization.
On Nvidia's own DenseCaptionBench, Flora leads across all metrics for human recordings, but for robot videos the model comes in second behind Astra. There's a methodological catch the researchers acknowledge, too. GPT-6 Astra evaluates the descriptions while also being one of the models under test.
Flora leads on human recordings, outcome scoring, and step-by-step ratings, while GPT-6 Astra wins on WGO-Bench, robot videos, and rubric scoring. | Image: Nvidia
Almost no other model catches mid-episode errors
On RoboRewardBench, Flora's error rate is 27.8 percent lower than Astra's. The paper attributes the gap to partially completed tasks. When a robot only tips a bottle over instead of knocking it off the table, Flora assigns 3 out of 5 points to match the human reference, while Astra gives just one.
Flora-Rewarder catches 53.3 percent of failed steps within an episode, while no competitor gets above 11.7 percent and Astra doesn't catch a single one. The tradeoff is that Flora falsely flags about 11 percent of normal steps as errors. Astra still leads on rubric-based scoring and trajectory ranking.
In a video with many short hand movements, Flora identifies 34 of 37 individual actions, while Astra catches only four. On the flip side, Flora sometimes splits longer actions into too many small steps and occasionally gets descriptions wrong. In one video, a robot hand wipes a plate with a cloth, but Flora describes it as folding a napkin.
In one example episode, Flora identifies 34 of 37 reference actions, while GPT-6 Astra catches only four. | Image: Nvidia
Nvidia positions Flora as an open alternative to commercial services like Scale AI's Physical AI Data Engine. Researchers can use it to scale their own robotics datasets and test approaches like transferring human demonstrations to robots. Nvidia is investing billions in open AI models to keep developers in its hardware ecosystem and drive demand for its chips, and Flora serves that same goal.
The company has also been working for some time to offset the shortage of robotics training data through simulation and automated data processing. At GTC earlier this year, Nvidia showed a data pipeline that automatically prepares, multiplies, and scores training material. Flora adds detailed labels and reward signals from video to that pipeline.
All of this feeds into Nvidia's strategy of covering the entire robotics value chain, from hardware and training data to simulation and the AI models themselves. Google's recently announced Gemini 4 Argon targets a similar part of the robotics training process, also identifying work steps in training videos and flagging failed actions.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
Read on for the full picture.
Subscribe for hype-free coverage.
- Full access to every article on THE DECODER
- No ads
- Join the comments and community discussions
- A weekly AI news recap via mail
- 6x/year: "AI Radar" — deep dives on the AI topics that matter most
- Daily AI news, always up to date
- Our full ten-year archive
- Covered by a team with 10+ years in AI
Ad
Top
Stories
- An AI agent in "Skynet mode" hijacks unprotected language models to launch self-sustaining cyberattacks
- MiniMax M3.1 Flash shows China's AI price race has no floor in sight
- OpenAI CEO Sam Altman says advanced AI will inevitably escape its sandbox, and only alignment can save us
- Fancy harnesses make coding agents more expensive but not better, study finds
- Anthropic takes on Grok Bot, Meta's Muse, and OpenAI's Dots with its always-on agent "Claude Duet"
Don't Miss
What Matters
Stay in the loop on AI. Clear, useful, no fluff.
Your email address Subscribe to our Newsletter
Most
Popular
- Stanford and Arc Institute scientists used AI to design new viruses that killed bacteria in the lab
- Study explains why AI agents benefit from "skills" and when they fail
- Frontier Radar #4: China has caught up, so what's left of the Western AI lead?
- AI keeps cracking unsolved math problems, and mathematicians have mixed feelings
- Anthropic wants you to know Claude leads a quarter of its research, but "lead" doesn't mean what you think
- Meta's new frontier model Muse Wonder Full breaks into the AI top tier
AI Community
& Insights
The Decoder
Follow The Decoder for AI news, background stories and expert analyses.
Opens LinkedIn in a new tabOpens Discord in a new tab
Ad
BETA-TEST
×
Start new search
×|
Send
wpDiscuz
Insert
Newsletter - THE DECODER
Stay in the loop on AI. Clear, useful, no fluff.
Your email address Subscribe to our Newsletter
Opens discord in a new tabOpens discord in a new tab
Information
Topics
Legal
THE DECODER by DEEP CONTENT by heise | All rights reserved 2026
BETA-TEST
×
Start new search
×|
Send
wpDiscuz
Insert
注意转载授权 · 阅读原文
来源：The Decoder · the-decoder.com
引用原文
Jonathan Kemper. Nvidia open-sources Flora to make robot video labeling 125x cheaper than GPT-6 Astra[EB/OL]. (2026-10-25)[访问日期]. https://the-decoder.com/nvidia-open-sources-flora-to-make-robot-video-labeling-125x-cheaper-than-gpt-6-astra/.