HUMAN-1M

Scaling Physical AI
with Human Experience

1M hoursHuman-1M collection

100,000 hoursOpen-source subset

Human-1M is the largest and most diverse high-quality egocentric dataset which contains egocentric video, dense language annotations, head and hand motion focused on real world manipulation. Human-1M spans economically valuable work in the wild and in controlled studios, and powers NVIDIA's flagship Cosmos and GR00T models.

01 / DATASET STATS

The 100K-hour open-source subset

Camera configurations · 100K-hour open-source subset
02 / VIEW AN EPISODE

View an episode

Follow a task from its overall goal to each hand–object interaction, then explore stereo geometry and motion.

Bundle flower stems

28 seconds · 6 actions · Head + wrist views

Egocentric video

Full episode
Left wrist
Right wrist
TASK ANNOTATION

Subtask annotation

0.00 s
03 / EXPLORE

Explore human skills

Loading the task catalog…

3D task map

Rotate the map to explore related tasks. Select a point to view instructions and demonstrations.

Preparing the 3D task map…

● One point = one task group◉ Video example availableShift + drag to pan

Featured task clusters

04 / QUALITY

Quality at every step

Useful training data needs accurate instructions, clear interactions, reliable motion, and varied experience. Human-1M combines human review and quantitative checks across four quality gates.

01 / LANGUAGE

High quality dense annotation

Language connects a demonstration to what the person is trying to accomplish.

  • Task annotation: a 1–2 sentence summary of the goal, major actions, and key objects.
  • Subtask annotation: contiguous 1–10-second actions with explicit hand laterality, precise verbs, and unambiguous objects.
  • Human audits check accuracy, completeness, and alignment with the video.
02 / TASKS & VIDEO

High quality tasks

Clear, active demonstrations expose how skilled people handle objects and tools.

  • Proficient physical work toward a discrete goal, with idle time screened and trimmed.
  • At least 30 FPS / 480p, recorded at unaltered speed.
  • Hands visible for at least 95% of an episode; hands and task objects remain in focus.
03 / DIVERSITY

High quality diversity

Diversity is checked at the task, scene and collector, and environment levels.

  • Task-level checks use our diversity tool to cluster related tasks and identify repetition.
  • Scene and collector coverage captures different people and collection locations.
  • Environment-level targets balance coverage across nine environment categories.
04 / 3D TRACKING

High quality 3D tracking

Hand geometry supports motion learning, reconstruction, and robot retargeting.

  • Human review of projected hand tracks and 3D motion checks alignment, drift, and implausible poses.
  • Quantitative checks cover bone-length consistency, motion smoothness, and stereo alignment.
  • Tracking masks and confidence identify usable pose estimates and failed tracking.

Three tiers of diversity

Task level

Our diversity tool groups semantically similar task descriptions, measures task coverage, and flags excessive repetition.

Scene and collector level

Scene and collector IDs track coverage across people and collection locations, limiting concentration in a single scene or collector.

Environment level

Environment-level targets balance hours across nine categories, spanning controlled studios, households, and a range of workplaces.

Explore task diversity →

Quality gates in practice

Production task annotation audit history · 25 delivery weeks

Full episode requirements →
561K hoursAccepted task annotation
461K hoursRejected submissions, gross
Week 25
25
05 / COLLECTION

Collection specs

Collection settings

Human-1M

Standardized workspaces support repeatable skills, targeted task collection, and controlled comparisons across people and sensor configurations.

Sensorization

Monocular

A single head-mounted RGB camera, with depth and 3D hand pose inferred from monocular observations.

Stereo

Synchronized head-mounted cameras provide depth cues for 3D hand tracking and scene reconstruction.

Wrist cameras

Additional wrist-mounted views capture close-up manipulation and hand–object interactions.

Motion and calibration

6-DoF head-camera pose and 21 keypoints per hand, with tracking masks and confidence, camera intrinsics and extrinsics, and rig, collector, scene, and environment identifiers.

06 / HUMAN WORK

Everyday index of real human work.

Explore human tasks across the broad occupation groups in the U.S. Bureau of Labor Statistics Occupational Outlook Handbook.

About these associations

Human-1M tasks are associated with related work categories using actions and objects in their canonical names or supplied instructions. Each task group appears in at most one category. Ambiguous descriptions remain unassigned.

Broad category reference: BLS Occupational Outlook Handbook. Task associations are Human-1M analysis.

07 / SCHEMA

Standardized LeRobot V3.0 format

What lives where

Release folders
Anonymous vendor_id, batch_id, and the v0 version. Each batch’s versions.json sits alongside v0/.
Frame tables
Frame index, timestamp, camera pose, hand positions and rotations, masks, confidence, and label indices.
Episode metadata
Anonymous vendor, episode and rig IDs; collector and scene IDs; camera calibration; data and video intervals.
Label dictionaries
Task and subtask language, environment labels, and scene descriptions.
Video streams
Head views and optional wrist views, located through each episode’s camera metadata.
Download field reference ↓

Instructions in this cluster

Download clip ↓
EPISODE INSPECTION

Video, human motion, and robot alignment

Open viewer directly ↗

Opening the episode. Video loads first; the interactive 3D view loads next.

Camera calibration

Calibration values supplied with this episode.