LeRobotDataset:v3.0 Released — Streaming data support and improved scalability
Action Required
Users must update their lerobot libraries to utilize the new LeRobotDataset:v3.0 format to benefit from streaming data processing and improved scalability.
AI Impact Summary
The LeRobotDataset team has released version 3.0, introducing a significant improvement in data handling by packing multiple episodes into a single file using relational metadata. This addresses the file system limitations of the previous version, enabling the processing of much larger datasets in streaming mode. This new format also natively supports accessing datasets in streaming mode, allowing to process large datasets on the fly, without having to download prohibitively large collections of data onto disk. This change allows for more accessible robot learning, and is a key milestone towards more accessible robot learning.
Affected Systems
- Date
- Date not specified
- Change type
- capability
- Severity
- high