DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset

The creation of large, diverse, high-quality robot manipulation datasets is an important stepping stone on the path toward more capable and robust robotic manipulation policies. However, creating such datasets is challenging: collecting robot manipulation data in diverse environments poses logistical and safety challenges and requires substantial investments in hardware and human labour. As a result, even the most general robot manipulation policies today are mostly trained on data collected in a small number of environments with limited scene and task diversity. In this work, we introduce DROID (Distributed Robot Interaction Dataset), a diverse robot manipulation dataset with 76k demonstration trajectories or 350 hours of interaction data, collected across 564 scenes and 84 tasks by 50 data collectors in North America, Asia, and Europe over the course of 12 months. We demonstrate that training with DROID leads to policies with higher performance and improved generalization ability. We open source the full dataset, policy learning code, and a detailed guide for reproducing our robot hardware setup.

Task-Driven Manipulation with Reconfigurable Parallel Robots

ReachBot, a proposed robotic platform, employs extendable booms as limbs for mobility in challenging environments, such as martian caves. When attached to the environment, ReachBot acts as a parallel robot, with reconfiguration driven by the ability to detach and re-place the booms. This ability enables manipulation-focused scientific objectives: for instance, through operating tools, or handling and transporting samples. To achieve these capabilities, we develop a two-part solution, optimizing for robustness against task uncertainty and stochastic failure modes. First, we present a mixed-integer stance planner to determine the positioning of ReachBot's booms to maximize the task wrench space about the nominal point(s). Second, we present a convex tension planner to determine boom tensions for the desired task wrenches, accounting for the probabilistic nature of microspine grasping. We demonstrate improvements in key robustness metrics from the field of dexterous manipulation, and show a large increase in the volume of the manipulation workspace. Finally, we employ Monte-Carlo simulation to validate the robustness of these methods, demonstrating good performance across a range of randomized tasks and environments, and generalization to cable-driven morphologies. We make our code available at our project webpage, https://stanfordasl.github.io/reachbot_manipulation/

Autonomous Material Composite Morphing Wing

Aeronautics research has continually sought to achieve the adaptability and morphing performance of avian wings, but in practice, wings of all scales continue to use the same hinged control-surface embodiment. Recent research into compliant and bio-inspired mechanisms for morphing wings and control surfaces has indicated promising results, though often these are mechanically complex, or limited in the number of degrees-of-freedom (DOF) they can control. Seeking to improve on these limitations, we apply a new paradigm denoted Autonomous Material Composites to the design of avian-scale morphing wings. With this methodology, we reduce the need for complex actuation and mechanisms, and allow for three-dimensional placement of stretchable fiber optic strain gauges (Optical Lace) throughout the metamaterial structure. This structure centers around elastomeric conformal lattices, and by applying functionally-graded warping and thickening to this lattice, we allow for local tailoring of the compliance properties to fit the desired morphing. As a result, the wing achieves high-deformation morphing in three DOF: twist, camber, and extension/compression, with these morphed shapes effectively modifying the aerodynamic performance of the wing, as demonstrated in low-Reynolds wind tunnel testing. Our sensors also successfully demonstrate differentiable trends across all degrees of morphing, enabling the future state estimation and control of this wing.