Advances, challenges and opportunities in creating data for trustworthy AI
As artificial intelligence (AI) transitions from research to deployment, creating the appropriate
datasets and data pipelines to develop and evaluate AI models is increasingly the biggest …
datasets and data pipelines to develop and evaluate AI models is increasingly the biggest …
Self-driving laboratories for chemistry and materials science
Self-driving laboratories (SDLs) promise an accelerated application of the scientific method.
Through the automation of experimental workflows, along with autonomous experimental …
Through the automation of experimental workflows, along with autonomous experimental …
Objaverse: A universe of annotated 3d objects
Massive data corpora like WebText, Wikipedia, Conceptual Captions, WebImageText, and
LAION have propelled recent dramatic progress in AI. Large neural models trained on such …
LAION have propelled recent dramatic progress in AI. Large neural models trained on such …
Tidybot: Personalized robot assistance with large language models
For a robot to personalize physical assistance effectively, it must learn user preferences that
can be generally reapplied to future scenarios. In this work, we investigate personalization of …
can be generally reapplied to future scenarios. In this work, we investigate personalization of …
Unisim: A neural closed-loop sensor simulator
Rigorously testing autonomy systems is essential for making safe self-driving vehicles (SDV)
a reality. It requires one to generate safety critical scenarios beyond what can be collected …
a reality. It requires one to generate safety critical scenarios beyond what can be collected …
Foundation models in robotics: Applications, challenges, and the future
We survey applications of pretrained foundation models in robotics. Traditional deep
learning models in robotics are trained on small datasets tailored for specific tasks, which …
learning models in robotics are trained on small datasets tailored for specific tasks, which …
Diffusion-based generation, optimization, and planning in 3d scenes
We introduce SceneDiffuser, a conditional generative model for 3D scene understanding.
SceneDiffuser provides a unified model for solving scene-conditioned generation …
SceneDiffuser provides a unified model for solving scene-conditioned generation …
🏘️ ProcTHOR: Large-Scale Embodied AI Using Procedural Generation
Massive datasets and high-capacity models have driven many recent advancements in
computer vision and natural language understanding. This work presents a platform to …
computer vision and natural language understanding. This work presents a platform to …
[PDF][PDF] Vima: General robot manipulation with multimodal prompts
Prompt-based learning has emerged as a successful paradigm in natural language
processing, where a single general-purpose language model can be instructed to perform …
processing, where a single general-purpose language model can be instructed to perform …
Behavior-1k: A benchmark for embodied ai with 1,000 everyday activities and realistic simulation
We present BEHAVIOR-1K, a comprehensive simulation benchmark for human-centered
robotics. BEHAVIOR-1K includes two components, guided and motivated by the results of an …
robotics. BEHAVIOR-1K includes two components, guided and motivated by the results of an …