Researchers use large language models to help robots navigate
The method uses language-based inputs instead of costly visual data to direct a robot through a multistep navigation task.
Computer Science and Artificial Intelligence Laboratory (CSAIL)
New algorithm discovers language just by watching videos
DenseAV, developed at MIT, learns to parse and understand the meaning of language just by watching videos of people talking, with potential applications in multimedia search, language learning, and robotics.
A technique for more effective multipurpose robots
With generative AI models, researchers combined robotics data from different sources to help robots learn better.
Looking for a specific action in a video? This AI-based method can find it for you
A new approach could streamline virtual training processes or aid clinicians in reviewing diagnostic videos.
Controlled diffusion model can change material properties in images
“Alchemist” system adjusts the material attributes of specific objects within images to potentially modify video game models to fit different environments, fine-tune VFX, and diversify robotic training.
School of Engineering welcomes new faculty
Fifteen new faculty members join six of the school’s academic departments.
Scientists use generative AI to answer complex questions in physics
A new technique that can automatically classify phases of physical systems could help scientists investigate novel materials.
Using ideas from game theory to improve the reliability of language models
A new “consensus game,” developed by MIT CSAIL researchers, elevates AI’s text comprehension and generation skills.
A better way to control shape-shifting soft robots
A new algorithm learns to squish, bend, or stretch a robot’s entire body to accomplish diverse tasks like avoiding obstacles or retrieving items.
Creating bespoke programming languages for efficient visual AI systems
Associate Professor Jonathan Ragan-Kelley optimizes how computer graphics and images are processed for the hardware of today and tomorrow.