'Actions' play a vital role in how humans interact with the world and enable them to achieve
desired goals. As a result, most common sense (CS) knowledge for humans revolves …

Captioning is a crucial and challenging task for video understanding. In videos that involve
active agents such as humans, the agent's actions can bring about myriad changes in the …

Videos often capture objects, their visible properties, their motion, and the interactions
between different objects. Objects also have physical properties such as mass, which the …

Object rearrangement is a challenge for embodied agents because solving these tasks
requires generalizing across a combinatorially large set of configurations of entities and their …

Object rearrangement is a challenge for embodied agents because solving these tasks
requires generalizing across a combinatorially large set of underlying entities that take the …

Humans observe various actions being performed by other humans (physically or in
videos/images) and can draw a wide range of inferences about it beyond what they can …