Towards Unobtrusive Physical AI: Augmenting Everyday Objects with Intelligence and Robotic Movement for Proactive Assistance

Action 1: knife moves away to ensure safety Video streamAction 2: pan trivets move close for baking sheet Action-goal alignment Figure 1: Everyday objects, such as trivets, are brought to life by the Object Agents system.These objects move autonomously, in order to assist and protect users.Our system (1) perceives context using a vision language model backbone, (2) reasons about user goals and object affordances, and (3) generates actions that are delivered to familiar items augmented with robotic motion.