8 upvotes
New memory module lets robots remember past steps
What is HeLM: Hierarchical Explicit Language Memory for Non-Markovian Manipulation?
HeLM adds a hierarchical language memory to vision-language-action models, letting them retain information across multiple timesteps. This enables robots to carry out manipulation tasks that require a short-term working memory instead of reacting only to the current view.
Who it is for
Anyone building embodied AI or robotic manipulation systems can use it to tackle tasks that need the robot to remember earlier actions.