CoRL 2026 · Half-Day Workshop

Memory for Robot Foundation Models

Toward persistent autonomy: what robots and vision–language–action models should remember — and how memory should be learned, built, evaluated, and deployed.

November 9, 2026 Austin, TX, USA Conference on Robot Learning

About the Workshop

Memory is central to embodied intelligence.

A robot in the physical world cannot treat every timestep as a fresh start — it may need to recall that a mug went into a cupboard, that a drawer was already checked, or that a grasp failed because the object slipped. By memory we mean the ability to store past experience and call it back when it is relevant, not just to keep recent observations in view — which matters most in partially observable, long-horizon tasks. Yet most robot foundation models — generalist policies, vision–language–action (VLA) models, and video world models — treat memory only shallowly: a window of recent context, a replay buffer, or retrieval over past observations.

This workshop works toward a shared vocabulary for robot memory, the failure modes it must address, and evaluation criteria that isolate what memory actually contributes.

What should memory mean for autonomous robots — and how should we learn, build, evaluate, and deploy it?

Speakers

Invited Speakers

Bernadette Bucher In Person
Bernadette Bucher

University of Michigan

Jie Tan In Person
Jie Tan

Google DeepMind & Stanford

Katerina Fragkiadaki In Person
Katerina Fragkiadaki

Carnegie Mellon University

Karl Pertsch In Person
Karl Pertsch

Physical Intelligence

Program

Half-day schedule

  1. 08:30 – 08:45 Welcome
  2. 08:45 – 09:15 Invited Speaker 1
  3. 09:15 – 09:45 Invited Speaker 2
  4. 09:45 – 10:30 Lightning Position Talks & Audience Discussion
  5. 10:30 – 11:15 Posters & Coffee Break
  6. 11:15 – 11:45 Invited Speaker 3
  7. 11:45 – 12:15 Invited Speaker 4
  8. 12:15 – 12:30 Final Discussion & Conclusion

Open Problems

Open problems we aim to address

01

The role of memory in robot behavior

Beyond perception and policy execution, what should memory enable — tracking hidden state, avoiding repeated mistakes, recovering from failures, adapting to environments and users, and accumulating reusable knowledge?

02

What to store and retrieve

Observations, language summaries, object states, maps, action traces, failures, preferences, or latent representations? And how can a robot retrieve the right memory under partial observability without surfacing stale or irrelevant entries?

03

Consolidation, abstraction & forgetting

How should robots compress repeated experience into reusable knowledge, preserve rare but important events, and revise or forget memories when environments, tasks, or users change?

04

Integrating memory with policies & planners

Should memory be external, latent, structured, or end-to-end learned — and how should it interact with reactive control, long-horizon planning, prediction, and language-conditioned reasoning?

05

Learning from remembered experience

How can memories of failed grasps, unsuccessful searches, misunderstood instructions, or changing environments lead to improved future behavior rather than passive recall?

06

Evaluating memory-enabled learning

What benchmarks and metrics can distinguish genuine memory use from larger context windows, environment memorization, or task-specific shortcuts?

Call for Papers

Contribute to the workshop

  • Topics. Memory architectures, VLA models, long-horizon manipulation, embodied agents, planning, world models, human–robot interaction, and benchmark design.
  • Formats. Short papers and extended abstracts — works-in-progress and negative/ablation results are explicitly welcome.
  • Review criteria. Technical correctness, reproducibility, and actionable artifacts — protocols, datasets, metrics, or well-documented system case studies.
  • Accepted abstracts (and optional PDFs, with author permission) will be hosted here so attendees can find relevant work.
Submit on OpenReview

Submission portal opens soon.

Important Dates

  • Submission deadline TBA
  • Notification TBA
  • Camera-ready TBA
  • Workshop day Nov 9, 2026

CoRL 2026 · Austin, TX, USA.

Organizers

Pembe Gizem Özdil Pembe Gizem Özdil

Kempner Institute, Harvard

Weirui Ye Weirui Ye

MIT

Tarık Keleştemur Tarık Keleştemur

Eka Robotics

Huangyuan Su Huangyuan Su

Kempner Institute, Harvard

Francesco Paissan Francesco Paissan

Mila, Université Laval

Zhiyi Li Zhiyi Li

MIT

Jan-Nico Zaech Jan-Nico Zaech

Woven by Toyota

Yilun Du Yilun Du

Kempner Institute, Harvard