CoRL 2026 · Half-Day Workshop

Memory for Robot Foundation Models

Toward persistent autonomy: what robots and vision–language–action models should remember — and how memory should be learned, built, evaluated, and deployed.

November 12, 2026 Austin, TX, USA Conference on Robot Learning Submissions due Sep 24 (AoE)

About the Workshop

Memory is central to embodied intelligence.

A robot in the physical world cannot treat every timestep as a fresh start — it may need to recall that a mug went into a cupboard, that a drawer was already checked, or that a grasp failed because the object slipped. By memory we mean the ability to store past experience and call it back when it is relevant, not just to keep recent observations in view — which matters most in partially observable, long-horizon tasks. Yet most robot foundation models — generalist policies, vision–language–action (VLA) models, and video world models — treat memory only shallowly: a window of recent context, a replay buffer, or retrieval over past observations.

This workshop works toward a shared vocabulary for robot memory, the failure modes it must address, and evaluation criteria that isolate what memory actually contributes.

What should memory mean for autonomous robots — and how should we learn, build, evaluate, and deploy it?

Speakers

Invited Speakers

Bernadette Bucher In Person
Bernadette Bucher

University of Michigan

Yuejiang Liu In Person
Yuejiang Liu

Stanford University

Katerina Fragkiadaki In Person
Katerina Fragkiadaki

Carnegie Mellon University

Karl Pertsch In Person
Karl Pertsch

Physical Intelligence

Program

Half-day schedule

  1. 08:30 – 08:45 Welcome
  2. 08:45 – 09:15 Invited Speaker 1
  3. 09:15 – 09:45 Invited Speaker 2
  4. 09:45 – 10:30 Lightning Position Talks & Audience Discussion
  5. 10:30 – 11:15 Posters & Coffee Break
  6. 11:15 – 11:45 Invited Speaker 3
  7. 11:45 – 12:15 Invited Speaker 4
  8. 12:15 – 12:30 Final Discussion & Conclusion

Open Problems

Open problems we aim to address

01

The role of memory in robot behavior

Beyond perception and policy execution, what should memory enable — tracking hidden state, avoiding repeated mistakes, recovering from failures, adapting to environments and users, and accumulating reusable knowledge?

02

What to store and retrieve

Observations, language summaries, object states, maps, action traces, failures, preferences, or latent representations? And how can a robot retrieve the right memory under partial observability without surfacing stale or irrelevant entries?

03

Consolidation, abstraction & forgetting

How should robots compress repeated experience into reusable knowledge, preserve rare but important events, and revise or forget memories when environments, tasks, or users change?

04

Integrating memory with policies & planners

Should memory be external, latent, structured, or end-to-end learned — and how should it interact with reactive control, long-horizon planning, prediction, and language-conditioned reasoning?

05

Learning from remembered experience

How can memories of failed grasps, unsuccessful searches, misunderstood instructions, or changing environments lead to improved future behavior rather than passive recall?

06

Evaluating memory-enabled learning

What benchmarks and metrics can distinguish genuine memory use from larger context windows, environment memorization, or task-specific shortcuts?

Call for Papers

Contribute to the workshop

We invite short papers on any aspect of memory for robot foundation models. Position papers, works-in-progress, benchmark and dataset contributions, and negative or ablation results are explicitly welcome.

Key Dates

Submissions now open

Submission deadline

Sep 24

2026 · Anywhere on Earth

Notification

Oct 12

2026

Workshop day

Nov 12

Austin, TX, USA

Submit on OpenReview

Time left to submit

days
hrs
min
sec

Topics of Interest

01

Memory architectures & implementation

Recurrent and state-space memory · compressed or gated KV caches · external memory banks · retrieval-augmented policies · on-robot latency and compute budgets

02

Spatial & scene memory

Persistent 3D and 4D scene representations · semantic maps · object-centric and surfel memory · Gaussian splats · object permanence under occlusion · re-localization and revisit consistency

03

Episodic memory, retrieval & lifelong improvement

Recall of trajectories, failures and corrections · retrieval-based adaptation · consolidation into reusable skills · forgetting stale memories · catastrophic interference

04

Memory in world models & long-horizon planning

Memory-augmented action-conditioned prediction · spatial and physical consistency over long rollouts · hallucination in revisited scenes · memory-conditioned planning · hierarchical task state

05

Benchmarks, datasets & evaluation protocols

Genuinely partially observable, history-dependent tasks · temporal, spatial, object and procedural memory taxonomies · controls that rule out longer context, memorization and task shortcuts

06

Human-centered memory

Preferences, instructions and corrections across sessions and users · interpretable and editable memory · privacy, consent and the right to be forgotten

Submission Guidelines

  • Page Limit: We welcome submissions of up to 4 pages (excluding references) describing completed research, ongoing work, or benchmark datasets relevant to the workshop topics.
  • Formatting: Authors are encouraged to use the CoRL 2026 paper template.
  • Reviews: Each submission will receive at least two reviews from the organizing committee and external reviewers.
  • Anonymity: All submissions will be double-anonymized.
  • Dual Submission: We welcome submissions that are under review or recently published at relevant venues.
  • Non-Archival: This workshop is non-archival. Accepted papers will be posted on the workshop website.
  • Presentation: Accepted papers will be presented in an interactive poster session, with the top 3–5 papers selected for oral spotlight presentations. Authors are expected to present in person.
Submit on OpenReview

Submissions close September 24, 2026 · 23:59 Anywhere on Earth.

Organizers

Pembe Gizem Özdil Pembe Gizem Özdil

Kempner Institute, Harvard

Weirui Ye Weirui Ye

MIT

Tarık Keleştemur Tarık Keleştemur

Eka Robotics

Huangyuan Su Huangyuan Su

Kempner Institute, Harvard

Francesco Paissan Francesco Paissan

Mila, Université Laval

Zhiyi Li Zhiyi Li

MIT

Jan-Nico Zaech Jan-Nico Zaech

Woven by Toyota

Yilun Du Yilun Du

Kempner Institute, Harvard