AI Persistent Memory: ChatGPT Dreaming and the Cross-Session Context Race
What's new in v6
Two new items from Rohan Paul (June 8–9) promote Kocoro, an open-source Mac-native agent running local background memory review — adding a local/privacy-preserving voice to the portable-memory camp and sharpening Paul's existing position that context-window scaling does not address the persistence problem [10][13]. Alibaba Cloud entered the space with a MemoryAgent Arena hackathon track [15] and RecallOS announced its first chapter [14], both minor signals of broadening ecosystem activity. The remaining new items are social amplification of the Dreaming launch with no new analytical content.
What
OpenAI's Dreaming V3, launched June 4, 2026, redesigns ChatGPT memory as a background synthesis process rather than static user-managed entries [1][2]. The Neuron published the first independent accuracy metrics on June 7: original ChatGPT memory had 41.5% factual recall in 2024; Dreaming V3 raises that to 82.8%, with a 5x compute reduction that also extends memory to free users [5]. Around the Dreaming launch, a wave of independent persistent-memory tools has appeared — Kocoro (open-source, local, Mac-native) [10][13], RecallOS [14], AgentMemory for Claude Code [20], and others — suggesting the problem space is active well beyond OpenAI's platform. Alibaba Cloud is running a MemoryAgent Arena track at its Qwen hackathon, bringing the problem into formal competition [15].
Why it matters
The 41.5% baseline recall figure shows how unreliable earlier AI memory implementations were, and The Neuron argues all major providers likely share similar problems without disclosing them [5]. The growing ecosystem of local and portable memory tools — some explicitly privacy-motivated, running on-device rather than in the cloud — reflects real user demand that platform-native solutions have not fully addressed.
Open questions
Other AI assistant providers likely have memory accuracy problems comparable to ChatGPT's 41.5% baseline [5] — will any publish similar benchmarks, or does OpenAI's disclosure remain the exception?
Does Dreaming V3's 82.8% recall accuracy hold as user histories grow longer and more complex, or does performance degrade at scale? [5][21]
Can local, on-device memory tools like Kocoro [10][13] gain enough traction to serve as privacy-preserving alternatives, or do they lack the distribution and model integration that platform-native solutions provide?
A self-evolving agent continuously updates its own state, so the version that passed safety review may not match the version running weeks later [19] — how do providers plan to handle this for background-synthesis systems like Dreaming?
Narrative
On June 4, 2026, OpenAI announced Dreaming V3 — a redesigned memory architecture for ChatGPT that runs background synthesis processes to keep user context current rather than relying on explicit, static memory entries [1][2]. Unlike prior versions where users managed memory manually, Dreaming V3 periodically reviews conversation history and updates what the system knows about a user's preferences and goals. OpenAI added a user-facing memory summary page, giving subscribers visibility into what the system has retained [3][4].
The Neuron published the first quantified performance metrics for ChatGPT memory on June 7, 2026. OpenAI's original memory feature had factual recall accuracy of only 41.5% in 2024 — wrong more than half the time on memory-dependent tasks. Dreaming V3 raises that to 82.8%, while preference adherence improved from 55.3% to 71.3% [5]. A 5x compute reduction produced these gains and extended memory access to free users for the first time [5], which accounts for The Verge's earlier framing that the feature was rolling out to everyone rather than only paid tiers [6]. The Neuron's treatment of the disclosure was notable: it praised OpenAI for publishing poor baseline numbers rather than suppressing them, while warning that all major AI assistants likely run similar accuracy problems without equivalent transparency [5].
The Dreaming launch sits in a broader field of competing approaches. MIT MeMo research found a 26% LLM performance improvement when memory is kept architecturally separate from the base model [7]. Developer practitioners have documented compaction amnesia and context rot in complex workflows and argued that structured selective memory retrieval is more reliable than extending context windows [8][9] — a position Rohan Paul also articulated explicitly in reference to Kocoro [10]. Anuma frames proprietary per-model memory as structurally insufficient, arguing user context should be portable across models in a user-owned format [11][12]. On the local-first side, Kocoro launched as an open-source Mac-native agent that runs a background process reviewing past sessions on-device rather than in the cloud [10][13]. RecallOS announced its first chapter [14], and Alibaba Cloud opened a MemoryAgent Arena track at its Qwen hackathon [15], signaling the problem is now attracting institutional competition beyond the major AI labs.
The security dimension of persistent AI memory has moved from theoretical to operational. Palo Alto Networks documented that indirect prompt injection can poison AI long-term memory, causing persistent behavioral changes across sessions [16]. Sysdig documented the first publicly known LLM-agent-driven post-exploitation chain in May 2026 [17], and SecurityWeek published a formal benchmark ranking the security posture of 100 AI agents [18]. A structural concern runs through practitioner commentary: Danny Livshits observed that a self-evolving agent voids its own safety review, since the version tested may not match the version running a month later [19] — a problem that background-synthesis systems like Dreaming make more concrete. No major provider has publicly addressed how they plan to defend against persistent prompt-injection attacks or validate the safety of continuously updating memory systems.
Timeline
- 2026-05-10: Sysdig documents the first publicly known LLM-agent-driven post-exploitation chain. [17]
- 2026-05-26: Hacker News post documents compaction amnesia and context rot in Codex on complex multi-step workflows. [8]
- 2026-05-30: MIT MeMo research claims 26% LLM performance gain from memory kept architecturally separate from the base model. [7]
- 2026-06-02: Danny Livshits observes that a self-evolving agent voids its own safety review, as the tested version may not match the production version. [19]
- 2026-06-03: SecurityWeek publishes a benchmark ranking the security posture of 100 AI agents. [18]
- 2026-06-04: OpenAI announces Dreaming V3 for ChatGPT — background memory synthesis with a user-facing summary page — rolling out initially to Plus and Pro users. [1][2][3][4]
- 2026-06-04: Anuma cross-model portable memory discussed as a structural alternative to proprietary model-specific memory. [11][12]
- 2026-06-04: Palo Alto Networks research on indirect prompt injection poisoning AI long-term memory surfaces in context of the Dreaming launch. [16]
- 2026-06-05: The Verge reports Dreaming rolling out to everyone, suggesting broader availability than the Plus/Pro-only initial framing. [6]
- 2026-06-05: Third-party AgentMemory tool appears to give Claude Code persistent cross-session memory. [20]
- 2026-06-06: Developer commentary attributes roughly 5x lower compute cost to Dreaming V3, adding specificity to OpenAI's vague 'compute-efficient' claim. [21][24]
- 2026-06-07: The Neuron publishes quantified memory accuracy metrics: 41.5% factual recall in 2024 rising to 82.8% with Dreaming V3; preference adherence up from 55.3% to 71.3%; 5x compute reduction extends memory to free users. [5]
- 2026-06-08: Kocoro promoted as an open-source Mac-native AI agent running local background memory review of past sessions, explicitly framed as an alternative to context-window scaling. [10][13]
- 2026-06-09: Alibaba Cloud opens a MemoryAgent Arena track at its Qwen Cloud Global AI Hackathon, signaling institutional competition around agent memory. [15]
- 2026-06-09: RecallOS announces its first chapter as a persistent-memory product. [14]
Perspectives
OpenAI
Dreaming V3 is a background synthesis system that is 'more capable and compute-efficient,' with published metrics showing factual recall rising from 41.5% to 82.8% and preference adherence from 55.3% to 71.3%.
Evolution: Consistent; specific accuracy metrics now quantify the previously vague 'compute-efficient' characterization.
The Neuron / Grant Harvey
OpenAI deserves credit for publishing its poor baseline numbers; but the accuracy problem is likely industry-wide, with all major AI assistants running similar problems without disclosure.
Evolution: Consistent since introduced in the previous pass.
Anuma / Rohan Paul
Proprietary per-model memory is insufficient; user context should be portable across all AI models in a private, user-owned format rather than platform-controlled — and larger context windows do not address the fundamental persistence problem.
Evolution: Consistent; Paul also promotes Kocoro as a local-memory alternative, reinforcing the portability/privacy framing.
MIT MeMo researchers
Keeping memory architecturally separate from the base model yields a measurable 26% performance improvement without retraining.
Evolution: Consistent; academic framing with no commercial stance.
Palo Alto Networks / security researchers
Persistent AI memory creates a significant attack surface; indirect prompt injection can poison long-term memory and cause persistent behavioral changes across sessions.
Evolution: Consistent; no provider has publicly responded to these findings.
Sysdig / SecurityWeek
AI agent vulnerabilities are operational, not theoretical; a real-world LLM-agent post-exploitation chain has been documented and formal industry benchmarks now rank agent security posture.
Evolution: Consistent.
Practitioner and developer community
Context loss is a genuine workflow cost; memory-first architecture is more reliable than extending context windows; third-party and local tools (Kocoro, AgentMemory, Zep, Zaxy, RecallOS) are filling cross-session memory gaps independently of platform-native solutions.
Evolution: The local/on-device angle is more prominent, with Kocoro explicitly positioning local background review as the meaningful alternative to cloud-based synthesis.
Tensions
- OpenAI published its memory accuracy baseline (41.5% recall in 2024); The Neuron argues all major AI providers likely share similar accuracy problems but have not disclosed them, framing OpenAI's transparency as the exception rather than the norm. [5]
- OpenAI's Dreaming locks richer memory into ChatGPT specifically; Anuma, Kocoro, Zaxy, and Zep argue memory should be portable, user-owned, or locally controlled rather than platform-managed. [1][11][12][23][22][10][13]
- Dynamic background synthesis (Dreaming) vs. static explicit memory: practitioners argue proactive synthesis may introduce context drift as a new failure mode rather than solving reliability. [1][9]
- More capable persistent memory expands the prompt-injection attack surface; Palo Alto Networks and Sysdig confirm this is operational, but neither OpenAI nor other providers have publicly addressed how they will defend against it. [16][1][17]
- Self-evolving agents that continuously update their own memory may void prior safety reviews; Danny Livshits argues the tested version is not the version running a month later — a structural problem that background-synthesis systems like Dreaming make concrete. [19][1]
Status: active but slowing
Sources
- [1] Dreaming: Better memory for a more helpful ChatGPT — OpenAI Blog (2026-06-04)
- [2] Dreaming memory system rolls out to ChatGPT Plus and Pro users — reactive:ai-persistent-memory-race
- [3] OpenAI updates ChatGPT memory with a "more capable and compute-efficient" architecture and a summary page that lets user... — reactive:ai-persistent-memory-race (2026-06-04)
- [4] OpenAI updates ChatGPT memory with a "more capable and compute-efficient" architecture and a summary page that lets user... — reactive:ai-persistent-memory-race (2026-06-04)
- [5] 😺 ChatGPT admitted its memory was broken — The Neuron (2026-06-07)
- [6] ChatGPT’s upgraded memory system is rolling out to everyone. | The Verge — reactive:ai-persistent-memory-race
- [7] MIT's MeMo: 26% LLM performance boost without retraining — memory stays separate from the base model. — reactive:ai-persistent-memory-race (2026-05-30)
- [8] Why codex /goal fails on complex workflows: compaction amnesia and context rot — reactive:ai-persistent-memory-race (2026-05-26)
- [9] Memory-First Conversational Architecture as an Alternative to Long ... — reactive:ai-persistent-memory-race
- [10] A longer context window does not solve the real memory problem in AI work. — Rohan Paul Twitter (2026-06-08)
- [11] Most AI workflows break because the user has to carry the context manually, and Anuma is trying to make that context por… — Rohan Paul Twitter (2026-06-04)
- [12] Cross-Model, Cross-Device Portable AI Context | Anuma — reactive:ai-persistent-memory-race
- [13] A new open-source agent engine is trying to make AI sessions continuous across days. — Rohan Paul Twitter (2026-06-09)
- [14] Today, RecallOS enters its first chapter — reactive:ai-persistent-memory-race (2026-06-09)
- [15] Tired of AI agents forgetting the context? 🧠 Welcome to the MemoryAgent Arena at Qwen Cloud Global AI Hackathon Series! — reactive:ai-persistent-memory-race (2026-06-09)
- [16] When AI Remembers Too Much – Persistent Behaviors in Agents ... — reactive:ai-persistent-memory-race
- [17] When I wrote about Sysdig observing the first publicly documented LLM-agent-driven post-exploitation chain on May 10, th... — reactive:ai-persistent-memory-race (2026-06-04)
- [18] SecurityWeek just published a benchmark ranking the security posture of 100 AI agents. The headline is interesting. The ... — reactive:ai-persistent-memory-race (2026-06-03)
- [19] A self-evolving agent voids its own safety review. The version you tested is not the version running a month later. — reactive:ai-persistent-memory-race (2026-06-02)
- [20] 🧠 Does your AI coding agent remember yesterday's session? AgentMemory gives persistent cross-session memory to Claude Co... — reactive:ai-persistent-memory-race (2026-06-05)
- [21] Memory is becoming a part of assistant infra. @OpenAI claims a more scalable memory architecture and about 5x lower com... — reactive:ai-persistent-memory-race (2026-06-06)
- [22] How to Give Your AI Agent Persistent Memory (Guide) | Zep — reactive:ai-persistent-memory-race
- [23] Hoping a big lab adopts Zaxy's coordinated memory architecture. It's awesome! — reactive:ai-persistent-memory-race (2026-06-06)
- [24] Memory is becoming a part of assistant infra. OpenAI claims a more scalable memory architecture and about 5x lower compu... — reactive:ai-persistent-memory-race (2026-06-06)