New comment by sattard in "LLMs get lost in multi-turn conversation"

sattard — Fri, 16 May 2025 12:16:49 +0000

Why haven't AI code editors not built this at their core yet, to automatically consolidate previous conversational turns into a more structured context summary. Instead of relying solely on the model’s memory of all prior exchanges, surely these tools should take responsibility for intermittently “restating” the clarified requirements so the model doesn’t have to reconstruct context from scratch (or worse, pick up mistakes). This might mitigate compounding errors and reduce verbosity.

Hacker News: sattard

New comment by sattard in "LLMs get lost in multi-turn conversation"