An Anthropic Leader Told a Room of Founders to Stop Worrying About Context Windows. Here's the catch

An Anthropic researcher told a room of founders to stop worrying about context windows. Here is the question I did not get to ask, and why a bigger window solves short-term memory with bad tradeoffs and does nothing for long-term memory.