Think of LLM Applications as POMDPs — Not Agents

LLM engineering is a young field. Practitioners suffer from a lack of clarity about their problem space, resulting in tools and applications that are hard to reason about, manage, and iterate on — slop.