ML Experiment Tracking: What to Track Across Models, Data, and Production

The vast majority of teams working on large language models (LLMs) and machine learning (ML) systems diligently track hyperparameters.