RealCLI: Toward a Unified Evaluation of Human-Agent Collaboration for CLI Agents
Command-line interface (CLI) agents increasingly execute longer-horizon tasks, yet existing benchmarks either assume that user instructions remain fixed throughout execution or evaluate task outcomes without capturing runtime collaboration quality.
arXiv - cs.CL (NLP)2 min read