When should an AI assistant push back? Measuring warnings and unsolicited opinions on decisions you've already made

This is a side project from my time in the Anthropic Fellows Program. The benchmark items, prompts and scripts are in the pushback-bench repository.I studied how much and when AI assistants push back on choices people have already made and ask the assistant just to execute on the decision.