Same Probe, Different Numbers: Are Activation Probes Robust to Inference-Time Numerical Non-Determinism?
Activation probes are increasingly used to monitor LLMs in deployment. A probe is typically trained under one inference configuration, then used under whatever batch size and numerical precision the serving stack uses.
By Alizishaan KhatriarXiv cs.LG
Read the full story
Originally published by arXiv cs.LG on Sep 30, 2026.
Comments
Sign in to join the discussion.