Auditing a Model-Hub Benchmark: Data Quality, Training Budgets, and Side Information in HuggingBench
Benchmarks built from model hubs combine interaction data, knowledge graphs (KGs) and resource documentation, but valid files do not ensure that these artifacts describe the same objects.
arXiv cs.LG2 min read