Know a great AI tool or AI news source? Submit it to AiByts

Best practices when running a benchmark on online models [D]

I'm developing a benchmark for a low resource language and I don't want it to be leaked and used for training when it is being used to get predictions. For locally run models it shouldn't be a problem, but for models that are only accessible via API, it is.

By /u/neuralbeansReddit - r/ML

Read the full story

Originally published by Reddit - r/ML on Oct 8, 2026.

Read on Reddit - r/ML(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.