Language Discrimination Improves Linguistic Learning in Multilingual Speech Models

Multilingual self-supervised speech models can benefit from sharing information across languages, but under a matched total pretraining data budget they still fall short of monolingual models.