Pearl-Chat: Engineering a native Luganda language model from first principles in JAX and Flax NNX
Autoregressive foundation language models predominantly target high-resource Indo-European languages, imposing computational and morphological penalties on under-represented African languages.
arXiv - cs.CL (NLP)2 min read