Home » Authors » Harish Santhanalakshmi Ganesan, Hariharan M. S., Prabhurajhan R

Harish Santhanalakshmi Ganesan, Hariharan M. S., Prabhurajhan R

Public reference bibliography and cataloged PDF materials authored or published by Harish Santhanalakshmi Ganesan, Hariharan M. S., Prabhurajhan R.

Found 1 document(s) Page 1 of 1

HobbyLM: A Sparse Mixture-of-Experts Model Family on a Hobby Budget

Year: 2026 • Source: arxiv.org • Listed PDF

We describe HobbyLM, a family of small sparse Mixture-of-Experts (MoE) models trained from scratch with a few hundred to a few thousand dollars of rented GPU time. The core is a decoder-only transformer with fine-grained...