Now that "scale is all we need" has predictably faltered...
1. Small AI models often perform better in context.
2. Obsession w bigness has bad consequences, from climate, to power concentration, to research capture.
Me +
@GaelVaroquaux
@sashaluccioni
arxiv.org/abs/2409.14160