@stellaathena@sigmoid.social
Mathematician and AI researcher. Executive Director and Head of Research at EleutherAI She/her
Hi, my name is Stella! I train and publicly release LLMs so people can study their abilities, limitations, and biases. Recently I’ve started getting into doing my own interpretability work too, looking at causes of memorization and eliciting latent knowledge.
I run EleutherAI, an open science AI research institute https://arxiv.org/abs/2210.06413
There's a lot of misinfo about this out there, so here's the definitive list of the largest open source LLMs in the world:
1. Yandex's YaLM-100B
2. EleutherAI's GPT-NeoX-20B
= @GoogleOfficial's UL2-20B
= @nvidia's NeMo-Megatron-20B
All are licensed under Apache 2.0, except NeMo-Megatron which is licensed CC-BY.
I am not sure about Huawei's PanGu-α. The repo is in Chinese, but I think only the code is Apache 2.0. Here's the repo, if anyone speaks Chinese: https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/PanGu-%CE%B1
Elk is a nimble Mastodon web client. You can login to your Mastodon account and use it to interact with the fediverse.
Expect some bugs and missing features here and there. Elk is Open Source and we're actively improving it as a community project. Join us and let's build it together!
If you'd like to report a bug, help us testing, give feedback, or contribute, reach out to us on GitHub and get involved.
To boost development, you can sponsor the Team through GitHub Sponsors. We hope you enjoy Elk!
