History
EleutherAI was founded in July 2020 by Connor Leahy, Sid Black, and Leo Gao. Initially created as a Discord server to discuss OpenAI’s GPT-3, a large language model, EleutherAI has since evolved into a leading non-profit research institute focused on large-scale artificial intelligence (AI). Their mission is to democratize access to cutting-edge AI technologies and promote open science norms in natural language processing. In 2023, EleutherAI was officially incorporated as a non-profit foundation (EleutherAI) (Wikipedia).
Founders
The founders of EleutherAI are:
- Connor Leahy: CEO of Conjecture and a driving force behind the organization.
- Sid Black: Co-founder and active researcher at EleutherAI.
- Leo Gao: Co-founder and researcher, heavily involved in the development of the models.
What can you do with it?
EleutherAI has developed several significant projects and models that are used worldwide:
- GPT-Neo: A series of language models replicating OpenAI’s GPT-3. The models have up to 20 billion parameters and were released in March 2021.
- GPT-J: A 6-billion-parameter model, also released in March 2021, and was the largest publicly available GPT-3-like language model at the time.
- GPT-NeoX: With 20 billion parameters, the largest open language model at its release in February 2022.
- Pythia: A suite of models designed to facilitate research on the capabilities and learning processes of large language models (Wikipedia) (EleutherAI).
In addition to language models, EleutherAI has made significant strides in image and text-to-image synthesis, particularly with projects like VQGAN-CLIP. This technology allows for the generation of images from text descriptions and has inspired the development of further generative AI models (Wikipedia).
Free Access?
EleutherAI strongly adheres to open-source principles. Many of their models and datasets are freely accessible and can be used by researchers and developers worldwide. This includes providing code and models on platforms like GitHub, as well as publishing scientific papers and documentation that are freely available. This openness promotes transparency and allows a broader community to participate in the development and improvement of AI technologies (EleutherAI) (Eleuther AI) (EleutherAI).
Sources
- EleutherAI Website
- Wikipedia on EleutherAI
- EleutherAI Research
- Introduction to EleutherAI