New Delhi: Open Source GPT Chat has gone a step forward with the release of the Dolly Large Language Model (DLL) created by the Databricks enterprise software company. The new ChatGPT clone is called Dolly, named after the famous sheep of that name, the first mammal to be cloned. The Dolly LLM is the latest manifestation of the growing open source AI movement that seeks to offer greater access to the technology so that it’s not monopolized and controlled by large corporations.
Dolly was created from an open source model created by the non-profit EleutherAI research institute and the Stanford University Alpaca model which itself that was created from the 65 billion parameter open source LLaMA model created by Meta.
LLaMA, which stands for Large Language Model Meta AI, is a language model that is trained on publicly available data. LLaMA can outperform many of the top language models (OpenAI GPT-3, Gopher by Deep Mind and Chinchilla by DeepMind) despite being smaller.
The importance is that Dolly demonstrates that a useful large language model can be created with a smaller but high quality dataset.
The open source AI movement is concerned about businesses may be reluctant to hand over sensitive data to a third party that controls the AI technology.
Discussion about this post