Grok, Elon Musk’s xAI artificial intelligence chatbot, is open source

Elon Musk’s artificial intelligence (AI) venture xAI open sourced its large language model (LLM) Grok-1 on March 17. Last week, the billionaire revealed on his social media platform X, formerly known as Twitter, that the artificial intelligence chatbot would be open source. Now, it’s available to researchers and developers. Notably, the xAI developers say that only the pretrained LLM has been released in the public domain, meaning that while the weights and network architecture can be accessed and built on top of, Grok does not come with any training data.

xAI said in announcing the open version blog post, “We are releasing the basic model weights and network architecture of our large-scale language model Grok-1. Grok-1 is a 314 billion parameter hybrid expert model trained from scratch by xAI.” The artificial intelligence company also pointed out that LLM It is provided as open source under the Apache 2.0 license.Interested friends can visit you have a model From GitHub.

according to a Report Provided by VentureBeat, the Apache 2.0 license includes commercial use, as well as modification and redistribution. This means developers can build on the basis of an LL.M., fine-tune it for a specific application, and then sell it. However, the model cannot be trademarked and developers must mention any changes made to the original code.

Although a commercial license is available, the version of Grok-1 that has been offered is from October 2023, when the model was trained using data from X and the Grok chatbot was given a unique personality. This means that any researcher or developer intending to use the model must purchase the data themselves.

xAI stated that the open source Grok-1 is a 314 billion parameter Mixture-of-Experts (MoE) model. The parameter size is much larger than other LLMs in the public domain, such as Meta LLaMa 2 or Mistral 8x7B. The larger the parameter size, the larger the context window of the AI. This enables it to provide a more contextually accurate and comprehensive response.

Grok was launched on November 3, 2023 as a chatbot designed to compete with the major players in the field. It is only available to limited users who have purchased an X Premium+ subscription. Musk also said at the time that Grok would get a standalone application.