Home Elon Musk’s xAI open-sources base model of Grok

Elon Musk’s xAI open-sources base model of Grok

TLDR

  • xAI releases Grok AI model, revealing architecture.
  • Grok-1: 314B parameter MoE model, trained from scratch.
  • No training code needed; available on GitHub.

xAI has confirmed the open release of its Grok artificial intelligence (AI) model, detailing the weights and architecture of the system. 

Elon Musk’s company detailed the Grok-1 version as a “314 billion parameter Mixture-of-Experts model trained from scratch by xAI.” In addition, the San Francisco-based startup outlined how the model had been instructed on a large volume of text data rather than tailored toward any specific task.

No training code is required, as users can head directly to Git Hub to get started with the large language model (LLM). 

In an effort to solicit input from the research community on potential enhancements, companies like xAI can make their LLMs either fully open-source or available through limited open-source releases.

Grok has also been available to premium subscribers on X, the prominent social media platform formerly known as Twitter before Musk’s takeover.

What is the legal dispute between Elon Musk and OpenAI?

Last week, the billionaire announced xAI would open-source Grok at a time when he is embroiled in a bitter legal battle with rival firm OpenAI, which he was previously associated with as a co-founder.

Musk, 52, walked away to take a different direction in AI development and now he has sued the maker of ChatGPT and its incumbent CEO, Sam Altman, for allegedly reneging on its original purpose to build AI for the benefit of humanity and not for the pursuit of profit.

In response, OpenAI has rebuked the legal action, stating it is based on “convoluted – often incoherent – factual premises”, in a court filing as part of the counterclaim.

An official blog post that accompanied an email to company employees appeared to dismiss the early influence and impact of Musk on Open AI. 

The firm implored it has stayed true to its mission “to ensure AGI benefits all of humanity, which means both building safe and beneficial AGI”, “every step of the way”.

It was penned collectively by Altman, Greg Brockman, John Schulman, Ilya Sutskever, and Wojciech Zaremba, and detailed how the firm had raised less than $45 million from Musk, despite his pledge to bring in up to $1 billion in funding.

Image source: x.ai

About ReadWrite’s Editorial Process

The ReadWrite Editorial policy involves closely monitoring the tech industry for major developments, new product launches, AI breakthroughs, video game releases and other newsworthy events. Editors assign relevant stories to staff writers or freelance contributors with expertise in each particular topic area. Before publication, articles go through a rigorous round of editing for accuracy, clarity, and to ensure adherence to ReadWrite's style guidelines.

Graeme Hanna
Tech Journalist

Graeme Hanna is a full-time, freelance writer with significant experience in online news as well as content writing. Since January 2021, he has contributed as a football and news writer for several mainstream UK titles including The Glasgow Times, Rangers Review, Manchester Evening News, MyLondon, Give Me Sport, and the Belfast News Letter. Graeme has worked across several briefs including news and feature writing in addition to other significant work experience in professional services. Now a contributing news writer at ReadWrite.com, he is involved with pitching relevant content for publication as well as writing engaging tech news stories.

Get the biggest tech headlines of the day delivered to your inbox

    By signing up, you agree to our Terms and Privacy Policy. Unsubscribe anytime.

    Tech News

    Explore the latest in tech with our Tech News. We cut through the noise for concise, relevant updates, keeping you informed about the rapidly evolving tech landscape with curated content that separates signal from noise.

    In-Depth Tech Stories

    Explore tech impact in In-Depth Stories. Narrative data journalism offers comprehensive analyses, revealing stories behind data. Understand industry trends for a deeper perspective on tech's intricate relationships with society.

    Expert Reviews

    Empower decisions with Expert Reviews, merging industry expertise and insightful analysis. Delve into tech intricacies, get the best deals, and stay ahead with our trustworthy guide to navigating the ever-changing tech market.