Until a few weeks ago, few people in the Western world had heard of a small Chinese artificial intelligence (AI) company known as DeepSeek. But on January 20, it captured global attention when it released a new AI model called R1.
R1 is a “reasoning” model, meaning it works through tasks step by step and details its working process to a user. It is a more advanced version of DeepSeek’s V3 model, which was released in December. DeepSeek’s new offering is almost as powerful as rival company OpenAI’s most advanced AI model o1, but at a fraction of the cost.
Within days, DeepSeek’s app surpassed ChatGPT in new downloads and set stock prices of tech companies in the United States tumbling. It also led OpenAI to claim that its Chinese rival had effectively pilfered some of the crown jewels from OpenAI’s models to build its own.
In a statement to the New York Times, the company said:
We are aware of and reviewing indications that DeepSeek may have inappropriately distilled our models, and will share information as we know more. We take aggressive, proactive countermeasures to protect our technology and will continue working closely with the US government to protect the most capable models being built here.
The Conversation approached DeepSeek for comment, but it did not respond.
But even if DeepSeek copied – or, in scientific parlance, “distilled” – at least some of ChatGPT to build R1, it’s worth remembering that OpenAI also stands accused of disrespecting intellectual property while developing its models.
What is distillation?
Model distillation is a common machine learning technique in which a smaller “student model” is trained on predictions of a larger and more complex “teacher model”.
When completed, the student may be nearly as good as the teacher but will represent the teacher’s knowledge more effectively and compactly.
To do so, it is not necessary to access the inner workings of the teacher. All one needs to pull off this trick is to ask the teacher model enough questions to train the student.
This is what OpenAI claims DeepSeek has done: queried OpenAI’s o1 at a massive scale and used the observed outputs to train DeepSeek’s own, more efficient models.
A fraction of the resources
DeepSeek claims that both the training and usage of R1 required only a fraction of the resources needed to develop their competitors’ best models.
There are reasons to be sceptical of some of the company’s marketing hype – for example, a new independent report suggests the hardware spend on R1 was as high as US$500 million. But even so, DeepSeek was still built very quickly and efficiently compared with rival models.
This might be because DeepSeek distilled OpenAI’s output. However, there is currently no method to prove this conclusively. One method that is in the early stages of development is watermarking AI outputs. This adds invisible patterns to the outputs, similar to those applied to copyrighted images. There are various ways to do this in theory, but none is effective or efficient enough to have made it into practice.
There are other reasons that help explain DeepSeek’s success, such as the company’s deep and challenging technical work.
The technical advances made by DeepSeek included taking advantage of less powerful but cheaper AI chips (also called graphical processing units, or GPUs).
DeepSeek had no choice but to adapt after the US has banned firms from exporting the most powerful AI chips to China.
While Western AI companies can buy these powerful units, the export ban forced Chinese companies to innovate to make the best use of cheaper alternatives.
A series of lawsuits
OpenAI’s terms of use explicitly state nobody may use its AI models to develop competing products. However, its own models are trained on massive datasets scraped from the web. These datasets contained a substantial amount of copyrighted material, which OpenAI says it is entitled to use on the basis of “fair use”:
Training AI models using publicly available internet materials is fair use, as supported by long-standing and widely accepted precedents. We view this principle as fair to creators, necessary for innovators, and critical for US competitiveness.
This argument will be tested in court. Newspapers, musicians, authors and other creatives have filed a series of lawsuits against OpenAI on the grounds of copyright infringement.
Of course, this is quite distinct to what OpenAI accuses DeepSeek of doing. Nevertheless OpenAI isn’t attracting much sympathy for its claim that DeepSeek illegitimately harvested its model output.
The war of words and lawsuits is an artefact of how the rapid advance of AI has outpaced the development of clear legal rules for the industry. And while these recent events might reduce the power of AI incumbents, much hinges on the outcome of the various ongoing legal disputes.
Shaking up the global conversation
DeepSeek has shown it is possible to develop state-of-the-art models cheaply and efficiently. Whether they can compete with OpenAI on a level playing field remains to be seen.
Over the weekend, OpenAI attempted to demonstrate its supremacy by publicly releasing its most advanced consumer model, o3-mini.
OpenAI claims this model substantially outperforms even its own previous market-leading version, o1, and is the “most cost-efficient model in our reasoning series”.
These developments herald an era of increased choice for consumers, with a diversity of AI models on the market. This is good news for users: competitive pressures will make models cheaper to use.
And the benefits extend further.
Training and using these models places a massive strain on global energy consumption. As these models become more ubiquitous, we all benefit from improvements to their efficiency.
DeepSeek’s rise certainly marks new territory for building models more cheaply and efficiently. Perhaps it will also shake up the global conversation on how AI companies should collect and use their training data.
(Author: Lea Frermann, Senior Lecturer in Natural Language Processing, The University of Melbourne, The University of Melbourne and Shaanan Cohney, Lecturer in Cybersecurity, The University of Melbourne)
This article is republished from The Conversation under a Creative Commons license. Read the original article.
(Except for the headline, this story has not been edited by NDTV staff and is published from a syndicated feed.)