Don’t expect large language models like the next GPT to be democratized

Buy Google Ads Accounts

In early May, Meta released Open Pretrained Transformer (OPT-175B), a large language model (LLM) that can perform various tasks. Large language models have become one of the hottest areas of research in artificial intelligence in the past few years.

OPT-175B is the latest entrant in the LLM arms race triggered by OpenAI’s GPT-3, a deep neural network with 175 billion parameters. GPT-3 showed that LLMs can perform many tasks without undergoing extra training and only seeing a few examples (zero- or few-shot learning). Microsoft later integrated GPT-3 into several of its products, showing not only the scientific but also the commercial promises of LLMs.

Greetings humanoids

Subscribe now for a weekly recap of our favorite AI stories


Mike is a Staff Writer for Geeker. For over 14 years, he has written about technology and tech history for sites such as The Atlantic, Fast Company, PCMag, PCWorld, Macworld, Ars Technica, and Wired. As a collector of vintage computers and video games for over 25 years, he brings a deep sense of history to his writings and uses that to inform his works on the past, present, and the future of tech.

Related Articles

Back to top button