The company behind GPT-3 and Codex isn’t as open as it claims. — The best intentions can be corrupted when money gets in the way. OpenAI was founded in 2015 as a non-profit company whose primary concern was to ensure that artificial general intelligence (AGI) would be created safely and would benefit all humanity evenly. “As a non-profit, our aim is to build…

I worked for 3 years at an AI company. Now I’ve decided to leave the industry indefinitely. — 3 years ago the words Artificial Intelligence evoked powerful sensations in me. Entering that world felt like taking a step into the mysteries and secrets of the future. I was mind-blown by the promises of intelligent machines, capable of solving tasks forever reserved to us. I was deep-diving into the…

A solution to the labor shortage or a new obstacle for workers? — Manufacturing companies are using a robot-as-employee approach to combat the labor shortage flooding the US. Since the pandemic started, the US has suffered from a highly unusual shortage of workers. The fear of the virus and the bad working conditions have incited many people to leave the workforce. Covid immigration…

Famous roboticist Rodney Brooks says we aren’t close to full autonomy — Companies have been promising self-driving tech for 80 years now. Despite what some may think, we’re not remotely there yet. Press releases and news articles about autonomous vehicle (AV) companies tend to overstate the stage of development of fully self-driving technology or, at least, obscure details that would remind analysts…

Official info, current trends, and predictions. — The day for the release of GPT-4 is getting closer. GPT-3 was announced in May 2020, almost two years ago. It was released one year after GPT-2 — which was also released a year after the original GPT paper was published. If this trend were to hold across versions, GPT-4…

DeepMind has found the secret to cheaply scale large language models. — DeepMind’s latest paper dismantles the tired trend of building larger and larger models to improve performance. The company has found a key aspect of scaling large language models that no one has ever applied before. OpenAI, Google, Microsoft, Nvidia, Facebook, and even DeepMind themselves, all big tech companies committed to…

They’re what OpenAI should’ve been — open and non-profit — EleutherAI will show OpenAI how to keep a promise. The early ideas behind OpenAI were extremely attractive. People were excited about the prospects of AGI and their commitment to open-source software untied from commercial interests. That was OpenAI, a non-profit AI institute that would lead the way towards safe, aligned…

How AI can influence a global conflict — and everything else. — A global conflict and the impossibility to tell real from fake is a cocktail for disaster. Two weeks ago Volodymyr Zelensky was making headlines everywhere. But this time, it wasn’t really him. It was a fake video in which Ukraine’s president supposedly appeared declaring he had decided to “return Donbas”…

μTransfer makes GPT-3 models even better than previously thought — μTransfer will allow companies to get the best performance out of the largest models, cheaply. Large neural networks show performances that were unimaginable just a few years ago. Models like GPT-3, Gopher, or AlphaCode have proved that big transformer-based models improve with size. However, a limitation hinders their performance in…