Appreciate it Markus :) That's a good question, I'm not sure that information is anywhere. Because the parameters are what's learnable, that's the number that matters the most.

To make an analogy, the brain has aprox 10^11 neurons and 10^15 synapses. That's 4 orders of magnitude more connections than units. Therefore (and this is just to make a very rough approximation), because the synapses are the equivalent to parameters, GPT-3 would have around 20 million neurons.

Yet, there are important differences. For instance, the number of synapses per neuron in the brain could be much larger than in GPT-3.

Cheers :)

--

--

AI and Technology | Analyst at CambrianAI | Weekly Newsletter: https://mindsoftomorrow.ck.page | Contact: alber.romgar@gmail.com

Love podcasts or audiobooks? Learn on the go with our new app.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Alberto Romero

Alberto Romero

AI and Technology | Analyst at CambrianAI | Weekly Newsletter: https://mindsoftomorrow.ck.page | Contact: alber.romgar@gmail.com

More from Medium

The Metaverse is Flat. Not.

Researching while Chinese American: Ethnic Profiling, Chinese American Scientists and a New…

Taking the science to the people: Sheeva Azma hosts Real ScientistsPlaceholder

Kevin Reese is the Yankees’ new director of player development