Thank you Emmanuel for your comment!

I agree with you. If GPT-'s training cost around $12 million, Wu Dao 2.0 was probably on the same order of magnitude (even taking into account MoE-based cost improvements).

But they didn't publish anything regarding costs. I didn't even find it in the original Chinese article. I talk about the cost problems in this and other articles.

Cheers :)

--

--

AI & Tech | Analyst at CambrianAI | Weekly AI Newsletter: https://thealgorithmicbridge.substack.com/ | Contact: alber.romgar@gmail.com

Love podcasts or audiobooks? Learn on the go with our new app.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Alberto Romero

Alberto Romero

AI & Tech | Analyst at CambrianAI | Weekly AI Newsletter: https://thealgorithmicbridge.substack.com/ | Contact: alber.romgar@gmail.com

More from Medium

The Future of Cybersecurity and the Tech Companies out to Improve it

Eliciting latent knowledge

Why we Need Art to Cocreate the Societal Impact of AI