GPT-3 Is Overhyped

By Analytics Drift

October 28, 2020

Yann LeCun..


GPT-3 doesn’t have any knowledge of how the world actually works.

LeCun Continues..


It only appears to have some level of background knowledge, to the extent  that this knowledge is  present in the statistics of text. But this knowledge is very shallow and disconnected from the underlying reality


But trying to build intelligent machines by scaling up language models is like building a high-altitude airplanes to go to the moon. You might beat altitude records, but going to the moon will require a completely different approach

Why such an approach won't work?

Read Our Article...