Yann LeCun On GPT-3

Opinion GPT-3 Is Overhyped By Analytics Drift October 28, 2020

Yann LeCun.. Yann LeCun.. 1 GPT-3 doesn’t have any knowledge of how the world actually works. GPT-3 doesn’t have any knowledge of how the world actually works.

LeCun Continues.. LeCun Continues.. 2 It only appears to have some level of background knowledge, to the extent that this knowledge is present in the statistics of text. But this knowledge is very shallow and disconnected from the underlying reality It only appears to have some level of background knowledge, to the extent that this knowledge is present in the statistics of text. But this knowledge is very shallow and disconnected from the underlying reality

3 But trying to build intelligent machines by scaling up language models is like building a high-altitude airplanes to go to the moon. You might beat altitude records, but going to the moon will require a completely different approach But trying to build intelligent machines by scaling up language models is like building a high-altitude airplanes to go to the moon. You might beat altitude records, but going to the moon will require a completely different approach Why such an approach won't work? Why such an approach won't work?