Noam Chomsky: Language, Cognition, and Deep Learning | Lex Fridman Podcast #53

The conversation begins with the host recounting his memorable first encounter with Noam Chomsky at MIT, highlighting the significance of meeting such an influential figure in linguistics, cognitive science, philosophy, and political thought. The host expresses gratitude for the opportunity to converse with Chomsky and shares the unfortunate technical mishap that occurred during the recording, resulting in the loss of video footage of Chomsky. Despite this, the host emphasizes the depth of intellect displayed by Chomsky and his willingness to engage in meaningful dialogue.

The discussion delves into the possibility of establishing communication with an alien species, with Chomsky referencing Marv Minsky's experiments and the idea that higher intelligence might share commonalities such as arithmetic. Chomsky explores the concepts of internal and external language, emphasizing that they are not alternatives but represent different aspects of language use. The conversation touches on the nature of language as an innate human faculty, distinct from other species, and its role as a fundamental component of human cognition.

Chomsky discusses the inherent limits of human intelligence, challenging the belief that we can answer any question in principle. He draws parallels between our cognitive capacities and genetic endowments, suggesting that the richness and complexity of our cognitive abilities also set boundaries on what we can achieve. The conversation includes a historical account of Newton's struggle with the concept of action at a distance, illustrating how scientific understanding evolves and sometimes accepts the existence of mysteries beyond our comprehension.

Chomsky addresses the philosophical question of whether evil arises from human nature or societal institutions. He argues that while all actions have roots in our nature, the specific institutions that emerge are expressions of human nature influenced by historical contingencies. Chomsky also discusses the potential for different societal structures, challenging the notion that market systems or other institutions are inherently part of human nature.

The host shares his experience at Neuralink, a company developing brain-computer interfaces, and poses questions about the potential expansion of human cognitive and linguistic capacities through technology. Chomsky differentiates between expanding cognitive capacity, as books have done for centuries, and the possibility of fundamentally new understandings. He suggests that while technology like Neuralink might offer new ways to interact with the world, it does not necessarily equate to a deeper comprehension of complex systems such as quantum mechanics.

Chomsky highlights the fascinating aspect of language known as structure dependence, which refers to the way we interpret sentences based on their structural relationships rather than linear proximity. He explains how this property of language is deeply ingrained and universal, yet remains a mystery in terms of its neural basis and underlying reasons. Chomsky emphasizes the importance of understanding such linguistic structures and the insights they provide into the nature of language and cognition.

The conversation turns to the topic of deep learning and neural networks, with Chomsky questioning their status as scientific endeavors versus engineering projects. He critiques the approach of using vast amounts of data to find patterns without seeking to understand the underlying principles. Chomsky compares the process to the scientific method, which seeks critical experiments to answer theoretical questions, and suggests that deep learning's success on data that violates language rules is, from a scientific perspective, a failure.

In the final part of the conversation, Chomsky reflects on personal and intellectual moments that have brought him happiness and satisfaction, such as falling in love and having children. He also discusses the evolution of his thoughts on language and cognition, emphasizing the importance of questioning seemingly obvious phenomena and the narrow constraints that govern the possibilities of language and organisms. Chomsky concludes with his views on mortality and the meaning of existence, asserting that the significance of life is determined by our own actions and activities.

The host concludes the podcast by thanking Noam Chomsky for the insightful conversation and acknowledges the presenting sponsor, Cash App. He encourages listeners to download Cash App using the code 'LexPodcast' to support STEM education nonprofit FIRST. The host also invites listeners to engage with the podcast by subscribing on YouTube, rating on Apple Podcast, supporting on Patreon, or connecting on Twitter.