Blog Logo
TAGS

Ilya Sutskever: Deep Learning | Lex Fridman Podcast #94

Duration : 01:37:28

Elias Discover, the co-founder and chief scientist of OpenAI, is widely regarded as one of the most influential computer scientists in history with over 165,000 citations. His expertise lies in the field of deep learning, and he is considered one of the most brilliant minds in the field. The conversation with him was recorded before the outbreak of the pandemic, and it covered topics such as deep learning, intelligence, and life in general. The conversation does not include any ads and is presented by Cash App, a leading finance app that also supports robotics and STEM education through donations. Discover discusses the power of neural networks and their representational capabilities, highlighting the moment when he realized their potential. He refers to the importance of training large neural networks on extensive supervised data and how overparameterization is not a discouraging factor. However, he acknowledges that the theory regarding the relationship between data and parameters is still incomplete.