Deep learning, the area of machine learning that relies on neural networks, is at the center of the current expansion of AI into all areas of science, technology, and society. Despite the success of deep learning in many applications, a comprehensive theory of deep learning is still lacking, and several foundational questions remain poorly understood. We will provide a brief introduction to deep learning and survey several open mathematical problems in the theory of deep learning.