I investigate the analytic and statistical foundations of deep learning. By understanding their behaviour, I develop rigorous modifications that enable these models to efficiently capture structures arising in finance, stochastic processes, games, and PDEs.