I investigate the analytic and statistical foundations of deep learning. By understanding the behaviour of these models, I can rigorously modify them to efficiently encode the structures arising in the natural and social sciences, esp. stochastic processes, games, and PDEs.