Understanding Neural Architectures with Kernel Analysis (ft. Arthur Jacot)
Interestingly, the adequacy of a neural architecture can be regarded as choosing the right kernel for the data at hand, as discussed by Arthur Jacot, PhD candidate in mathematics at EPFL.
https://people.epfl.ch/arthur.jacot
Check Arthur's 2018 NeurIPS paper on the neural tangent kernel
• Neural Tangent Kernel: Convergence and Gen...
https://arxiv.org/abs/1806.07572