Lecture Notes: Neural Network Architectures

2023/04/11 by Herberg, Evelyn
#68T07 #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)

paper · doi:10.48550/arxiv.2304.05133

Abstract

These lecture notes provide an overview of Neural Network architectures from a mathematical point of view. Especially, Machine Learning with Neural Networks is seen as an optimization problem. Covered are an introduction to Neural Networks and the following architectures: Feedforward Neural Network, Convolutional Neural Network, ResNet, and Recurrent Neural Network.

Related

• Lecture Notes on Linear Neural Networks: A Tale of Optimization and Generalization in Deep Learning
• Deep learning: Technical introduction
• Lecture Notes: Optimization for Machine Learning
• Neural Computing
• Towards a Mathematical Understanding of Neural Network-Based Machine Learning: what we know and what we don't