Automatic Differentiation: a look through Tensor and Operational Calculus

2016/12/08 by Žiga Sajovic, Sajovic, Žiga
Computer Science · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Functional Analysis (math.FA) #Symbolic Computation (cs.SC) #cs.SC #math.FA

paper · pdf · doi:10.48550/arxiv.1612.02731

arxiv created 2018/08/30 · arxiv updated 2018/09/03

Abstract

In this paper we take a look at Automatic Differentiation through the eyes of Tensor and Operational Calculus. This work is best consumed as supplementary material for learning tensor and operational calculus by those already familiar with automatic differentiation. To that purpose, we provide a simple implementation of automatic differentiation, where the steps taken are explained in the language tensor and operational calculus.

Related

• Automatic Differentiation of Algorithms for Machine Learning
• How to Define Automatic Differentiation
• A Simple Differentiable Programming Language
• On the Equivalence of Automatic and Symbolic Differentiation
• A Geometric Theory of Higher-Order Automatic Differentiation