Some Mathematical Notes on Three-Mode Factor Analysis

1966/09/01 by Ledyard R Tucker · 147 citations
Agricultural and Biological Sciences · Computer Science · #Sensory Analysis and Statistical Methods #Matrix Theory and Algorithms #Blind Source Separation Techniques

paper · doi:10.1007/bf02289464

Abstract

The model for three-mode factor analysis is discussed in terms of newer applications of mathematical processes including a type of matrix process termed the Kronecker product and the definition of combination variables. Three methods of analysis to a type of extension of principal components analysis are discussed. Methods II and III are applicable to analysis of data collected for a large sample of individuals. An extension of the model is described in which allowance is made for unique variance for each combination variable when the data are collected for a large sample of individuals.

Citations

• The Approximation of One Matrix by Another of Lower Rank

Cited by

• Analysis of Individual Differences in Multidimensional Scaling Via an N-way Generalization of “Eckart-Young” Decomposition
• Intrinsic Low-Tucker-Rank Theory and Unified Tensor CUR Decomposition for High-Dimensional Hyperinterpolation
• Sparse Reduced-rank Regression Methods for Spatially Misaligned Data with Application to Spatial Transcriptomics
• A low-rank and sparse enhanced Tucker decomposition approach for tensor completion
• Tensor Network Machine Learning for Wildfire Susceptibility Mapping: from Grokking Dynamics to Quantum Mixedness of Class Representations
• A Local Macroscopic Conservative Low-Rank Discontinuous Galerkin Method for the Vlasov-Poisson Equation with Dougherty-Fokker-Planck Collisions
• A JoLT for the KV Cache: Near-Lossless KV Cache Compression via Joint Tucker and JL-Residual Allocation for LLMs
• Higher-order Count Sketch: Dimensionality Reduction That Retains Efficient Tensor Operations
• Building Compact and Robust Deep Neural Networks with Toeplitz Matrices
• Simple and Efficient Parallelization for Probabilistic Temporal Tensor Factorization
• Wide Compression: Tensor Ring Nets
• covSTATIS: A multi-table technique for network neuroscience
• Algorithm for multivariate data standardization up to third moment
• Randomized Approach to Nonlinear Inversion Combining Simultaneous Random\n and Optimized Sources and Detectors
• Towards Dual-Brain Minimal Sufficient Representation for Vision-Language Navigation
• The Atlas for the Aspiring Network Scientist
• When Bayesian Tensor Completion Meets Multioutput Gaussian Processes: Functional Universality and Rank Learning
• Soft Tensor Regression
• Structure-Preserving Nonlinear Sufficient Dimension Reduction for Tensors
• Rethinking Coupled Tensor Analysis for Hyperspectral Super-Resolution: Recoverable Modeling Under Endmember Variability
• IoMT-based Automated Leukemia Classification using CNN and Higher Order Singular Value
• Bayesian Conditional Tensor Factorizations for High-Dimensional Classification
• Infinite Tucker Decomposition: Nonparametric Bayesian Models for Multiway Data Analysis
• Dynamical Tensor Train Approximation for Kinetic Equations
• Optimal Sparse Singular Value Decomposition for High-dimensional High-order Data
• Scaling and Scalability: Provable Nonconvex Low-Rank Tensor Estimation from Incomplete Measurements
• Efficient Low-Tubal-Rank Tensor Estimation via Alternating Preconditioned Gradient Descent
• Nonparametric Sparse Tensor Factorization with Hierarchical Gamma Processes
• Advanced Unsupervised Learning: A Comprehensive Overview of Multi-View Clustering Techniques
• Cell-cell communication inference and analysis: biological mechanisms, computational approaches, and future opportunities
• A Provably Efficient Method for Tensor Ring Decomposition and Its Applications
• High-dimensional Autoregressive Modeling for Time Series with Hierarchical Structures
• Time Extrapolation with Graph Convolutional Autoencoder and Tensor Train Decomposition
• Symmetric tensors and symmetric tensor rank
• Deeper, Broader and Artier Domain Generalization
• High-dimensional vector autoregressive time series modeling via tensor decomposition
• iFCTN: Folding-Free Fully-Connected Tensor Network Decomposition for Tensor Completion
• Causal Inference on Sequential Treatments via Tensor Completion
• Tensor-network approach to quantum optical state evolution beyond the Fock basis
• SliceNStitch: Continuous CP Decomposition of Sparse Tensor Streams
• Enhanced nonconvex low-rank approximation of tensor multi-modes for tensor completion
• MobileDets: Searching for Object Detection Architectures for Mobile Accelerators
• Algorithm 862
• Multi-modal and frequency-weighted tensor nuclear norm for hyperspectral image denoising
• A Sharp Blockwise Tensor Perturbation Bound for Orthogonal Iteration
• A Novel Block-Alternating Iterative Algorithm for Retrieving Top-k Elements from Factorized Tensors
• Spatial-Temporal Tensor Graph Convolutional Network for Traffic Prediction
• Bayesian Allocation Model: Inference by Sequential Monte Carlo for Nonnegative Tensor Factorizations and Topic Models using Polya Urns
• Consensus-based In-Network Computation of the PARAFAC Decomposition
• Distribution-Aware Tensor Decomposition for Compression of Convolutional Neural Networks
• Large Bayesian Tensor Autoregressions
• An Interdisciplinary and Cross-Task Review on Missing Data Imputation
• No-rank Tensor Decomposition Using Metric Learning
• HybriNet-Hybrid Neural Network-based framework for Multi-Parametric Database Generation, Enhancement, and Forecasting
• Regularized Orthogonal Tensor Decompositions for Multi-Relational Learning
• Tensor Transpose and Its Properties
• An Axiomatic Approach to Tensor Rank Functions
• A Bayesian Tensor Factorization Model via Variational Inference for Link Prediction
• BLOCK: Bilinear Superdiagonal Fusion for Visual Question Answering and\n Visual Relationship Detection
• Pass-efficient methods for compression of high-dimensional turbulent flow data
• Tensorizing Neural Networks
• Tensor Factor Model Estimation by Iterative Projection
• Tensor Q-Rank: New Data Dependent Definition of Tensor Rank
• Low-Rank+Sparse Tensor Compression for Neural Networks
• Beyond dimension reduction: Stable electric fields emerge from and allow representational drift
• Modulating Regularization Frequency for Efficient Compression-Aware Model Training
• RIP-based performance guarantee for low-tubal-rank tensor recovery
• Intelligence Beyond the Edge: Inference on Intermittent Embedded Systems
• Post-Training Network Compression for 3D Medical Image Segmentation: Reducing Computational Efforts via Tucker Decomposition
• Committor functions via tensor networks
• HONE: Higher-Order Network Embeddings
• Efficient construction of tensor ring representations from sampling
• Hierarchical search of tree tensor networks for high-dimensional data
• Algebraic compressed sensing
• Parametric PDEs: Sparse or Low-Rank Approximations?
• Tensor network factorizations: Relationships between brain structural connectomes and traits
• A Unified Tensor-based Active Appearance Face Model
• Low-Rank High-Order Tensor Completion With Applications in Visual Data
• Tensor Restricted Isometry Property Analysis For a Large Class of Random Measurement Ensembles
• Tensor Decomposition for Compressing Recurrent Neural Network
• Convex Tensor Decomposition via Structured Schatten Norm Regularization
• Tensor Numerical Methods for High-dimensional PDEs: Basic Theory and\n Initial Applications
• High-dimensional low-rank matrix regression with unknown latent structures
• Probabilistic PCA on tensors
• Progressive Attention Memory Network for Movie Story Question Answering
• HOQRI: Higher-order QR Iteration for Low Multilinear Rank Approximation of Large and Sparse Tensors
• Common and Individual Structure of Brain Networks
• On the Identifiability of Tensor Ranks via Prior Predictive Matching
• Tensor Completion via Monotone Inclusion: Generalized Low-Rank Priors Meet Deep Denoisers
• Compact Autoregressive Network
• Tensor Network alternating linear scheme for MIMO Volterra system identification
• Tensor-based compression of the sea temperature data
• Efficient Resource-Constrained Training of Vision Transformers via Subspace Optimization
• Bayesian Poisson Tensor Factorization for Inferring Multilateral\n Relations from Sparse Dyadic Event Counts
• Adaptive Learning of Tensor Network Structures
• A Ternary Non-Commutative Latent Factor Model for Scalable Three-Way Real Tensor Completion
• Distributed Flexible Nonlinear Tensor Factorization
• Comparison of a Parametric Physics-Informed Neural Network and a Tensorial Reduced-Order Model for the Shallow-Water Dam-Break Problem
• Mathematics for Machine Learning
• Cross-View Latent Integration via Nonparametric Gamma Shrinkage Factor Analysis
• Ferumoxytol‐Enhanced <scp>5D</scp> Multiphase Steady‐State Imaging Using Rotating Cartesian K‐Space With Low‐Rank Reconstruction for Pediatric Congenital Heart Disease
• A new cross approximation for Tucker tensors and its application in Tucker-Anderson Acceleration
• TensLoRA: Tensor Alternatives for Low-Rank Adaptation
• Robust Vision-Language Models via Tensor Decomposition: A Defense Against Adversarial Attacks
• Bayesian Semiparametric Hidden Markov Tensor Partition Models for\n Longitudinal Data with Local Variable Selection
• Matrix Product State for Feature Extraction of Higher-Order Tensors
• Bayesian Sparse Tucker Models for Dimension Reduction and Tensor Completion
• Sparse multiway decomposition for analysis and modeling of diffusion\n imaging and tractography
• Tensor Networks for Latent Variable Analysis. Part I: Algorithms for Tensor Train Decomposition
• Low-rank Tensor Estimation via Riemannian Gauss-Newton: Statistical Optimality and Second-Order Convergence
• ISLET: Fast and Optimal Low-rank Tensor Regression via Importance Sketching
• Provable Near-Optimal Low-Multilinear-Rank Tensor Recovery
• Quantum tensor singular value decomposition with applications to recommendation systems
• Sharing Residual Units Through Collective Tensor Factorization in Deep Neural Networks
• Tensor Forms of Derivatives of Matrices and their applications in the Solutions to Differential Equations
• Data-driven discovery of dynamical models in biology
• Coupled tensor models for probability mass function estimation: Part II, Uniqueness of the model
• Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review
• Tensor Ring Decomposition
• A Tensorized Transformer for Language Modeling
• Community Detection for Hypergraph Networks via Regularized Tensor Power Iteration
• High-Dimensional Low-Rank Tensor Autoregressive Time Series Modeling
• Analysis of tensor methods for stochastic models of gene regulatory networks
• BoxE: A Box Embedding Model for Knowledge Base Completion
• Iterative Low-Rank Approximation for CNN Compression
• MLCTR: A Fast Scalable Coupled Tensor Completion Based on Multi-Layer Non-Linear Matrix Factorization
• AutoHOOT: Automatic High-Order Optimization for Tensors
• Frequency-adaptive tensor neural networks for high-dimensional multi-scale problems
• Regularized Tensor Factorizations and Higher-Order Principal Components Analysis
• TENT: Tensorized Encoder Transformer for Temperature Forecasting
• Goal-Oriented Low-Rank Tensor Decompositions for Numerical Simulation Data
• Are Fourier Neural Operators Really Faster for Time-Domain Wave Propagation?
• A Lightweight Learned Cardinality Estimation Model
• Fast adaptive tubal rank-revealing algorithm for t-product based tensor approximation
• CNN Acceleration by Low-rank Approximation with Quantized Factors
• Mode-Aware Non-Linear Tucker Autoencoder for Tensor-based Unsupervised Learning
• A Tensor Train Approach for Deterministic Arithmetic Operations on Discrete Representations of Probability Distributions
• Multi-mode Core Tensor Factorization based Low-Rankness and Its Applications to Tensor Completion
• Representation Learning for Words and Entities
• Multi-Slice Clustering for 3-order Tensor Data
• Tensorized Clustered LoRA Merging for Multi-Task Interference
• The coherent structures of EVP Fluid Flow Past a Circular Cylinder
• Randomized algorithms for the low multilinear rank approximations of tensors
• Nonnegative Low Rank Tensor Approximation and its Application to Multi-dimensional Images
• Higher order dynamic mode decomposition of noisy experimental data: The flow structure of a zero-net-mass-flux jet
• On The Synergy Between Nonconvex Extensions of The Tensor Nuclear Norm for Tensor Recovery
• Transfer entropy and O-information to detect grokking in tensor network multi-class classification problems

Related

• A Statistical Model which Combines Features of Factor Analytic and Analysis of Variance Techniques
• Component Analysis versus Common Factor Analysis: Some Further Observations
• Three Multivariate Models: Factor Analysis, Latent Structure Analysis, and Latent Profile Analysis
• THE THEORETICAL FOUNDATIONS OF PRINCIPAL FACTOR ANALYSIS, CANONICAL FACTOR ANALYSIS, AND ALPHA FACTOR ANALYSIS
• The Hull Method for Selecting the Number of Common Factors