Beyond independent component analysis: identifiability and algorithms
2510.07525v1
math.ST, cs.LG, stat.ML, stat.TH, 62H12, 62R01, 62E10, 15A69
2025-10-11
Авторы:
Alvaro Ribot, Anna Seigal, Piotr Zwiernik
Abstract
Independent Component Analysis (ICA) is a classical method for recovering
latent variables with useful identifiability properties. For independent
variables, cumulant tensors are diagonal; relaxing independence yields tensors
whose zero structure generalizes diagonality. These models have been the
subject of recent work in non-independent component analysis. We show that
pairwise mean independence answers the question of how much one can relax
independence: it is identifiable, any weaker notion is non-identifiable, and it
contains the models previously studied as special cases. Our results apply to
distributions with the required zero pattern at any cumulant tensor. We propose
an algebraic recovery algorithm based on least-squares optimization over the
orthogonal group. Simulations highlight robustness: enforcing full independence
can harm estimation, while pairwise mean independence enables more stable
recovery. These findings extend the classical ICA framework and provide a
rigorous basis for blind source separation beyond independence.