An Interventional Perspective on Identifiability in Gaussian LTI Systems with Independent Component Analysis

November 29, 2023 ยท Entered Twilight ยท ๐Ÿ› CLEaR

๐Ÿ’ค TWILIGHT: Eternal Rest
Repo abandoned since publication

Repo contents: .github, .gitignore, .gitmodules, .pre-commit-config.yaml, CITATION.cff, LICENSE, README.md, analysis, configs, lti_ica, requirements.txt, scripts, setup.cfg, setup.py, state_space_models, sweeps, tests

Authors Goutham Rajendran, Patrik Reizinger, Wieland Brendel, Pradeep Ravikumar arXiv ID 2311.18048 Category cs.LG: Machine Learning Cross-listed cs.CE, eess.SY, stat.ME Citations 9 Venue CLEaR Repository https://github.com/rpatrik96/lti-ica โญ 2 Last Checked 2 months ago
Abstract
We investigate the relationship between system identification and intervention design in dynamical systems. While previous research demonstrated how identifiable representation learning methods, such as Independent Component Analysis (ICA), can reveal cause-effect relationships, it relied on a passive perspective without considering how to collect data. Our work shows that in Gaussian Linear Time-Invariant (LTI) systems, the system parameters can be identified by introducing diverse intervention signals in a multi-environment setting. By harnessing appropriate diversity assumptions motivated by the ICA literature, our findings connect experiment design and representational identifiability in dynamical systems. We corroborate our findings on synthetic and (simulated) physical data. Additionally, we show that Hidden Markov Models, in general, and (Gaussian) LTI systems, in particular, fulfil a generalization of the Causal de Finetti theorem with continuous parameters.
Community shame:
Not yet rated
Community Contributions

Found the code? Know the venue? Think something is wrong? Let us know!

๐Ÿ“œ Similar Papers

In the same crypt โ€” Machine Learning