Latent vector autoregressive modeling and feature analysis of high dimensional and noisy data from dynamic systems

S. Joe QIN

doi:10.1002/aic.17703

Latent vector autoregressive modeling and feature analysis of high dimensional and noisy data from dynamic systems

S. Joe QIN^*

^*Corresponding author for this work

Research output: Journal Publications › Journal Article (refereed) › peer-review

2 Citations (Scopus)

Abstract

In this article, a novel latent vector autoregressive (LaVAR) modeling algorithm with a canonical correlation analysis (CCA) objective is proposed to estimate a fully-interacting reduced-dimensional dynamic model. This algorithm is an advancement of the dynamic inner canonical correlation analysis (DiCCA) algorithm, which builds univariate latent autoregressive models that are noninteracting. The dynamic latent variable scores of the proposed algorithm are guaranteed to be orthogonal with a descending order of predictability, retaining the properties of DiCCA. Further, the LaVAR-CCA algorithm solves multiple latent variables simultaneously with a statistical interpretation of the profile likelihood. The Lorenz oscillator with noisy measurements and an application case study on an industrial dataset are used to illustrate the superiority of the proposed algorithm. The reduced-dimensional latent dynamic model has numerous potential applications for prediction, feature analysis, and diagnosis of systems with rich measurements.

Original language	English
Article number	e17703
Number of pages	14
Journal	AICHE Journal
Volume	68
Issue number	6
Early online date	30 Mar 2022
DOIs	https://doi.org/10.1002/aic.17703
Publication status	Published - Jun 2022
Externally published	Yes

Bibliographical note

Financial support for this work from a General Research Fund by RGC of Hong Kong (No. 11303421), Dimension reduction modeling methods for high dimensional dynamic data in smart manufacturing and operations, the Natural Science Foundation of China grant (U20A20189), Big data-driven abnormal situation intelligent diagnosis and self-healing control for process industries, and the City University of Hong Kong Project (9380123), SGP: Bridging between systems theory and dynamic data learning toward industrial intelligence and industry 4.0 is gratefully acknowledged. The author appreciates the helpful discussions with Prof. Alain Bensoussan at the City University of Hong Kong and Prof. Yingying Fan at the University of Southern California.

Keywords

dynamic latent variable learning
latent system modeling
plant-wide feature analysis
predictable latent time series
profile likelihood

Access to Document

10.1002/aic.17703

Cite this

@article{ea48bde94d4046ffbd347800f5f648d0,

title = "Latent vector autoregressive modeling and feature analysis of high dimensional and noisy data from dynamic systems",

abstract = "In this article, a novel latent vector autoregressive (LaVAR) modeling algorithm with a canonical correlation analysis (CCA) objective is proposed to estimate a fully-interacting reduced-dimensional dynamic model. This algorithm is an advancement of the dynamic inner canonical correlation analysis (DiCCA) algorithm, which builds univariate latent autoregressive models that are noninteracting. The dynamic latent variable scores of the proposed algorithm are guaranteed to be orthogonal with a descending order of predictability, retaining the properties of DiCCA. Further, the LaVAR-CCA algorithm solves multiple latent variables simultaneously with a statistical interpretation of the profile likelihood. The Lorenz oscillator with noisy measurements and an application case study on an industrial dataset are used to illustrate the superiority of the proposed algorithm. The reduced-dimensional latent dynamic model has numerous potential applications for prediction, feature analysis, and diagnosis of systems with rich measurements.",

keywords = "dynamic latent variable learning, latent system modeling, plant-wide feature analysis, predictable latent time series, profile likelihood",

author = "QIN, {S. Joe}",

note = "Financial support for this work from a General Research Fund by RGC of Hong Kong (No. 11303421), Dimension reduction modeling methods for high dimensional dynamic data in smart manufacturing and operations, the Natural Science Foundation of China grant (U20A20189), Big data-driven abnormal situation intelligent diagnosis and self-healing control for process industries, and the City University of Hong Kong Project (9380123), SGP: Bridging between systems theory and dynamic data learning toward industrial intelligence and industry 4.0 is gratefully acknowledged. The author appreciates the helpful discussions with Prof. Alain Bensoussan at the City University of Hong Kong and Prof. Yingying Fan at the University of Southern California.",

year = "2022",

month = jun,

doi = "10.1002/aic.17703",

language = "English",

volume = "68",

journal = "AICHE Journal",

issn = "0001-1541",

publisher = "Wiley-Blackwell",

number = "6",

}

TY - JOUR

T1 - Latent vector autoregressive modeling and feature analysis of high dimensional and noisy data from dynamic systems

AU - QIN, S. Joe

N1 - Financial support for this work from a General Research Fund by RGC of Hong Kong (No. 11303421), Dimension reduction modeling methods for high dimensional dynamic data in smart manufacturing and operations, the Natural Science Foundation of China grant (U20A20189), Big data-driven abnormal situation intelligent diagnosis and self-healing control for process industries, and the City University of Hong Kong Project (9380123), SGP: Bridging between systems theory and dynamic data learning toward industrial intelligence and industry 4.0 is gratefully acknowledged. The author appreciates the helpful discussions with Prof. Alain Bensoussan at the City University of Hong Kong and Prof. Yingying Fan at the University of Southern California.

PY - 2022/6

Y1 - 2022/6

N2 - In this article, a novel latent vector autoregressive (LaVAR) modeling algorithm with a canonical correlation analysis (CCA) objective is proposed to estimate a fully-interacting reduced-dimensional dynamic model. This algorithm is an advancement of the dynamic inner canonical correlation analysis (DiCCA) algorithm, which builds univariate latent autoregressive models that are noninteracting. The dynamic latent variable scores of the proposed algorithm are guaranteed to be orthogonal with a descending order of predictability, retaining the properties of DiCCA. Further, the LaVAR-CCA algorithm solves multiple latent variables simultaneously with a statistical interpretation of the profile likelihood. The Lorenz oscillator with noisy measurements and an application case study on an industrial dataset are used to illustrate the superiority of the proposed algorithm. The reduced-dimensional latent dynamic model has numerous potential applications for prediction, feature analysis, and diagnosis of systems with rich measurements.

AB - In this article, a novel latent vector autoregressive (LaVAR) modeling algorithm with a canonical correlation analysis (CCA) objective is proposed to estimate a fully-interacting reduced-dimensional dynamic model. This algorithm is an advancement of the dynamic inner canonical correlation analysis (DiCCA) algorithm, which builds univariate latent autoregressive models that are noninteracting. The dynamic latent variable scores of the proposed algorithm are guaranteed to be orthogonal with a descending order of predictability, retaining the properties of DiCCA. Further, the LaVAR-CCA algorithm solves multiple latent variables simultaneously with a statistical interpretation of the profile likelihood. The Lorenz oscillator with noisy measurements and an application case study on an industrial dataset are used to illustrate the superiority of the proposed algorithm. The reduced-dimensional latent dynamic model has numerous potential applications for prediction, feature analysis, and diagnosis of systems with rich measurements.

KW - dynamic latent variable learning

KW - latent system modeling

KW - plant-wide feature analysis

KW - predictable latent time series

KW - profile likelihood

UR - http://www.scopus.com/inward/record.url?scp=85128941762&partnerID=8YFLogxK

U2 - 10.1002/aic.17703

DO - 10.1002/aic.17703

M3 - Journal Article (refereed)

AN - SCOPUS:85128941762

SN - 0001-1541

VL - 68

JO - AICHE Journal

JF - AICHE Journal

IS - 6

M1 - e17703

ER -

Latent vector autoregressive modeling and feature analysis of high dimensional and noisy data from dynamic systems

Abstract

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this