Academic Thesis

Basic information

Name Kuroda Masahiro
Belonging department
Occupation name
researchmap researcher code 5000032373
researchmap agency Okayama University of Science

Title

Speeding up the convergence of the alternating least squares algorithm using vector $$\varepsilon $$ acceleration and restarting for nonlinear principal component analysis

Bibliography Type

Joint Author

Author

Kuroda Masahiro, Mori Yuichi and Iizuka Masaya

Summary

Principal component analysis (PCA) is a widely used descriptive multivariate technique in the analysis of quantitative data. When applying PCA to mixed quantitative and qualitative data, we utilize an optimal scaling technique for quantifying qualitative data. PCA with optimal scaling is called nonlinear PCA. The alternating least squares (ALS) algorithm is used for computing nonlinear PCA. The ALS algorithm is stable in convergence and simple in implementation; however, the algorithm tends to converge slowly for large data matrices owing to its linear convergence. Then the vε-ALS algorithm, which incorporates the vector ε accelerator into the ALS algorithm, is used to accelerate the convergence of the ALS algorithm for nonlinear PCA. In this paper, we improve the vε-ALS algorithm via a restarting procedure and further reduce its number of iterations and computation time. The restarting procedure is performed under simple restarting conditions, and it speeds up the convergence of the vε-ALS algorithm. The vε-ALS algorithm with a restarting procedure is referred to as the vεR-ALS algorithm. Numerical experiments examine the performance of the vεR-ALS algorithm by comparing its number of iterations and computation time with those of the ALS and vε-ALS algorithms.


Magazine(name)

Computational Statistics

Publisher

Springer

Volume

38

Number Of Pages

StartingPage

243

EndingPage

262

Date of Issue

2023/03

Referee

Exist

Invited

Not exist

Language

English

Thesis Type

ISSN

DOI

10.1007/s00180-022-01225-4

NAID

PMID

URL

J-GLOBAL ID

arXiv ID

ORCID Put Code

DBLP ID