13.3.11.4.1 Least Squares Optimization, Learning

Chapter Contents (Back)
Optimization. Least Squares.
See also Gradient Descent.
See also Computational Complexity Issues, Computation. 2602

Toh, K.A.[Kar-Ann], Eng, H.L.[How-Lung],
Between Classification-Error Approximation and Weighted Least-Squares Learning,
PAMI(30), No. 4, April 2008, pp. 658-669.
IEEE DOI 0803
BibRef

Xue, H.[Hui], Chen, S.C.[Song-Can], Yang, Q.A.[Qi-Ang],
Discriminatively regularized least-squares classification,
PR(42), No. 1, January 2009, pp. 93-104.
Elsevier DOI 0809
Classifier design; Discriminative information; Manifold learning; Pattern recognition BibRef

Qu, H.N.[Hai-Ni], Li, G.Z.[Guo-Zheng], Xu, W.S.[Wei-Sheng],
An asymmetric classifier based on partial least squares,
PR(43), No. 10, October 2010, pp. 3448-3457.
Elsevier DOI 1007
Partial least squares, Dimension reduction, Classification, Unbalanced data BibRef

Yamada, M.[Makoto], Sugiyama, M.[Masashi], Wichern, G.[Gordon], Simm, J.[Jaak],
Improving the Accuracy of Least-Squares Probabilistic Classifiers,
IEICE(E94-D), No. 6, June 2011, pp. 1337-1340.
WWW Link. 1101
BibRef

Quinn, J.A.[John A.], Sugiyama, M.[Masashi],
A least-squares approach to anomaly detection in static and sequential data,
PRL(40), No. 1, 2014, pp. 36-40.
Elsevier DOI 1403
Anomaly detection BibRef

Chierchia, G., Pustelnik, N., Pesquet, J.C., Pesquet-Popescu, B.,
Epigraphical projection and proximal tools for solving constrained convex optimization problems,
SIViP(9), No. 8, November 2015, pp. 1737-1749.
Springer DOI 1511
BibRef

Harizanov, S.[Stanislav], Pesquet, J.C.[Jean-Christophe], Steidl, G.[Gabriele],
Epigraphical Projection for Solving Least Squares Anscombe Transformed Constrained Optimization Problems,
SSVM13(125-136).
Springer DOI 1305
BibRef

Guan, S.[Sihai], Li, Z.[Zhi],
Optimal step size of least mean absolute third algorithm,
SIViP(11), No. 6, September 2017, pp. 1105-1113.
WWW Link. 1708
BibRef

Zhang, T., Wang, S., Huang, X., Jia, L.,
Kernel Recursive Least Squares Algorithm Based on the Nystrom Method With k-Means Sampling,
SPLetters(27), 2020, pp. 361-365.
IEEE DOI 2004
Kernel adaptive filters, Nystrom method, kernel recursive least squares, k-means sampling BibRef

Gribonval, R.[Rémi], Nikolova, M.[Mila],
A Characterization of Proximity Operators,
JMIV(62), No. 6-7, July 2020, pp. 773-789.
Springer DOI 2007
Functions that map a vector to a solution of a penalized least-squares optimization problem. BibRef

Chen, G.Y., Gan, M., Wang, S., Chen, C.L.P.,
Insights Into Algorithms for Separable Nonlinear Least Squares Problems,
IP(30), 2021, pp. 1207-1218.
IEEE DOI 2012
Jacobian matrices, Optimization, Signal processing algorithms, Partitioning algorithms, Bundle adjustment, Analytical models, bundle adjustment BibRef

Rusu, C.[Cristian], Gonzalez-Prelcic, N.[Nuria],
A Novel Approach for Unit-Modulus Least-Squares Optimization Problems,
SPLetters(30), 2023, pp. 224-228.
IEEE DOI 2303
Optimization, Iterative methods, Millimeter wave communication, Linear programming, Signal processing algorithms, hybrid precoding and combining BibRef

Wei, T.[Tong], Huang, H.P.[Hui-Ping], Wu, L.L.[Lin-Long], Chi, C.Y.[Chong-Yung], Shankar, M.R.B.[M. R. Bhavani], Ottersten, B.[Björn],
Quadratic Equality Constrained Least Squares: Low-Complexity ADMM for Global Optimality,
SPLetters(33), 2026, pp. 361-365.
IEEE DOI 2601
Convergence, Convex functions, Complexity theory, Optimization, Signal processing algorithms, Accuracy, Iterative methods, non-convex quadratic equality constraint BibRef

Paleologu, C.[Constantin], Benesty, J.[Jacob], Otopeleanu, R.A.[Radu-Andrei], Ciochina, S.[Silviu],
A Nonparametric Variable Forgetting Factor Recursive Least-Squares Algorithm,
SPLetters(33), 2026, pp. 36-40.
IEEE DOI 2512
Signal processing algorithms, Adaptive filters, Covariance matrices, Convergence, Filtering algorithms, variable forgetting factor BibRef


Nasery, A.[Anshul], Hayase, J.[Jonathan], Koh, P.W.[Pang Wei], Oh, S.[Sewoong],
PLeaS: Merging Models with Permutations and Least Squares,
CVPR25(30493-30502)
IEEE DOI 2508
Training, Computational modeling, Merging, Machine learning, Approximation error, Data models, Classification algorithms, model merging BibRef

Pouransari, H., Tu, Z., Tuzel, O.,
Least squares binary quantization of neural networks,
EDLCV20(2986-2996)
IEEE DOI 2008
Quantization (signal), Computational modeling, Optimization, Tensile stress, Neural networks, Computational efficiency, Approximation algorithms BibRef

Zach, C., Bourmaud, G.,
Pareto Meets Huber: Efficiently Avoiding Poor Minima in Robust Estimation,
ICCV19(10242-10250)
IEEE DOI 2004
estimation theory, least squares approximations, optimisation, search problems, robust estimation, BibRef

Ikami, D., Yamasaki, T., Aizawa, K.,
Residual Expansion Algorithm: Fast and Effective Optimization for Nonconvex Least Squares Problems,
CVPR17(7206-7214)
IEEE DOI 1711
Clustering algorithms, Convergence, Image restoration, Linear programming, Optimization methods BibRef

Hasegawa, R.[Ryoma], Hotta, K.[Kazuhiro],
PLSNet: A simple network using Partial Least Squares regression for image classification,
ICPR16(1601-1606)
IEEE DOI 1705
Convolution, Databases, Feature extraction, Image classification, Network architecture, Principal component analysis, Training, Convolutional Neural Network, Deep Learning, PCANet, PLSNet, Partial Least Squares Regression, Stacked, PLS BibRef

Samejima, M.[Masaki], Matsushita, Y.[Yasuyuki],
Fast General Norm Approximation via Iteratively Reweighted Least Squares,
eHeritage16(II: 207-221).
Springer DOI 1704
BibRef

Olsson, C.[Carl], Kahl, F.[Fredrik], Hartley, R.I.[Richard I.],
Projective least-squares: Global solutions with local optimization,
CVPR09(1216-1223).
IEEE DOI 0906
BibRef

Olsson, C.[Carl], Byröd, M.[Martin], Kahl, F.[Fredrik],
Globally Optimal Least Squares Solutions for Quasiconvex 1D Vision Problems,
SCIA09(686-695).
Springer DOI 0906
BibRef

Debiolles, A., Oukhellou, L., Aknin, P.,
Combined use of partial least squares regression and neural network for diagnosis tasks,
ICPR04(IV: 573-576).
IEEE DOI 0409
BibRef

Chapter on Matching and Recognition Using Volumes, High Level Vision Techniques, Invariants continues in
Regression .


Last update:Feb 17, 2026 at 20:06:16