![An Iterative L1 Regularized Limited Memory Stochastic BFGS Algorithm and Numerical Experiments for Big Data Applications için kapak resmi An Iterative L1 Regularized Limited Memory Stochastic BFGS Algorithm and Numerical Experiments for Big Data Applications için kapak resmi](/client/assets/cf6e192b74af2810/ctx/images/no_image.png)
An Iterative L1 Regularized Limited Memory Stochastic BFGS Algorithm and Numerical Experiments for Big Data Applications
Başlık:
An Iterative L1 Regularized Limited Memory Stochastic BFGS Algorithm and Numerical Experiments for Big Data Applications
Yazar:
Patel, Vandan, author.
ISBN:
9780438044388
Yazar Ek Girişi:
Fiziksel Tanımlama:
1 electronic resource (59 pages)
Genel Not:
Source: Masters Abstracts International, Volume: 57-06M(E).
Advisors: Farzad Yousefian Committee members: Sunderesh Heragu; Chaoyue Zhao.
Özet:
This research is motivated by challenges in addressing optimization models arising in Big Data. Such models are often formulated as large scale stochastic optimization problems. When the probability distribution of the data is unknown, the Sample Average Approximation (SAA) scheme can be employed which results in an Empirical Risk Minimization (EMR) problem. To address this class of problems deterministic solution methods, such as the Broyden, Fletcher, Goldfarb, Shanno (BFGS) method, face high computational cost per iteration and memory requirement issues due to presence of uncertainty and high dimensionality of the solution space. To cope with these challenges, stochastic methods with limited memory variants have been developed recently. However, the solutions generated by such methods might be dense requiring high memory capacity. To generate sparse solutions, in the literature, standard L 1 regularization technique is employed, where constant L 1 regularization parameter is added to the objective function of the problem which changes the original problem and the solutions obtained by solving the regularized problem are approximate solutions. Moreover, limited information is available in the literature to obtain sparse solutions to the original problem. To address this gap, in this research we develop an iterative L1 Regularized Limited memory Stochastic BFGS (iRLS-BFGS) method in which the L1 regularization parameter and the step-size parameter are simultaneously updated at each iteration. Our goal is to find the suitable decay rates for these two sequences in our algorithm. To address this research question, we first implement the iRLS-BFGS algorithm on a Big Data text classification problem and provide a detailed numerical comparison of the performance of the developed algorithm under different choices of the update rules. Our numerical experiments imply that when both the step-size and the L1 regularization parameter decay at the rate of the order 1/√k, the best convergence is achieved. Later, to support our findings, we apply our method to address a large scale image deblurring problem arising in signal processing using the update rule from the previous application. As a result, we obtain much clear deblurred images compared to the classical algorithm's deblurred output images when both the step-size and the L1 regularization parameter decay at the rate of the order 1/√k.
Notlar:
School code: 0664
Konu Başlığı:
Tüzel Kişi Ek Girişi:
Mevcut:*
Yer Numarası | Demirbaş Numarası | Shelf Location | Lokasyon / Statüsü / İade Tarihi |
---|---|---|---|
XX(687931.1) | 687931-1001 | Proquest E-Tez Koleksiyonu | Arıyor... |
On Order
Liste seç
Bunu varsayılan liste yap.
Öğeler başarıyla eklendi
Öğeler eklenirken hata oldu. Lütfen tekrar deneyiniz.
:
Select An Item
Data usage warning: You will receive one text message for each title you selected.
Standard text messaging rates apply.