Constrained grouped sparsity

Yi Guo, Junbin Gao, Xia Hong

Research output: Chapter in Book / Conference PaperConference Paperpeer-review

1 Citation (Scopus)

Abstract

![CDATA[In this paper, we propose an algorithm encouraging group sparsity under some convex constraint. It stems from some applications where the regression coefficients are subject to constraints, for example nonnegativity and the explanatory variables are not suitable to be orthogonalized within groups. It takes the form of the group LASSO based on linear regression model where a L1/L2 norm is imposed on group coefficients to achieve group sparsity. It differs from the original group LASSO in the following ways. First, the regression coefficients must obey some convex constraints. Second, there is no requirement for orthogonality of the variables within individual groups. For these rea- sons, the simple blockwise coordinate descent for all group coefficients is no longer applicable and a special treatment for the constraint is necessary. The algorithm we proposed in this paper is an alternating direction method, and both exact and inexact solutions are provided. The inexact version simplifies the computation while retaining practical convergence. As an approximation to group L0, it can be applied to data analysis where group fitting is essential and the coefficients are constrained. It may serve as a screening procedure to reduce the number of the groups when the number of total groups is prohibitively high.]]
Original languageEnglish
Title of host publicationAI 2012: Advances in Artificial Intelligence: 25th International Australasian Joint Conference, Sydney, Australia, December 4-7, 2012, Proceedings
PublisherSpringer
Pages433-444
Number of pages12
ISBN (Print)9783642351006
DOIs
Publication statusPublished - 2012
EventAustralasian Joint Conference on Artificial Intelligence -
Duration: 1 Dec 2013 → …

Conference

ConferenceAustralasian Joint Conference on Artificial Intelligence
Period1/12/13 → …

Keywords

  • algorithm
  • least squares
  • linear models (statistics)

Fingerprint

Dive into the research topics of 'Constrained grouped sparsity'. Together they form a unique fingerprint.

Cite this