On the use of a pruning prior for neural networks

Cyril Goutte

doi:10.1109/NNSP.1996.548335

On the use of a pruning prior for neural networks

Cyril Goutte

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

503 Downloads (Pure)

Abstract

We address the problem of using a regularization prior that prunes unnecessary weights in a neural network architecture. This prior provides a convenient alternative to traditional weight-decay. Two examples are studied to support this method and illustrate its use. First we use the sunspots benchmark problem as an example of time series processing. Then we address the problem of system identification on a small artificial system

Original language	English
Title of host publication	Proceedings of the IEEE Signal Processing Society Workshop Neural Networks for Signal Processing
Publisher	IEEE
Publication date	1996
Pages	52-61
ISBN (Print)	07-80-33550-3
DOIs	https://doi.org/10.1109/NNSP.1996.548335
Publication status	Published - 1996
Event	1996 IEEE Workshop on Neural Networks for Signal Processing VI - Kyoto, Japan Duration: 4 Sept 1996 → 6 Sept 1996 Conference number: 6 http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=3974

Workshop

Workshop	1996 IEEE Workshop on Neural Networks for Signal Processing VI
Number	6
Country/Territory	Japan
City	Kyoto
Period	04/09/1996 → 06/09/1996
Internet address	http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=3974

Bibliographical note

Copyright: 1996 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE

Access to Document

10.1109/NNSP.1996.548335

CyrilFinal published version, 535 KB

OpenUrl availability

Full text

Cite this

@inproceedings{bda4933d91684466bba1eaeab32a96da,

title = "On the use of a pruning prior for neural networks",

abstract = "We address the problem of using a regularization prior that prunes unnecessary weights in a neural network architecture. This prior provides a convenient alternative to traditional weight-decay. Two examples are studied to support this method and illustrate its use. First we use the sunspots benchmark problem as an example of time series processing. Then we address the problem of system identification on a small artificial system",

author = "Cyril Goutte",

note = "Copyright: 1996 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE; 1996 IEEE Workshop on Neural Networks for Signal Processing VI, NNSP '96 ; Conference date: 04-09-1996 Through 06-09-1996",

year = "1996",

doi = "10.1109/NNSP.1996.548335",

language = "English",

isbn = "07-80-33550-3",

pages = "52--61",

booktitle = "Proceedings of the IEEE Signal Processing Society Workshop Neural Networks for Signal Processing",

publisher = "IEEE",

address = "United States",

url = "http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=3974",

}

TY - GEN

T1 - On the use of a pruning prior for neural networks

AU - Goutte, Cyril

N1 - Conference code: 6

PY - 1996

Y1 - 1996

N2 - We address the problem of using a regularization prior that prunes unnecessary weights in a neural network architecture. This prior provides a convenient alternative to traditional weight-decay. Two examples are studied to support this method and illustrate its use. First we use the sunspots benchmark problem as an example of time series processing. Then we address the problem of system identification on a small artificial system

AB - We address the problem of using a regularization prior that prunes unnecessary weights in a neural network architecture. This prior provides a convenient alternative to traditional weight-decay. Two examples are studied to support this method and illustrate its use. First we use the sunspots benchmark problem as an example of time series processing. Then we address the problem of system identification on a small artificial system

U2 - 10.1109/NNSP.1996.548335

DO - 10.1109/NNSP.1996.548335

M3 - Article in proceedings

SN - 07-80-33550-3

SP - 52

EP - 61

BT - Proceedings of the IEEE Signal Processing Society Workshop Neural Networks for Signal Processing

PB - IEEE

T2 - 1996 IEEE Workshop on Neural Networks for Signal Processing VI

Y2 - 4 September 1996 through 6 September 1996

ER -

On the use of a pruning prior for neural networks

Abstract

Workshop

Bibliographical note

Access to Document

OpenUrl availability

Fingerprint

Cite this