Levenberg Marquardt algorithm for the training of type-2 fuzzy neuro systems with a novel type-2 fuzzy membership function

Mojtaba Ahmadieh Khanesar; Erdal Kayacan; Mohammad Teshnehlab; Okyay Kaynak

doi:10.1109/T2FUZZ.2011.5949558

Levenberg Marquardt algorithm for the training of type-2 fuzzy neuro systems with a novel type-2 fuzzy membership function

Mojtaba Ahmadieh Khanesar^*, Erdal Kayacan, Mohammad Teshnehlab, Okyay Kaynak

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Abstract

A new training approach based on the Levenberg-Marquardt algorithm is proposed for type-2 fuzzy neural networks. While conventional gradient descent algorithms use only the first order derivative, the proposed algorithm used in this paper benefits from the first and the second order derivatives which makes the training procedure faster. Besides, this approach is more robust than the other techniques that use the second order derivatives, e.g. Gauss-Newton's method. The training algorithm proposed is tested on the training of a type-2 fuzzy neural network used for the prediction of a chaotic Mackey-Glass time series. The results show that the learning algorithm proposed not only results in faster training but also in a better forecasting accuracy.

Original language	English
Title of host publication	IEEE SSCI 2011 : Symposium Series on Computational Intelligence - T2FUZZ 2011: 2011 IEEE Symposium on Advances in Type-2 Fuzzy Logic Systems
Number of pages	6
Publication date	2011
Pages	88-93
Article number	5949558
ISBN (Print)	9781612840789
DOIs	https://doi.org/10.1109/T2FUZZ.2011.5949558
Publication status	Published - 2011
Externally published	Yes
Event	2011 IEEE Symposium Series on Computational Intelligence - Paris, France Duration: 11 Apr 2011 → 15 Apr 2011

Conference

Conference	2011 IEEE Symposium Series on Computational Intelligence
Country/Territory	France
City	Paris
Period	11/04/2011 → 15/04/2011
Sponsor	IEEE

Keywords

Levenberg-Marquardt algorithm
Mackey-Glass time series
Type-2 fuzzy neural networks

Access to Document

10.1109/T2FUZZ.2011.5949558

OpenUrl availability

Full text

Cite this

Khanesar, M. A., Kayacan, E., Teshnehlab, M., & Kaynak, O. (2011). Levenberg Marquardt algorithm for the training of type-2 fuzzy neuro systems with a novel type-2 fuzzy membership function. In IEEE SSCI 2011: Symposium Series on Computational Intelligence - T2FUZZ 2011: 2011 IEEE Symposium on Advances in Type-2 Fuzzy Logic Systems (pp. 88-93). Article 5949558 https://doi.org/10.1109/T2FUZZ.2011.5949558

@inproceedings{c7bc3ed9620f4393a12a461b87fcd723,

title = "Levenberg Marquardt algorithm for the training of type-2 fuzzy neuro systems with a novel type-2 fuzzy membership function",

abstract = "A new training approach based on the Levenberg-Marquardt algorithm is proposed for type-2 fuzzy neural networks. While conventional gradient descent algorithms use only the first order derivative, the proposed algorithm used in this paper benefits from the first and the second order derivatives which makes the training procedure faster. Besides, this approach is more robust than the other techniques that use the second order derivatives, e.g. Gauss-Newton's method. The training algorithm proposed is tested on the training of a type-2 fuzzy neural network used for the prediction of a chaotic Mackey-Glass time series. The results show that the learning algorithm proposed not only results in faster training but also in a better forecasting accuracy.",

keywords = "Levenberg-Marquardt algorithm, Mackey-Glass time series, Type-2 fuzzy neural networks",

author = "Khanesar, {Mojtaba Ahmadieh} and Erdal Kayacan and Mohammad Teshnehlab and Okyay Kaynak",

year = "2011",

doi = "10.1109/T2FUZZ.2011.5949558",

language = "English",

isbn = "9781612840789",

pages = "88--93",

booktitle = "IEEE SSCI 2011",

note = "2011 IEEE Symposium Series on Computational Intelligence, SSCI 2011 ; Conference date: 11-04-2011 Through 15-04-2011",

}

Khanesar, MA, Kayacan, E, Teshnehlab, M & Kaynak, O 2011, Levenberg Marquardt algorithm for the training of type-2 fuzzy neuro systems with a novel type-2 fuzzy membership function. in IEEE SSCI 2011: Symposium Series on Computational Intelligence - T2FUZZ 2011: 2011 IEEE Symposium on Advances in Type-2 Fuzzy Logic Systems., 5949558, pp. 88-93, 2011 IEEE Symposium Series on Computational Intelligence, Paris, France, 11/04/2011. https://doi.org/10.1109/T2FUZZ.2011.5949558

Levenberg Marquardt algorithm for the training of type-2 fuzzy neuro systems with a novel type-2 fuzzy membership function. / Khanesar, Mojtaba Ahmadieh; Kayacan, Erdal; Teshnehlab, Mohammad et al.
IEEE SSCI 2011: Symposium Series on Computational Intelligence - T2FUZZ 2011: 2011 IEEE Symposium on Advances in Type-2 Fuzzy Logic Systems. 2011. p. 88-93 5949558.

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

TY - GEN

T1 - Levenberg Marquardt algorithm for the training of type-2 fuzzy neuro systems with a novel type-2 fuzzy membership function

AU - Khanesar, Mojtaba Ahmadieh

AU - Kayacan, Erdal

AU - Teshnehlab, Mohammad

AU - Kaynak, Okyay

PY - 2011

Y1 - 2011

N2 - A new training approach based on the Levenberg-Marquardt algorithm is proposed for type-2 fuzzy neural networks. While conventional gradient descent algorithms use only the first order derivative, the proposed algorithm used in this paper benefits from the first and the second order derivatives which makes the training procedure faster. Besides, this approach is more robust than the other techniques that use the second order derivatives, e.g. Gauss-Newton's method. The training algorithm proposed is tested on the training of a type-2 fuzzy neural network used for the prediction of a chaotic Mackey-Glass time series. The results show that the learning algorithm proposed not only results in faster training but also in a better forecasting accuracy.

AB - A new training approach based on the Levenberg-Marquardt algorithm is proposed for type-2 fuzzy neural networks. While conventional gradient descent algorithms use only the first order derivative, the proposed algorithm used in this paper benefits from the first and the second order derivatives which makes the training procedure faster. Besides, this approach is more robust than the other techniques that use the second order derivatives, e.g. Gauss-Newton's method. The training algorithm proposed is tested on the training of a type-2 fuzzy neural network used for the prediction of a chaotic Mackey-Glass time series. The results show that the learning algorithm proposed not only results in faster training but also in a better forecasting accuracy.

KW - Levenberg-Marquardt algorithm

KW - Mackey-Glass time series

KW - Type-2 fuzzy neural networks

UR - http://www.scopus.com/inward/record.url?scp=79961231485&partnerID=8YFLogxK

U2 - 10.1109/T2FUZZ.2011.5949558

DO - 10.1109/T2FUZZ.2011.5949558

M3 - Article in proceedings

AN - SCOPUS:79961231485

SN - 9781612840789

SP - 88

EP - 93

BT - IEEE SSCI 2011

T2 - 2011 IEEE Symposium Series on Computational Intelligence

Y2 - 11 April 2011 through 15 April 2011

ER -

Khanesar MA, Kayacan E, Teshnehlab M, Kaynak O. Levenberg Marquardt algorithm for the training of type-2 fuzzy neuro systems with a novel type-2 fuzzy membership function. In IEEE SSCI 2011: Symposium Series on Computational Intelligence - T2FUZZ 2011: 2011 IEEE Symposium on Advances in Type-2 Fuzzy Logic Systems. 2011. p. 88-93. 5949558 doi: 10.1109/T2FUZZ.2011.5949558

Levenberg Marquardt algorithm for the training of type-2 fuzzy neuro systems with a novel type-2 fuzzy membership function

Abstract

Conference

Keywords

Access to Document

OpenUrl availability

Other files and links

Fingerprint

Cite this