TY - GEN

T1 - Modified ANFIS with Less Model Complexity for Classification Problems

AU - Talpur, Noreen

AU - Salleh, Mohd Najib Mohd

AU - Hussain, Kashif

AU - Ali, Haseeb

PY - 2018/10/18

Y1 - 2018/10/18

N2 - A machine learning technique develops the best-fit model by adjusting weights based on learning from data. Similarly, adaptive neuro-fuzzy inference system (ANFIS) is also one of the commonly used machine learning techniques which employs training algorithm to adjust its parameters to approximate the problem under consideration. Even though, ANFIS is used in wide variety of applications including rule-based control systems, classification, and pattern matching, but ANFIS has drawback of computational complexity as it carries the problem of curse of dimensionality. This limits ANFIS to be used only with the applications having less number of inputs. Additionally, the gradient-based learning algorithm suffers from the problem of trapping in local minima. To address these drawbacks, this study reduces ANFIS architecture from five to four layers, in order to reduce model complexity. Moreover, to avoid the local minima problem in typical hybrid learning algorithm, the popular swarm-based metaheuristic algorithm Artificial Bee Colony (ABC) is used to solve the benchmark classification problems with varying input-size. The overall comparison of results and experiments show that the modified ANFIS model performed equally better as compared to standard ANFIS, but with significantly reduced trainable parameters and training computation cost. The modified ANFIS reduced the model complexity up to 93% on classification problems with large input-size.

AB - A machine learning technique develops the best-fit model by adjusting weights based on learning from data. Similarly, adaptive neuro-fuzzy inference system (ANFIS) is also one of the commonly used machine learning techniques which employs training algorithm to adjust its parameters to approximate the problem under consideration. Even though, ANFIS is used in wide variety of applications including rule-based control systems, classification, and pattern matching, but ANFIS has drawback of computational complexity as it carries the problem of curse of dimensionality. This limits ANFIS to be used only with the applications having less number of inputs. Additionally, the gradient-based learning algorithm suffers from the problem of trapping in local minima. To address these drawbacks, this study reduces ANFIS architecture from five to four layers, in order to reduce model complexity. Moreover, to avoid the local minima problem in typical hybrid learning algorithm, the popular swarm-based metaheuristic algorithm Artificial Bee Colony (ABC) is used to solve the benchmark classification problems with varying input-size. The overall comparison of results and experiments show that the modified ANFIS model performed equally better as compared to standard ANFIS, but with significantly reduced trainable parameters and training computation cost. The modified ANFIS reduced the model complexity up to 93% on classification problems with large input-size.

U2 - 10.1007/978-3-030-03302-6_4

DO - 10.1007/978-3-030-03302-6_4

M3 - Conference contribution

SN - 978-3-030-03301-9

T3 - Advances in Intelligent Systems and Computing

SP - 36

EP - 47

BT - Computational Intelligence in Information Systems

A2 - Omar, Saiful

A2 - Suhaili, Wida Susanty Haji

A2 - Phon-Amnuaisuk, Somnuk

PB - Springer

ER -