Publication:
A mixed-integer linear programming based training and feature selection method for artificial neural networks using piece-wise linear approximations

Thumbnail Image

School / College / Institute

Organizational Unit

Program

KU-Authors

KU Authors

Co-Authors

Şıldır, Hasan

Publication Date

Language

Embargo Status

NO

Journal Title

Journal ISSN

Volume Title

Alternative Title

Abstract

Artificial Neural Networks (ANNs) may suffer from suboptimal training and test performance related issues not only because of the presence of high number of features with low statistical contributions but also due to their non-convex nature. This study develops piecewise-linear formulations for the efficient approximation of the non-convex activation and objective functions in artificial neural networks for optimal, global and simultaneous training and feature selection in regression problems. Such formulations include binary variables to account for the existence of the features and piecewise-linear approximations, which in turn, after one exact linearization step, calls for solving a mixed-integer linear programming problem with a global optimum guarantee because of convexity. Suggested formulation is implemented on two industrial case studies. Results show that efficient approximations are obtained through the usage of the method with only a few number of breakpoints. Significant feature space reduction is observed bringing about notable improvement in test accuracy.

Source

Publisher

Elsevier

Subject

Mixed integer nonlinear programming, Global optimization, Relaxation

Citation

Has Part

Source

Chemical Engineering Science (CES)

Book Series Title

Edition

DOI

10.1016/j.ces.2021.117273

item.page.datauri

Link

Rights

Copyrights Note

Endorsement

Review

Supplemented By

Referenced By

0

Views

3

Downloads

View PlumX Details