Less is more approach in optimization: a road to artificial intelligence

Abstract

The main idea of Less is more approach (LIMA) is using as fewer as possible ingredients to provide the best possible outcome. This approach has been used successfully almost in all the scientific and art disciplines. Recently, the idea has also been successfully explored in solving hard optimization problems. In this note we first define the dominance relation between two algorithms that includes their simplicity as well. Then we propose the general LIMA algorithm and discuss automatic ways to include common ingredients of all search algorithms, increasing the algorithms complexity in a systematic way. That kind of approach may represent a road from Optimization to Artificial Intelligence and Machine learning. Finally, we illustrate LIMA algorithm on two optimization problems and show its efficiency.