Abstract

We present OptimSolution, an open-source, cross-platform framework for the systematic benchmarking and analysis of continuous optimisation methods, available for Windows, Linux and macOS and operable via both a command-line interface (CLI) and a Qt-based Graphical User Interface (GUI). The framework supports four execution modes: Single mode for single method–problem runs with convergence and distribution analysis; Batch mode for automated multi-method, multi-problem experimentation with aggregated statistical summaries; Method Sensitivity Analysis for quantifying the effect of algorithmic hyperparameters on solution quality; and Problem Sensitivity Analysis for assessing how problem-defining parameters influence instance difficulty and inter-method rankings. Complexity analysis is provided along two-axes method scalability across problem dimensionalities and problem difficulty profiles across method portfolios. Statistical validation is embedded natively through Wilcoxon signed-rank and Friedman tests with post-hoc pairwise analysis, complemented by rank tables and box-plot visualisations. All outputs are exportable as CSV files or publication-ready PNG figures. The framework is designed for extensibility: new methods and benchmark problems can be registered and activated through the GUI without modifications to the core codebase, supporting rapid experimental iteration.

IPC Classification

Keywords