Methods of inference and learning for performance modeling of parallel applications


Benjamin Lee, David Brooks, Bronis Supinski, Martin Schulz, Karan Singh, and Sally McKee. 3/2007. “Methods of inference and learning for performance modeling of parallel applications.” In Proceedings of the 12th ACM SIGPLAN symposium on Principles and practice of parallel programming, Pp. 249–258. ACM. Publisher's Version


Increasing system and algorithmic complexity combined with a growing number of tunable application parameters pose significant challenges for analytical performance modeling. We propose a series of robust techniques to address these challenges. In particular, we apply statistical techniques such as clustering, association, and correlation analysis, to understand the application parameter space better. We construct and compare two classes of effective predictive models: piecewise polynomial regression and artifical neural networks. We compare these techniques with theoretical analyses and experimental results. Overall, both regression and neural networks are accurate with median error rates ranging from 2.2 to 10.5 percent. The comparable accuracy of these models suggest differentiating features will arise from ease of use, transparency, and computational efficiency.

Last updated on 05/02/2022