Community GPU codes - Task 036
Fit to programme
This task has been identified by the working groups as part of the agenda behind WP 1.1.
The task number is 036.
Description
The UK is home to several high-end capability compute codes. In an ideal world, all the biggest showcase codes would provide benchmarks that allow an independent team to assess the code’s performance. On the long term, we’d expect teams to submit these benchmarks to SHAREing which provides them with independent feedback, and it also allows SHAREing to build up a repository of codes to play around.
Initially, SHAREing will struggle to separate the role of the benchmark provider and author from the assessor. That is, SHAREing will rely on the community to prepare benchmarks, and to apply SHAREing’s performance analysis methodologies to their codes themselves.
Approach and Methodology
Prepare a benchmark from a particular application code and apply SHAREing’s performance assessment step by step as published to the benchmark. Publish the outcome on SHAREing’s webpage. A core component of the assessment is getting the code setup on a specific system such that the code is performant, so the assessment should also include a review of the system including hardware details and steps needed to configure the working environment.
Outputs and deliverables
Ready-to-use benchmark by the bidding community for third parties. Report on performance findings in line with SHAREing methodology. A review of the the system that the assessment is performed on, including details on the hardware and working environment configuration. This can be difficult for some codes as the configuration of the working environment can impact software performance.