Project

General

Profile

Cleanup #1872

Move performance tests and benchmarks from "make test" to a new "make benchmark"

Added by Evan Ramos about 1 month ago. Updated about 1 month ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
Build & Test Automation
Target version:
-
Start date:
04/17/2018
Due date:
% Done:

0%


Description

A non-trivial portion of "make test" jobs is spent on performance testing. These tests should be moved to a separate "make benchmark" so that automated unit and integration testing can complete more quickly.

History

#1 Updated by Sam White about 1 month ago

And at least some of the results of "make benchmark" should be plotted online somewhere every night based on some of the autobuilds whose performance we care about tracking. It would be useful for diagnosing performance regressions. We already do this for netlrts charm++ pingpong on the PPL wiki page.

I would want example/ampi/pingpong and tests/charm++/pingpong at a minimum. Potentially some reduction/broadcast tests, Converse/LRTS tests, and maybe some example programs to all have that.

This could be a good Charmworks intern task.

Also available in: Atom PDF