Add checksum regression tests (#1065)

* add a checksum module for regtests

* All capabilities to checksum tests

* update tests to generate a clean benchmark

* call checksum tests from analysis scripts

* Add checksum json benchmarks

* add missing script, better printing and increase tol

* eol

* fix permission, and bump tolerance

* chmod +x checksumAPI.py

* update benchmarks, probably old ones were wrong due to parallelization

* remove unused variable, thanks lgtm

* special handling when the benchmark is 0

* non-zero but very small CFL for 1 step for init tests

* reset erroneous Python benchmarks

* slightly bump tolerance for initial distribution test

* too small dr results in nans

* improve prints, tolerance handling, and fix tests

* typo

* enable tolerance and fields/particles optional comparison to fix tests

* more minor cleaning in space charge initialization tests

* update Python benchmarks for serial runs

* Run Python tests with 1 rank instead of 2

* fields that are zero should not be in reg tests

* Add developer documentation on checksum regression tests

Co-authored-by: Tools <warpx@lbl.gov>

1 files changed, 14 insertions, 0 deletions

diff --git a/Examples/analysis_default_regression.py b/Examples/analysis_default_regression.py
new file mode 100755
index 000000000..b40bb6675
--- /dev/null
+++ b/Examples/analysis_default_regression.py
@@ -0,0 +1,14 @@
+#! /usr/bin/env python
+
+import sys
+sys.path.insert(1, '../../../../warpx/Regression/Checksum/')
+import checksumAPI
+
+# this will be the name of the plot file
+fn = sys.argv[1]
+
+# Get name of the test
+test_name = fn[:-9] # Could also be os.path.split(os.getcwd())[1]
+
+# Run checksum regression test
+checksumAPI.evaluate_checksum(test_name, fn)