tree ee5f1ddefed62072f1b24e2f4820892396f3d23e
parent a2ea8b9c0e931fa09e460eb85b02e5e7e4908080
author Scott Todd <scott.todd0@gmail.com> 1708025967 -0800
committer GitHub <noreply@github.com> 1708025967 -0800
gpgsig -----BEGIN PGP SIGNATURE-----
 
 wsFcBAABCAAQBQJlzmhvCRC1aQ7uu5UhlAAAL1oQAD8h4YbTnvp81IvqSrR3SGjc
 7WwOZ8mcEAA1EblAEKKOUUArABLlQf3vfPUh10js9wcF4pGJnNKjXgP+yXRGziGr
 B2zLpNBRyeDQosG8zEar9W3qOD4tBt9y4mekpLhch1LROXL/4P808CeGx1PVJFaV
 sM9hGIV+Fb8b0gZP3MR9ySwbBd0d0i97e/hAUflMOJ8evuF0z6pvc5KYOGEEat+8
 8QsHAjobKWkIlku89meiEVJYuKQU/x7Om4Mn0AL4VQqhZvFsFKGy44ybfc6V+1GD
 zXRY5ekOMq/x4xYL6sQBy8x4+BK5EW+YbhQ4YdWs9zD7ObeTY8g7dl9pMN4mxEgc
 bsmOA5Xa1/HbENTJ1dIg/NqHmMK0fDQ2DYh1iD0Zv3ZKyKDfPPI7QvF4Xz+Khco7
 uGuPIyF5TW9l8Y1aVBvmg22V/9cGy68J38izBdWYXTpWmD7KtJ1vp7Gov2cnZoTG
 NsM8nQ66ZshWcrMXFWEOGz4kB1Th6J0TFMX7udaO02OODv9retUmAK6/kShwqjRG
 t2qMRA1nGGHOBEjLqE6o4qGNTKNa919tqvLEyMuGZ0JMgRdpBHK+9/QJ52ybWKsP
 Ck6dL5AnNKTRuP3ltO3D0zHslUGTNrBrnvjmAOP99f+eUgmGU+pNrKzPwGsSth7Z
 R0jAV1I70wzgGkyaP3DJ
 =qFo7
 -----END PGP SIGNATURE-----
 

Quality of life improvements for experimental/regression_suite. (#16415)

* Capture output in test fixtures.
* If compilation or execution fails, this will dump stdout/stderr from
`iree-compile` or `iree-run-module` to the logs.
  * The formatting isn't pretty,  but the output may help with triage.
* Include full (short) summary reports at the end of pytest output.
* I find it very useful to see which tests ran - both passing and
failing. The default only shows failures.
* Docs:
https://docs.pytest.org/en/stable/how-to/output.html#producing-a-detailed-summary-report

Progress on https://github.com/openxla/iree/issues/16372 (tidying up
`regression_suite` while I evaluating extending it)

ci-exactly: build_packages, regression_test_cpu,
regression_test_amdgpu_rocm, regression_test_amdgpu_vulkan