IREE Benchmark Suites Configurations

This directory contains the Python scripts that define the benchmark configrations. To run the benchmark suites, see IREE Benchmark Suites.

Updating Benchmarks

1. Modify the Python scripts of benchmark generators under build_tools/python/benchmark_suites/iree.
2. Follow tests/e2e/test_artifacts to regenerate the cmake files that will build the benchmarks.

To add a new source model, see Adding a new model

Updating TF/TFLite Importer in Benchmark CI

For TF and TFLite source models, benchmark CI installs iree-import-tf/tflite from integrations/tensorflow/python_projects to import models. See Updating Tensorflow Importers in CI to learn about the update procedure.

Benchmark Suites Design

TODO(#12215): Explain the design and the end-to-end flow.