build_tools/python/benchmark_suites/iree/README.md

# IREE Benchmark Suites Configurations

This directory contains the Python scripts that define the benchmark
configrations. To run the benchmark suites, see
[IREE Benchmark Suites](/docs/developers/developing_iree/benchmark_suites.md).

## Updating Benchmarks

1.  Modify the Python scripts of benchmark generators under
    [build_tools/python/benchmark_suites/iree](/build_tools/python/benchmark_suites/iree).
2.  Follow
    [tests/e2e/test_artifacts](https://github.com/openxla/iree/tree/main/tests/e2e/test_artifacts)
    to regenerate the cmake files that will build the benchmarks.

To add a new source model, see
[Adding a new model](/build_tools/python/e2e_test_framework/models/README.md#adding-a-new-model)

## Updating TF/TFLite Importer in Benchmark CI

For TF and TFLite source models, benchmark CI installs `iree-import-tf/tflite`
from
[integrations/tensorflow/python_projects](/integrations/tensorflow/python_projects)
to import models. See
[Updating Tensorflow Importers in CI](/integrations/tensorflow/README.md#updating-tensorflow-importers-in-ci)
to learn about the update procedure.

## Benchmark Suites Design

> TODO(#12215): Explain the design and the end-to-end flow.