Torch Models Test Suite

Directory Structure

torch_models/ ├── model1/ │ ├── modules/ │ │ ├── module1.json │ │ ├── module2.json │ │ └── ... │ ├── test1.json │ ├── test2.json │ └── ... ├── model2/ │ ├── modules/ │ │ ├── module1.json │ │ ├── module2.json │ │ └── ... │ ├── test1.json │ ├── test2.json │ └── ...

Markers

We try to add markers to every test. The CI collects tests for a machine based on these markers.

• Add a marker for the model class. For example “sdxl”.
• Add a marker for the compilation backend for the test. For example “llvm-cpu”, “hip”, “spirv”.
• Add a compilation target specific marker if the test is sku independent. For example: “gfx942”, “gfx1201”, “sm80”. This is generally try for quality and compstat tests, unless using sku specific tuning specs.
• Add a sku specific marker if the test is sku specific. For example: “mi325”, “w7900”, “rtx4090”. This is generally true for all benchmarking tests and when using sku specific tuner files.

Misc

Information on accepted test schema: https://github.com/iree-org/iree-test-suites/blob/main/torch_models/README.md