Google Git
Sign in
opensecura / 3p / openxla / iree / 9bf6fb1bcd6d5bc0d61c0a736e2555ad2745207b
commit9bf6fb1bcd6d5bc0d61c0a736e2555ad2745207b[log] [tgz]
authorOkwan Kwon <okwan@google.com>Mon May 15 19:32:07 2023 -0700
committerGitHub <noreply@github.com>Mon May 15 19:32:07 2023 -0700
tree5bb78ec1fc7daba154ae748aedf2c52cd7aae383
parent747b309fd7b353bc8c6f14e8c773cf15d83c2f74 [diff]
Support `num_replicas` and `num_partitions` (#13288)

Support `num_replicas` and `num_partitions` through cross_replica and
cross_partition for all_reduce, all_gather, and reduce_scatter,
replica_id, and partition_id.

Based on the channel ID and use_global_device_ids, the communication
mode can be different in the 2D grid.

See
https://github.com/openxla/stablehlo/blob/main/docs/spec.md#collective-ops
for more information.

Note that stablehlo still uses `mhlo.num_replicas` and
`mhlo.num_partitions` to embed the info in the module.
4 files changed
tree: 5bb78ec1fc7daba154ae748aedf2c52cd7aae383
  1. .devcontainer/
  2. .github/
  3. benchmarks/
  4. build_tools/
  5. compiler/
  6. docs/
  7. experimental/
  8. integrations/
  9. lib/
  10. llvm-external-projects/
  11. runtime/
  12. samples/
  13. tests/
  14. third_party/
  15. tools/
  16. .bazel_to_cmake.cfg.py
  17. .bazelignore
  18. .bazelrc
  19. .bazelversion
  20. .clang-format
  21. .dockerignore
  22. .gitignore
  23. .gitmodules
  24. .pylintrc
  25. .style.yapf
  26. .yamllint.yml
  27. AUTHORS
  28. BUILD.bazel
  29. CITATION.cff
  30. CMakeLists.txt
  31. configure_bazel.py
  32. CONTRIBUTING.md
  33. LICENSE
  34. README.md
  35. WORKSPACE
README.md

IREE: Intermediate Representation Execution Environment

IREE (Intermediate Representation Execution Environment, pronounced as “eerie”) is an MLIR-based end-to-end compiler and runtime that lowers Machine Learning (ML) models to a unified IR that scales up to meet the needs of the datacenter and down to satisfy the constraints and special considerations of mobile and edge deployments.

See our website for project details, user guides, and instructions on building from source.

CI Status

Project Status

IREE is still in its early phase. We have settled down on the overarching infrastructure and are actively improving various software components as well as project logistics. It is still quite far from ready for everyday use and is made available without any support at the moment. With that said, we welcome any kind of feedback on any communication channels!

Communication Channels

Related Project Channels

  • MLIR topic within LLVM Discourse: IREE is enabled by and heavily relies on MLIR. IREE sometimes is referred to in certain MLIR discussions. Useful if you are also interested in MLIR evolution.

Architecture Overview

IREE Architecture IREE Architecture

See our website for more information.

Presentations and Talks

  • 2021-06-09: IREE Runtime Design Tech Talk (recording and slides)
  • 2020-08-20: IREE CodeGen: MLIR Open Design Meeting Presentation (recording and slides)
  • 2020-03-18: Interactive HAL IR Walkthrough (recording)
  • 2020-01-31: End-to-end MLIR Workflow in IREE: MLIR Open Design Meeting Presentation (recording and slides)

License

IREE is licensed under the terms of the Apache 2.0 License with LLVM Exceptions. See LICENSE for more information.