Google Git
Sign in
opensecura / 3p / openxla / iree / 5ba8a7a1465ef61ffc3bb08232659322162e5a8b
commit5ba8a7a1465ef61ffc3bb08232659322162e5a8b[log] [tgz]
authorStella Laurenzo <stellaraccident@gmail.com>Tue May 11 21:29:23 2021 -0700
committerGitHub <noreply@github.com>Tue May 11 21:29:23 2021 -0700
tree83c09ab3c101d0825fc8d4ffe05b0f40a54772ff
parent4d1a317b1cd5a13c780bde9d224822f4d3769954 [diff]
Finish implementing native ABI support. (#5844)

* Does not yet flip it on.
* Adds a pass and a commented out usage to generate ABI metadata for MHLO, allowing JAX tests to pass.
  * I was just going to let this go down the untyped path, but it turns out people have been relying on implicit casting between scalar -> 0d tensor, so I just did it right.
* Switches TF returns to emit tuples instead of lists.
* Passes pytree_test.py, mobile bert (uses old kwarg style TF arg passing), and JAX tests.
* Once landed, I will start a branch to flip everything for real, and there will likely be additional triage.
14 files changed
tree: 83c09ab3c101d0825fc8d4ffe05b0f40a54772ff
  1. .github/
  2. bindings/
  3. build_tools/
  4. colab/
  5. docs/
  6. experimental/
  7. integrations/
  8. iree/
  9. scripts/
  10. third_party/
  11. .bazelignore
  12. .bazelrc
  13. .bazelversion
  14. .clang-format
  15. .gitignore
  16. .gitmodules
  17. .style.yapf
  18. .yamllint.yml
  19. BUILD.bazel
  20. CMakeLists.txt
  21. configure_bazel.py
  22. CONTRIBUTING.md
  23. LICENSE
  24. README.md
  25. SUBMODULE_VERSIONS.txt
  26. WORKSPACE
README.md

IREE: Intermediate Representation Execution Environment

IREE (Intermediate Representation Execution Environment, pronounced as “eerie”) is an MLIR-based end-to-end compiler that lowers Machine Learning (ML) models to a unified IR optimized for real-time inference on mobile/edge devices against heterogeneous hardware accelerators. IREE also provides flexible deployment solutions for its compiled ML models.

See our website for project details, user guides, and instructions on building from source.

Project Status

IREE is still in its early phase. We have settled down on the overarching infrastructure and are actively improving various software components as well as project logistics. It is still quite far from ready for everyday use and is made available without any support at the moment. With that said, we welcome any kind of feedback on any communication channels!

Communication Channels

Related Project Channels

  • MLIR topic within LLVM Discourse: IREE is enabled by and heavily relies on MLIR. IREE sometimes is referred to in certain MLIR discussions. Useful if you are also interested in MLIR evolution.

Build Status

CI SystemBuild SystemPlatformArchitectureComponentStatus
KokoroBazelLinuxx86Corekokoro_status_bazel_linux_x86_core
KokoroCMake & BazelLinuxx86-swiftshaderIntegrationskokoro_status_cmake-bazel_linux_x86-swiftshader_integrations
KokoroCMake & BazelLinuxx86-turingIntegrationskokoro_status_cmake-bazel_linux_x86-turing_integrations
KokoroCMakeLinuxx86-swiftshaderCore + Bindingskokoro_status_cmake_linux_x86-swiftshader
KokoroCMakeLinuxx86-swiftshader-asanCore + Bindingskokoro_status_cmake_linux_x86-swiftshader-asan
KokoroCMakeLinuxx86-turingCore + Bindingskokoro_status_cmake_linux_x86-turing
KokoroCMakeAndroidarm64-v8aRuntime (build only)kokoro_status_cmake_android_arm64-v8a
BuildKiteCMakeAndroidarm64-v8aRuntimebuildkite-status-cmake-android-arm

Presentations and Talks

  • 2020-08-20: IREE CodeGen: MLIR Open Design Meeting Presentation (recording and slides)
  • 2020-03-18: Interactive HAL IR Walkthrough (recording)
  • 2020-01-31: End-to-end MLIR Workflow in IREE: MLIR Open Design Meeting Presentation (recording and slides)

License

IREE is licensed under the terms of the Apache license. See LICENSE for more information.