Step 4/n: Integrate TensorFlow compiler build and tests into CMake.
* New option: 'IREE_BUILD_TENSORFLOW_COMPILER'
* Adds some cmake hackery to find and configure bazel, scoping it under the build directory.
* Adds an iree_add_bazel_invocation() function that executes bazel and creates cmake targets for some built executables.
* Adds the cmake target 'integrations_iree_tensorflow_importers' as a bazel invocation.
* Wires up the build for pyiree.tools.tf to link the binary from the bazel side. The result is a built bindings/python directory that can be used for tests and such with no further build required (or deployed directly).
* Once I'm done with this transition, we can completely remove all of the python building from bazel, likely just replacing tests with a shell script runner, since they can just run standalone.
* Also had to fix some issues with the python config (it wasn't detecting virtual envs properly due to using the old FindPython vars).
* Added yet another hack to run_lit.sh because with bazel's out directory living in the build directory, it was taking 2m+ to scan files for things to add to the path. We shouldn't have been doing that, but also... Bazel, WTF?
* Note that old build/tests of the integrations directory were double building almost everything because Bazel was differentiating between objects bound for binaries and for shared libraries. In addition, since it included the complete IREE compiler, it was building all of LLVM.
* In the new world, we only build one static binary, and since it is just the frontend, the amount of things it needs to compile from LLVM are minimal. Most of the time is in compiling eigen kernels.
* This will probably take some tweaking before it is ready for prime time.
Stats:
Clean build:
configure: ~1m
ninja build: ~10m (includes TF)
ctest -E 'vulkan|benchmark': 14s (includes new TF tests but not the whole e2e directory yet)
On a rebuild with CCache and Bazel's disk cache enabled from the above, a rebuild of everything took 18s.
diff --git a/build_tools/cmake/iree_macros.cmake b/build_tools/cmake/iree_macros.cmake
index 04466b5..8f4e5d2 100644
--- a/build_tools/cmake/iree_macros.cmake
+++ b/build_tools/cmake/iree_macros.cmake
@@ -265,6 +265,49 @@
endfunction()
#-------------------------------------------------------------------------------
+# Tool symlinks
+#-------------------------------------------------------------------------------
+
+# iree_symlink_tool
+#
+# Adds a command to TARGET which symlinks a tool from elsewhere
+# (FROM_TOOL_TARGET_NAME) to a local file name (TO_EXE_NAME) in the current
+# binary directory.
+#
+# Parameters:
+# TARGET: Local target to which to add the symlink command (i.e. an
+# iree_py_library, etc).
+# FROM_TOOL_TARGET: Target of the tool executable that is the source of the
+# link.
+# TO_EXE_NAME: The executable name to output in the current binary dir.
+function(iree_symlink_tool)
+ cmake_parse_arguments(
+ ARG
+ ""
+ "TARGET;FROM_TOOL_TARGET;TO_EXE_NAME"
+ ""
+ ${ARGN}
+ )
+
+ # Transform TARGET
+ iree_package_ns(_PACKAGE_NS)
+ iree_package_name(_PACKAGE_NAME)
+ set(_TARGET "${_PACKAGE_NAME}_${ARG_TARGET}")
+ set(_FROM_TOOL_TARGET ${ARG_FROM_TOOL_TARGET})
+
+ add_custom_command(
+ TARGET "${_TARGET}"
+ BYPRODUCTS
+ "${CMAKE_CURRENT_BINARY_DIR}/${ARG_TO_EXE_NAME}${CMAKE_EXECUTABLE_SUFFIX}"
+ COMMAND
+ ${CMAKE_COMMAND} -E create_symlink
+ "$<TARGET_FILE:${_FROM_TOOL_TARGET}>"
+ "${CMAKE_CURRENT_BINARY_DIR}/${ARG_TO_EXE_NAME}${CMAKE_EXECUTABLE_SUFFIX}"
+ )
+endfunction()
+
+
+#-------------------------------------------------------------------------------
# Tests
#-------------------------------------------------------------------------------
