Google Git
Sign in
opensecura / sw / vec_iree / 60e84bf5f1c1213dd264d91891fe737cb72c1dc8
commit60e84bf5f1c1213dd264d91891fe737cb72c1dc8[log] [tgz]
authorLun Dong <lundong@google.com>Wed Jul 26 18:40:21 2023 -0700
committerLun Dong <lundong@google.com>Thu Jul 27 11:07:18 2023 -0700
tree93134eedae8ed1d4a49187bc98ca66ee4360bd0f
parentf68ee4f8217d39f998a411b39c239a4fc3dd6ccb [diff]
sw/vec_iree: Add GCC compilation options in sparrow_ops.cmake

Add GCC compilation options at sparrow_ops.cmake, which is needed for
compiling targets in vec_iree and ml_models.

We still need C_NO_WARNING_FLAGS at riscv_iree_gcc.cmake for now, which
controls compilation of IREE. In future we may propose PR to move these flags to IREE code base.

Change-Id: I966a99a7525616bbf6d06d7e538d57f2d57350c8
2 files changed
tree: 93134eedae8ed1d4a49187bc98ca66ee4360bd0f
  1. audio_prep/
  2. build_tools/
  3. cmake/
  4. device/
  5. model_util/
  6. native_log/
  7. risp4ml/
  8. samples/
  9. ssd_postprocess/
  10. vmvx_ukernel/
  11. CMakeLists.txt
  12. README.md
  13. sparrow_config.h
README.md

Springbok Model Execution Repository

This project contains ML model codegen and execution libraries/examples. The artifacts built from this project is targeted for RISC-V 32-bit baremetal machine (Springbok).

Prerequisite

If you get this project from Project Shodan manifest, you are all set. If not, you need to have following projects as well to build the project successfully.

This project needs to be at <dir>/sw/vec_iree

Code structure

  • audio_prep: Audio preprocessing libarary
  • build_tools: Utility scripts for the project
  • cmake: CMake Macros for the project
  • device: Device HAL driver library
  • model_util: Runtime utility library for model execution
  • native_log: BSP support for the Linux userspace emulation
  • risp4ml: Vision preprocessing library (Reduced ISP for ML)
  • samples: Codegen and execution of ML models based on IREE
    • simple_vec_mul: Point-wise vector multiplication examples
  • ssd_postprocess: Vision postprocessing library for Single-Shot Detectors (SSD)
  • vmvx_ukernel: Custom microkernel library for VMVX

Build the project

If you are running from Project Shodan repo, you can build the artifacts with m iree. If you download this project alone, you need to download/build IREE's host compiler, then at the top level directory

  cmake -B <output dir> -G Ninja \
     -DCMAKE_TOOLCHAIN_FILE="$(realpath sw/vec_iree/cmake/riscv_iree.cmake)" \
     -DCMAKE_BUILD_TYPE=MinSizeRel \
     -DIREE_HOST_BIN_DIR="$(IREE_COMPILER_DIR)/install/bin" \
     -DRISCV_TOOLCHAIN_ROOT=$(TOOLCHAINRV32_PATH) \
     <dir>/sw/vec_iree
  cmake --build <output dir> --target all

Run the executables

You can run QEMU or RENODE emulation with the built executables. In Shodan repo, qemu_sim_springbok for QEMU emulation, and sim_springbok for Renode simulation. Out-of-repo emulation is possible but require more steps.

Test the executables

In Shodan, this project utilizes LLVM lit and FileCheck to test the ML executable performance. The tests are defined in the *_test.run files under <output dir>. To run the test, at the Shodan top level directory

lit --path <Filecheck dir> -a <output dir>

Filecheck in Debian testing is under /usr/lib/llvm-11/bin

Add -D RUNNER=qemu to enable the qemu tests.