Google Git
Sign in
opensecura / sw / vec_iree / c4839b36b96d627acba585ff889c3901aa30b7bc
commitc4839b36b96d627acba585ff889c3901aa30b7bc[log] [tgz]
authorLun Dong <lundong@google.com>Thu Jul 28 17:02:09 2022 -0700
committerLun Dong <lundong@google.com>Fri Jul 29 15:20:44 2022 -0700
tree2d069a85c6b8cdd4e7aa51a128653e97365ebb2d
parent530ea6bbb3d5bec61379b14ad8b245add5a828e0 [diff]
Optimize dot product in audio MFCC pre-processing via RVV

Use RVV for the dot product operation in audio preprocessing. Yield ~30% of saving in term of # of instructions.

Results validated (within 1 code of difference due to quantization) and unit tests are passed.

Other optimization opportunies for audio preprocessing are not trivial nor straightforword, and will be put on hold due to priority shift.

Change-Id: Iea6f78bf488bacb8c617fbed0671dd607137e50f
4 files changed
tree: 2d069a85c6b8cdd4e7aa51a128653e97365ebb2d
  1. build_tools/
  2. cmake/
  3. native_log/
  4. samples/
  5. CMakeLists.txt
  6. README.md
  7. springbok_config.h
README.md

Springbok Model Execution Repository

This project contains ML model codegen and execution libraries/examples. The artifacts built from this project is targeted for RISC-V 32-bit baremetal machine (Springbok).

Prerequisite

If you get this project from Project Shodan manifest, you are all set. If not, you need to have following projects as well to build the project successfully.

This project needs to be at <dir>/sw/vec_iree

Code structure

  • build_tools: Utility scripts for the project
  • cmake: CMake Macros for the project
  • native_log: BSP support for the Linux userspace emulation
  • samples: Codegen and execution of ML models based on IREE
    • audio_prep: Audio preprocessing libarary
    • device: Device HAL driver library
    • risp4ml: Vision preprocessing library (Reduced ISP for ML)
    • simple_vec_mul: Point-wise vector multiplication examples
    • util: Runtime utility library for model execution

Build the project

If you are running from Project Shodan repo, you can build the artifacts with m iree. If you download this project alone, you need to download/build IREE's host compiler, then at the top level directory

  cmake -B <output dir> -G Ninja \
     -DCMAKE_TOOLCHAIN_FILE="$(realpath sw/vec_iree/cmake/riscv_iree.cmake)" \
     -DCMAKE_BUILD_TYPE=MinSizeRel \
     -DIREE_HOST_BINARY_ROOT="$(IREE_COMPILER_DIR)/install" \
     -DRISCV_TOOLCHAIN_ROOT=$(TOOLCHAINRV32_PATH) \
     <dir>/sw/vec_iree
  cmake --build <output dir> --target all

Run the executables

You can run QEMU or RENODE emulation with the built executables. In Shodan repo, qemu_sim_springbok for QEMU emulation, and sim_springbok for Renode simulation. Out-of-repo emulation is possible but require more steps.

Test the executables

In Shodan, this project utilizes LLVM lit and FileCheck to test the ML executable performance. The tests are defined in the *_test.run files under <output dir>. To run the test, at the Shodan top level directory

lit --path <Filecheck dir> -a <output dir>

Filecheck in Debian testing is under /usr/lib/llvm-11/bin

Add -D RUNNER=qemu to enable the qemu tests.