commit | c4839b36b96d627acba585ff889c3901aa30b7bc | [log] [tgz] |
---|---|---|
author | Lun Dong <lundong@google.com> | Thu Jul 28 17:02:09 2022 -0700 |
committer | Lun Dong <lundong@google.com> | Fri Jul 29 15:20:44 2022 -0700 |
tree | 2d069a85c6b8cdd4e7aa51a128653e97365ebb2d | |
parent | 530ea6bbb3d5bec61379b14ad8b245add5a828e0 [diff] |
Optimize dot product in audio MFCC pre-processing via RVV Use RVV for the dot product operation in audio preprocessing. Yield ~30% of saving in term of # of instructions. Results validated (within 1 code of difference due to quantization) and unit tests are passed. Other optimization opportunies for audio preprocessing are not trivial nor straightforword, and will be put on hold due to priority shift. Change-Id: Iea6f78bf488bacb8c617fbed0671dd607137e50f
This project contains ML model codegen and execution libraries/examples. The artifacts built from this project is targeted for RISC-V 32-bit baremetal machine (Springbok).
If you get this project from Project Shodan manifest, you are all set. If not, you need to have following projects as well to build the project successfully.
<dir>/sw/vec
<dir>/toolchain/iree
<dir>/ml/ml-models-public
This project needs to be at <dir>/sw/vec_iree
If you are running from Project Shodan repo, you can build the artifacts with m iree
. If you download this project alone, you need to download/build IREE's host compiler, then at the top level directory
cmake -B <output dir> -G Ninja \ -DCMAKE_TOOLCHAIN_FILE="$(realpath sw/vec_iree/cmake/riscv_iree.cmake)" \ -DCMAKE_BUILD_TYPE=MinSizeRel \ -DIREE_HOST_BINARY_ROOT="$(IREE_COMPILER_DIR)/install" \ -DRISCV_TOOLCHAIN_ROOT=$(TOOLCHAINRV32_PATH) \ <dir>/sw/vec_iree cmake --build <output dir> --target all
You can run QEMU or RENODE emulation with the built executables. In Shodan repo, qemu_sim_springbok
for QEMU emulation, and sim_springbok
for Renode simulation. Out-of-repo emulation is possible but require more steps.
In Shodan, this project utilizes LLVM lit
and FileCheck
to test the ML executable performance. The tests are defined in the *_test.run files under <output dir>
. To run the test, at the Shodan top level directory
lit --path <Filecheck dir> -a <output dir>
Filecheck in Debian testing is under /usr/lib/llvm-11/bin
Add -D RUNNER=qemu
to enable the qemu tests.