Vision Models

Tests of Keras and Slim vision models.

IREE has three main backend targets: vmvx , llvm and vulkan-spirv. We also test TFLite in our infrastructure for benchmarking purposes.

Last Updated: 2020/12/8

End to end tests of tf.keras.applications vision models on Imagenet

targettflitevmvxvulkan-spirv
DenseNet121✓✓✓
DenseNet169✓✓✓
DenseNet201✓✓✓
EfficientNetB0✓✓✓
EfficientNetB1✓✓✓
EfficientNetB2✓✓✓
EfficientNetB3✓✓✓
EfficientNetB4✓✓✓
EfficientNetB5✓✓✓
EfficientNetB6✓✓✓
EfficientNetB7✓✓✓
InceptionResNetV2✓✓✗
InceptionV3✓✓✗
MobileNet✓✓✓
MobileNetV2✓✓✓
MobileNetV3Large✓✓✓
MobileNetV3Small✓✓✓
NASNetLarge✓✗✗
NASNetMobile✓✗✗
ResNet101✓✓✓
ResNet101V2✓✓✗
ResNet152✓✓✓
ResNet152V2✓✓✗
ResNet50✓✓✓
ResNet50V2✓✓✗
VGG16✓✓✓
VGG19✓✓✓

End to end tests of TensorFlow slim vision models

targettflitevmvxvulkan-spirv
inception_resnet_v2✓✓✗
inception_v1✓✓✗
inception_v2✓✓✗
inception_v3✓✓✗
nasnet_large✓✗✗
nasnet_mobile✓✗✗
pnasnet_large✓✓✗
resnet_v1_101✓✓✓
resnet_v1_152✓✓✓
resnet_v1_50✓✓✓
resnet_v2_101✓✓✗
resnet_v2_152✓✓✗
resnet_v2_50✓✓✗