How to utilize the latest XNNPack in TFJS-Lite?

General Discussion
, ,
#1

In the recent blog post XNNPack was shown to have accelerated processing via quantization and SIMD. I’d like to utilize these abilities via TFJS (WASM), though it is unclear exactly how to do so.

In the blog post they mention that, “will be available in TensorFlow Lite Web API in the 2.7 release”, when will that release be available? If I wanted to try it now should I just build TFJS myself from nightly, or is it just not in the codebase yet?

Please let me know!
Michael Carlon

#3

I think that you can build yourself with:

#4

@Bhack Thanks for that pointer; do you know if the current code has the latest enhancements around accelerating quantization processing?

#5

I think yes: