Quantizing LSTM layers?

General Discussion
,
#1

There seems to no support available for LSTM layer quantization.
If one has to do Quantization of LSTM layers, what will be starting point ?

1 Like
#2

Hi, I think you can starts from Post training quantization : Post-training quantization  |  TensorFlow Lite

Unfortunately, Quantization aware training is not supports LSTM/RNN layers yet.
(It just in the plan.)

For your information, There’s known issue related to LSTM quantization: Can LSTM be fully quantized for inference? · Issue #25563 · tensorflow/tensorflow · GitHub

3 Likes
#3

You can also check

1 Like