Quantizing LSTM layers?

There seems to no support available for LSTM layer quantization.
If one has to do Quantization of LSTM layers, what will be starting point ?

1 Like

Hi, I think you can starts from Post training quantization : Post-training quantization  |  TensorFlow Lite

Unfortunately, Quantization aware training is not supports LSTM/RNN layers yet.
(It just in the plan.)

For your information, There’s known issue related to LSTM quantization: Can LSTM be fully quantized for inference? · Issue #25563 · tensorflow/tensorflow · GitHub

3 Likes

You can also check

2 Likes