[Tracking Issue] Pre-quantized RNN Operators Support (e.g., UnidirectionalSequenceLSTM from TFlite)

[dftercero]

This issue is to track progress for Pre-quantized RNN Operators

It'd be great to expand support for recurrent quantized operators, such as the UnidirectionalSequenceLSTM from TensorFlow. Are there any timelines for this in the current roadmap?

Resources:

• TFlite frontend: https://github.com/apache/tvm/blob/main/python/tvm/relay/frontend/tflite.py
• Tensorflow fused RNN Operator: https://www.tensorflow.org/lite/models/convert/rnn

[dftercero]

@lhutton1 @leandron You guys have done a lot of work recently with quantized operators from TFLite based on #9187. Any thoughts on this? Thanks in advanced

[lhutton1]

Hi @dftercero, I don't believe there is any ongoing work to support it yet. I don't know much about this operator, although, after a quick search of the codebase it looks like a bit more work would be needed to support the quantized variant of LSTM in TVM rather than simply making a conversion in the frontend

[amroceva]

Hi @hpanda-naut @lhutton1, is there any ongoing work to support the quantized version of it ? if no, can you give hints about the needed work to do so, I would like to contribute...