TFLite stores the embeddings of its model as a FlatBuffer, utilizing memory-mapped I/O. I would like to understand the reasons why FlatBuffers are well-suited for memory-mapped I/O.
To my knowledge, the size of the embedding table is considered negligible because TFLite employs memory-mapped I/O for embeddings.