Transformer tutorial error in cell 25, line 4

General Discussion
#1

ValueError Traceback (most recent call last)

Cell In[25], line 4
1 embed_pt = PositionalEmbedding(vocab_size=tokenizers.pt.get_vocab_size(), d_model=512)
2 embed_en = PositionalEmbedding(vocab_size=tokenizers.en.get_vocab_size(), d_model=512)

#3

Hi @Juan_Vargas, while using Tensorflow 2.16 with keras 3 we have also observed the same. As a temporary work around please try to use keras 2 which will not produce any error. Please refer to the gist for working code. Thank You.