Fine gpt 2 model for any language using tensorflow

I’m trying to fine tune gpt 2 model for Urdu language but I can’t.
Can someone shere a good tutorial in which I can do this for any type of language?
Thank you.

is there an GPT2 open source available somewhere?

Yeah, on hugging face gpt2 and gpt neo are available.

There’s a great tutorial on how to fine-tune GPT-2 for any language over at the hugging face blog: Examples — transformers 2.0.0 documentation

1 Like