Fine gpt 2 model for any language using tensorflow

Research & Models
,
#1

I’m trying to fine tune gpt 2 model for Urdu language but I can’t.
Can someone shere a good tutorial in which I can do this for any type of language?
Thank you.

#3

is there an GPT2 open source available somewhere?

#4

Yeah, on hugging face gpt2 and gpt neo are available.

#6

There’s a great tutorial on how to fine-tune GPT-2 for any language over at the hugging face blog: Examples — transformers 2.0.0 documentation

1 Like