Hi! I am struggling to make some torch distributed code to work with a tfds dataset.
I seem to have reduced the issue to the following few lines of code
Basically, if I could manage to get the tfds dataset (above) pickable I believe the torch distributed code would run. Is there a way to do that?
Here is the dataset btw: Directory listing for /tensorflow_datasets_small/cms_pf_ttbar/1.6.0/
Thanks for any help!!