This is a known issue with newer version of TF Serving. Colab simply run older version of linux. The current workaround is to downgrade TF Serving. I can’t remember the version# to use, but if you search that error on GitHub and you will find a suitable version# for Colab.