Plot using real time instead of time steps

I am training a time series model to predict a time series curve using other parameters; however, I do not want to use the date as a feature. This means I take the datetime column out of my training input and then perform the batching, shuffling, training, etc. Is there a way that I can then now plot the model predictions using the real time values rather than the ambiguous time step values? Basically, it would be nice that the time was attached to the label time series values without actually being used in the training/prediction process. Is there a way to do this? I essentially followed this tutorial Time series forecasting  |  TensorFlow Core.