Prediction gave same result as output whatever the value I request

Special Interest Groups
,
#1

Hello,

I’d like to understand where is my mistake on training and predicting from a model.
My goal is to predict a value to be either odd or even, (or out of vocabulary), so a kind of classification.
But after training is fully completed I test my model using unseen values and the prediction output gave me unexpected and always the same result.

Note this is only for testing and the final accuracy does not matter to me.

Here is what I did using nodejs tensorflow Api :

  1. I rougthly have 10000 values on dataset, half of data is labeled as “odd” and the other half is “even” ; do you think it is enough ? how many input should I train for such use case ?
  2. Values are positive float values
  3. min value 0.0016584342301295685
  4. max value 9.998886873517526
  5. On my data I took parseInt(floatValue) so that I consider only the integer value for the label Odd/Even => e.g.: 1.2 is Odd as well as 1.9
  6. I set 90% training and 10% validating from that dataset ; and I pick training data randomly (after shuffleling).
  7. I set 50 epochs and 20 batch size… just pick those values for testing.
  8. Training gave me : 0.7347 as loss and 0.4969 as accuracy… So I’m expecting to have 50% errors on predictions … very bad, but again, I don’t care because I’m just testing my development.
  9. But when I’m requesting my code to predict from unseen values I got the following results :
  • 1.2 ==> Odd with a score of 0.481
  • 1.5 ==> Odd with a score of 0.481
  • 1.9 ==> Odd with a score of 0.481

FYI: The model is the following :

		const model = tf.sequential();
		model.add(tf.layers.dense({
			inputShape: [ 1 ],
			units: 1,
			activation: "relu"
		}));
		model.add(tf.layers.dense({
			units: 3, // because I consider 3 possible values "odd", "even" or "oov" for 'out of vocabulary' either it does not make a lot of sense in this context
			activation: "softmax"
		}));

What do you think ? where could be my mistakes ?

Thanks.

#3

@Math,

It seems the issue with your model and training approach.

Could you please try as suggested below and let us know?

  1. Increase the size of your dataset if possible for better model performance
  2. The model is very simple.Try adding more layers to the model and see if that improves the model performance
  3. The model is not trained enough. 50 epochs may not be enough to train the model to accurately predict unseen values. Try increasing the number of epochs and see if that improves the model performance

Thank you!

#5

Hi @chunduriv, and thank you for your suggestions.

I took a very long delay to answer your post, as I have tested several use cases without taking notes and then I did the tests again so I could get back on this post.

Unfortunately, there is something I don’t understand as my tests results does not help me that much and I still have unexpected predictions, at least the accuracy remain low.
On the following picture, I list the tests I conduct and the accuracy + loss results I got from the training+validation :

The best accuracy I could get is 0.7312

I also have tested adding one or 2 dense layer with sigmoid activation and random units numbers. but it does not seems to have big impacts on results.

Do you have any idea what could be innacurate ? (I’m still considering my code is not well implemented, but it’s going to be complicated to share you the source code as it is integrated into a complex platform)

Thanks