Hello, I am interested in generating and training a certain neural network structure, but am unsure how to get started.
In essence, I need to be able to call the same neural network for every instance of an object. This neural network will then have a scalar output. The issue is, I cannot train on these outputs as only the sum of the outputs is known. While I know I can concatenate these networks together, I also need to somehow tell the optimizer that although the inputs are different the weights of each instance of the neural network should be the same and cannot be changed independently. How do I do this? Is this something that needs to be specified for the Neural Networks, or for the optimizer?
