A method and apparatus with object estimation model training is provided. The method include generating a cross-correlation loss based on a first feature vector, generated using an interim first neural network (NN) model provided an input based on first input data about a target object, and a second feature vector generated using a trained second neural network provided another input based on second input data about the target object; and generating a trained first NN model, including training the interim first NN model based on the cross-correlation loss.