Individual identification is the foundation for achieving digital management of cattle. In order to achieve non-contact and high-precision individual identification, a dairy cow face recognition method based on RGB-D information fusion was proposed. Totally 108 Holstein cows aged 28 months to 30 months were selected as the research subjects, and 2334 color/depth images of cattle faces were collected by using the Intel RealSense D455 depth camera as the original dataset. Firstly, image preprocessing was carried out by using redundant image elimination and adaptive threshold background separation algorithms. After enhancement, a total of 8344 cattle face images was obtained as the dataset. Then, three feature extraction networks, including Inception ResNet v1, Inception ResNet v2, and SqueezeNet, were selected to extract the facial features of the cattle face. The optimal backbone feature extraction network of the FaceNet model was determined through comparative analysis. Finally, the extracted dairy cow face image features were L2 regularization and mapped to the same feature space. A classifier was trained to achieve individual classification of dairy cows. The test results showed that using Inception ResNet v2 as the backbone feature extraction network of the FaceNet model had the best performance. After testing the cow face recognition accuracy on the preprocessed dataset with background separation, the accuracy reached 98.6%, the verification rate was 81.9%, and the misidentification rate was 0.10%. Compared with that of Inception ResNet v1 and SqueezeNet networks, the accuracy was improved by 1 percentage points and 2.9 percentage points, respectively. Compared with that of the dataset without background separation, the accuracy was improved by 2.3 percentage points. The research result can provide a method for dairy cow face recognition.