Hyperspectral image has continuous spectral information of ground objects, which is an essential means of remote sensing monitoring. On this basis, the endmembers of the features can be extracted by decomposing the mixed pixel spectrum and exploring the degree of each endmember participates in the mixing. However, specific spectral changes cause trouble for spectral unmixing due to the sensor and the image’s resolution. To solve this problem, an endmember bundle extraction method based on multi-modal and multi-objective particle swarm optimization by special crowding distance (MOPSOSCD) was proposed. Firstly, for a three-dimensional hyperspectral image, the label coding was carried out pixel by pixel, and the index-based ring topology was used for individual interaction in different neighborhoods. Secondly, for particle velocity and position update, the position update method of PSO was adopted and the particle swarm velocity update method and the integer particle position update were improved through neighborhood optimization. The objective function selection was measured by two RMSEs, that was, the unconstrained least squares method was used to solve the RMSE of the abundance map anti-mixing and the original map, and the fully constrained least squares method was used to solve the RMSE of the abundance map anti-mixing and the original map. At the same time, according to the spatial characteristics of hyperspectral images, decision space diversity was improved by improving the crowded distance of decision space. Finally, the crowding distances of the decision space and the target space were combined and sorted, and the particles were updated according to the sorting results. When the particle directional movement probability was 0.2, the number of particles was 30, and the number of iterations was 400, the results of RMSE and mSAD on the MUUFL dataset were 0.0088 and 0.1112, respectively. Through the comparative test, the method had higher extraction accuracy and efficiency than VCA and DPSO, providing a more accurate end beam extraction method for hyperspectral unmixing.