In order to evaluate pearl color and luster, a monocular multi-view imaging device was designed by placing a HD camera in front of a symmetric bucket cavity body which constituted by the multiple pieces of plane mirror. The device could achieve the pearl’s surface images taken from five different perspectives. Then image processing was used to fuse the five pearl images and achieve a new image which contained the pearl’s whole surface. After that, a pearl’s region was divided into highlight areas and bright area, then the characteristic parameter of color was picked-up from bright area and the characteristic parameter of luster from highlight area. Finally, the feature fusion was used to determine the quality of the pearl. The experimental results showed that the monocular multi-view machine vision device could obtain the entire surface of the pearl in the same color system, and accomplish the real-time detection and grading for pearl’s color, luster and uniformity.