The main applications of computer vision technology in agriculture were briefly reviewed and the research situation on internal and external quality inspection of fruit was described. In the field of real time external quality detection of fruit based on computer vision, the main existing problems in defect detection of fruit surface were analyzed and the further research approaches were proposed. Moreover, the potential detecting methods for fruit internal attributes including firmness, sugar and acid content, volatile compounds, and internal defects were also introduced and analyzed. To sort and grade fruit at high speed, methods of combining the measurements from several sensors into an overall quality classification should be concerned and developed in the future.