Due to the factors such as sensor spatial resolution and heterogeneity of surface features, the mixed-pixels were commonly found in medium-spatial resolution remote sensing data, especially in hilly areas, strong topographic relief, diversity, breakage, mixed distribution and scattered layout of the surface features and other factors constituted the difficulties of remote-sensing image classification mapping. In order to improve the classification accuracy for land use in hilly areas and provide data support for land use monitoring, a combined approach of multiple endmember spectral mixture analysis (MESMA) and random forest (RF) was explored. Based on data source of Landsat-8 operational land imager (OLI) sensor data, the fractional abundance of vegetation, impervious surface and soil was firstly extracted through MESMA. Secondly, totally 20 feature variables were figured out and three combined models were constructed on the basis of data image spectrum, texture and fraction variables to carry out random forest classification experiment. Through comparing between the optimal result from the experiment and SVM and MLC classification results, including the same number of variables, the results indicated that MESMA can derive accurate fraction information. The inclusion of fraction information could help to improve the mapping accuracy of all classification methods (RF, SVM and MLC), which can be up to 90.50%, 88.85% and 86.35%, respectively, the gain of RF classification accuracy was most significant. Comparing with LSMA, the fraction variable generated by MESMA was more useful for improving the accuracy. The combined method of MESMA and RF can achieve the comparatively accurate classification map in the multi-feature variables. The accuracy was better than those of SVM and MLC classification results with the same feature variables. Therefore, the proposed method can obtain high precision in land use classification in hilly area. Based on this method, remote sensing image interpretation of large scales can provide technical support and rational reference for land reclamation monitoring.