In order to enhance the autonomy of construction tele-robot (CTR), a complete autonomous task control system of CTR based on stereo vision technology was established. Firstly, automation recognition and space location of the target object were studied by stereo vision and image processing technology. And then, forward and reverse kinematics equations, trajectory planning and control were discussed. To make the autonomous movement smoothly, trajectory function must be continuous and smooth, and expectation joint displacement and velocity would be obtained by forward kinematics equation. A fuzzy controller was designed. Finally, experiments of the autonomous task control were carried out on CTR test-bed. The experiments results indicated that autonomous task control system of CTR based on stereo vision technology was reliable and safe to complete their task, and task process was smooth. 