Aiming at the trajectory tracking control problem of the hybrid mechanism with mismatched disturbance, a control strategy combining extreme learning machine and adaptive backstepping control was proposed. Considering the hybrid mechanism containing the characteristics of drive motor, adaptive control with backstepping method was used to design the control strategy in stages. Based on the disturbance analysis, the conveying mechanism modeling error, friction, load and external random disturbance, and motor voltage disturbance were taken as matched disturbance and mismatched disturbance were two lumped disturbance terms. Since the mismatched disturbance cannot be eliminated directly by the feedback controller, two ELM networks were used to perform on-line approximation respectively, and perform feedforward compensation in the designed backstepping controller. According to the stability theory of Lyapunov function, the control rate and adaptive rate of the hybrid mechanism were designed. The simulation results showed that the method effectively eliminated the influence of mismatch disturbance in the system and realized the trajectory tracking control of the hybrid mechanism. In addition, because the neural network adaptive inversion controller of the hybrid mechanism contained many adjustable parameters such as inversion stabilization coefficients and adaptive parameters, the particle swarm algorithm was used to optimize and set the controller parameters. The system error, output error, controller output and rise time were used as the objective function construction conditions, and the optimal parameters of the controller were obtained through 150 iterations of optimization. Neural network adaptive backstepping controller without PSO-optimize and the PD controller were simulated as a comparison. The simulation results showed that the neural network adaptive backstepping controller of the hybrid mechanism based on PSO optimization had excellent tracking accuracy and system robustness.