Since the conventional dynamic inversion(DI) control is sensitive to the uncertainties of system, an $L_1$ adaptive augmentation approach is proposed to control the high angle of attack of fighter. Firstly, the control system is divided into the inner loop and outer loop based on the time-scale separation principle. Then, dynamic inversion controllers are designed as the basic controllers to follow the angle rates and the angles. The $L_1$ adaptive controller is designed as augmentation controller to cancel the uncertainties of the control system. Finally, the simulations and comparisons are implemented in the nominal case and parameter perturbation case. Simulation results show that the proposed control approach is able to cancel the uncertainties and increase the control effects efficiently.