In order to further improve the efficiency of multi-modal function optimization, a novel hybrid algorithm which combines improved particle swarm optimization algorithm and Powell search method is proposed. The Powell-IPSO hybrid algorithm organically integrates PSO algorithm which has powerful global search capability with Powell search method which has strong local search ability. The hybrid algorithm ensures quick convergent speed and find all extreme points as much as possible, and solution’s precision is improved. The hybrid algorithm only uses function values information and doesn’t need to calculate the derivative of function. So it is a generalized algorithm for multi-modal function of differentiable and non-differentiable. The simulation experionents show the effectiveness of the hybrid algorithm.