Directly constructing the fuzzy concept lattice is one of most important issues for formal concept analysis(FCA). However, most construction algorithms for fuzzy concept lattice are based on closure operation of fuzzy Galois connection. Therefore, a parallel algorithm based on load balance is proposed to improve the efficiency of building all fuzzy concepts. It utilizes the structure of complete tree to organize and parallelly breadth-first traverse search space which is represented
with nature number interval. Along the height of the complete tree, the algorithm checks and reduces current sub-search spaces parallelly, meanwhile fuzzy concepts are produced. At the end of each iterations, search space is redivided so that all computing nodes share computing load fairly. Experiment results show that the algorithm has excellent performances on sparse data set, and it can effectively improve the efficiency of the construction of all fuzzy concepts.