Material image recognition has broad application prospects, such as clothing recognition, automatic picking by a robot, industrial detection, etc. Owing to the influence of light intensity and camera angle, material image is easy to change. Mining robust and effective image features is one of the most important factors to handle this change. To address this problem, an improved model called {SECF²