The method of support vector machine (SVM) was used to recognize the stitch structure of single plain and tuck knitted fabric in this paper. After getting and preprocessing the digital images of fabrics, fabric coverage rate, the variance of yarn intervals in the vertical direction and the variance of the yarn average diameters were selected as characteristic parameters of SVM, and recognizing model was established. The experiments showed that the method has good identification rate for single plain and tuck knitted fabric.