The paper aims to solve the problem that the detection camera is distorted due to external jitter during the shooting process. The first frame of the video was selected as the reference frame, and the feature points of each frame of the video were detected. Compared with the position of the feature points of the first frame, and the perturbation of each frame was eliminated by affine transformation. The FAST algorithm was used to generate frame feature point. The BRISK algorithm was used to obtain the binary feature descriptor of the feature point. The Hamming distance of the feature point descriptor was compared to match the feature points between the adjacent two frames; and the affine transformation model were determined with matched feature point pairs. The affine transformation model was finally corrected for each frame with the obtained affine transformation matrix. The total number of frames of the original video was 23 frames, the duration was 1 second, and the resolution was 320×240. All frames except the first frame were corrected. The FAST corner detection algorithm combined with the BRISK matching method can effectively solve problems such as video distortion.