This study was aimed to enable the video service system to provide different video quality according to different needs, and be able to identify and quantify the loss of quality, so that the video quality can be controlled and improved, in order to meet the requirements of different areas. A set of video quality evaluation system was constructed by using grey correlation technique based on entropy weight method, and divided into video quality assessment system and grey correlation evaluation model. The video quality evaluation system included subjective evaluation and objective evaluation. The subjective evaluation adopted DCR subjective evaluation criteria as defined by the ITU-T P.910 method, and the objective evaluation included peak signal to noise ratio, point sharpness, structural similarity and quaternion singular value as four index algorithms. The comprehensive evaluation combing multiple methods had obvious advantages. It solved the limitations in subjective and single-index evaluation, and could evaluate the experimental videos in a comprehensive and correct manner, with high correlation with human eyes and objective reflection of the real quality of video sequences. The final comprehensive evaluation results proved that the video quality evaluation system in this paper was reasonably constructed, the method were correctly selected, and the method was feasible, achieving good results, which has a certain guiding significance to the study of video quality evaluation .