This article presents a coding method for the lossless compression of color video. In the proposed method, four-dimensional matrix Walsh transform (4D-M-Walsh-T) is used for color video coding. The whole n frames of a color video sequence are divided into '3D-blocks' which are image width (row component), image height (column component), image width (vertical component) in a color video sequence, and adjacency (depth component) of n frames (Y, U or V) of the video sequence. Similar to the method of 2D-Walsh transform, 4D-M-Walsh-T is 4D sub-matrices, and the size of each sub-matrix is n. The method can fully utilize correlations to encode for lossless compression and reduce the redundancy of color video, such as adjacent pixels in one frame or different frames of a video at the same time. Experimental results show that the proposed method can achieve higher lossless compression ratio (CR) for the color video sequence.