An example method of video coding includes receiving a video bitstream corresponding to a plurality of frames of video data and obtaining, from the video bitstream, an indication of whether a set of cross-component sample offset (CCSO) parameters for a current frame is to be predicted from a reference frame. In accordance with the indication indicating that the set of CCSO parameters is to be predicted, the method includes deriving the set of CCSO parameters for the current frame from the reference frame, where signaling of the set of CCSO parameters in the video bitstream is skipped for the current frame. The method further includes obtaining a filtered block by applying the CCSO filtering process to a block of the current frame, and reconstructing the current frame using the filtered block.