This paper introduces a sliding-window mean removal high pass filter by which background clutter of infrared multispectral image is obtained. The method of selecting the optimum size of the sliding-window is based on the skewness-kurtosis test. In the end, a multivariate Gaussian distribution mathematical expression of background clutter image is given.