In order to reduce Gaussian noise, this paper proposes a method via taking the average of the upper and lower envelopes generated by capturing the high and low peaks of the input signal. The designed fast response filter has no cut-off frequency, so the high order harmonics of the actual signal remain unchanged. Therefore, it can immediately respond to the changes of input signal and retain the integrity of the actual signal. In addition, it has only a small phase delay. The slew rate, phase delay and frequency response can be confirmed from the simulation results of Multisim 13.0. The filter outlined in this article can retain the high order harmonics of the original signal, achiev-ing a slew rate of 6.34 V/μs and an almost zero phase difference. When using our filter to physically test the input signal with a noise level of 3 Vp-p Gaussian noise, a reduced noise signal of 120 mVp-p is obtained. The noise can be suppressed by up to 4% of the raw signal.