The hot gas purification process is essential in integrated gasification combined cycle (IGCC), and the technology used therein exhibits high system efficiency and has a low environmental impact. The main purpose of this research is to develop a filtration system that can be used in a near-industrial environment. By controlling the moving granular bed filter in the moving bed mode, this operation could generate a cooling effect and condense the tar in the filter media by incorporating the characteristics of the dew point temperature of tar. Tar could then be collected by the gas sampling system at the gas exhaust end, and the tar removal efficiency could be obtained by comparing the inlet and outlet concentrations. The test parameters were used to explore the influence of tar removal efficiency of medium- and high-temperature granular bed filters by changing the inlet velocity, temperature, and filter media mass flow rate. Test results show that the tar removal efficiency decreased with increasing temperature and velocity. When the concentration of the tar module was 50 g/Nm3, the gas velocity was 1.8 m/s, and the filter media mass flow rate was 300 g/min. The removal efficiency could reach 98.3% at a temperature of 200 °C. In addition, the test results indicate that the removal efficiency led to an optimized filter media mass flow rate at different inlet velocities. These results are expected to lay a foundation for advanced purification technology in the future.