The H.264/AVC inter-prediction is performed for Variable Block-Size Motion Estimation (VBSME) such as 16×16, 16×8, 8×16, 8×8, 8×4, 4×8 and 4×4, it cause the high complexity for H.264 Motion Estimation (ME). This investigation develops an architecture for a combined fast motion estimation algorithm with Edge Information Mode Decision (EIMD) and Predict Hexagon Search (PHS). Compared with other popular ME architecture, the proposed architecture has a large search range and low processing frequency. For the general specification of SDTV (720×480) with 4 reference frames, search range 256×256, the proposed architecture needs only 18.66MHz. For the very high specification of QFHD (3840×2160) with 1 reference frame, search range 256×256, the proposed architecture only requires 112MHz. The gate count of the proposed architecture is 300K, and the memory usage is 12.6 KB.