Calcaneus fractures often occur because of accidents during exercise or activities. In general, the detection of the calcaneus fracture is still carried out manually through CT image observation, and as a result, there is a lack of precision in the analysis. This paper proposes a computer-aid method for the calcaneal fracture detection to acquire a faster and more detailed observation. First, the anatomical plane orientation of the tarsal bone in the input image is selected to determine the location of the calcaneus. Then, several fragments of the calcaneus image are detected and marked by color segmentation. The Sanders system is used to classify fractures in transverse and coronal images into four types, based on the number of fragments. In the sagittal image, fractures are classified into three types based on the involvement of the fracture area. The experimental results show that the proposed method achieves a high precision rate of 86%, with a fast computational performance of 133 frames per second (fps), used to analyze the severity of injury to the calcaneus. The results in the test image are validated based on the assessment and evaluation carried out by the physician on the reference datasets.