This study developed effective algorithms to reconstruct 3D building models from a single image. The developed algorithms extract feature lines first from photographs or paintings with perspective views. Vanishing points are calculated and feature points are determined using extracted feature lines. Coordinates of the extracted feature points are then computed based on vanishing points using single-view metrology. Several types of image were used in this study to test the performance of the developed algorithms, including computer simulated paintings, video frame cuts, close-range and overlook photos, real paintings. The results demonstrated indicate that the developed algorithms can successfully extract 3D information and reconstruct 3D building models effectively from single-view images.