This study involved developing a natural disaster risk assessment framework based on the consideration of three phases: a pre-disaster phase, disaster impact phase, and post-disaster recovery phase. The exposure of natural disasters exhibits unique characteristics. The interactions of numerous factors should be considered in risk assessment as well as in monitoring environment to provide natural disaster warnings. In each phase, specific factors indicate the relative status in the area subjected to risk assessment. Three types of natural disaster were assessed, namely debris flows, floods, and droughts. The Chishan basin in Taiwan was used as a case study and the adequacy of the relocation of Xiaolin village was evaluated. Incorporating resilience into the assessment revealed that the higher the exposure is, the higher the resilience becomes. This is because highly populated areas are typically allocated enough resources to respond to disasters. In addition, highly populated areas typically exhibit high resilience. The application of this analysis in the policy of relocation of damaged village after disaster provides valuable information for decision makers to achieve the sustainability of land use planning.