White light LEDs become more and more important in display and lighting in various structures. Here a new modeling algorithm for phosphor-converted white light-emitting diodes (pcW-LEDs) is proposed, aiming to perform accurate simulation for color appearance, where potentially enabling optical designers to remove yellowish/bluish spots in LED lighting. The proposed modeling method is applied to simulate a pcW-LED with a hemi spherical lens. The simulation accurately predicts the blue and yellow light distribution. The model is further verified by applying a total internal reflector lens to the pcW-LED. In the midfield region, the blue and yellow light distribution exhibit large variations as the observation distance changed; this varying light pattern for both the blue and yellow lights can be accurately predicted by using the proposed model. The well-established optical model should facilitate designing a pcW-LED that features high-quality illumination and enhances color uniformity.