Abstract
Stating a confidence interval is a traditional method of indicating the sampling error of a point estimator of a model's performance measure. We propose a single dimensionless criterion, inspired by Schruben's coverage function, for evaluating and comparing the statistical quality of confidence-interval procedures. Procedure quality is usually thought to be multidimensional, composed of the mean (and maybe the variance) of the interval-width distribution and the probability of covering the performance measure (and maybe other values). Our criterion, which we argue lies at the heart of what makes a confidence-interval procedure good or bad, compares a given procedure's intervals to those of an "ideal" procedure. For a given point estimator (such as the sample mean) and given experimental data process (such as a first-order autoregressive process with specified parameters), our single criterion is a function of only the sample size (or other rule that ends sampling).
Original language | English |
---|---|
Pages (from-to) | 345-352 |
Number of pages | 8 |
Journal | Winter Simulation Conference Proceedings |
Volume | 1 |
State | Published - 2002 |
Event | Proceedings of the 2002 Winter Simulation Conference - San Diego, CA, United States Duration: 8 Dec 2002 → 11 Dec 2002 |