From Observed Frequency to Expected Value

A worked explanation of from observed frequency to expected value, including the key limitation and a checkable example.

From Observed Frequency to Expected Value

An observed proportion from your data cannot replace a true probability in a long-run average calculation unless you meet one condition: the sample is representative and you invoke the law of large numbers as your justification. That is the single gate from observed frequency to expected value. The relative frequency you compute from a sample is an estimate of the unknown probability, not the probability itself. Use it in an expected value calculation only when you are willing to state the sampling uncertainty alongside the estimate.

The formula to bridge the gap is P̂ = f / n, where f is the observed frequency of the event and n is the total number of independent trials. P̂ is the estimated probability, a proportion between 0 and 1. When you multiply P̂ by the number of future trials, you get an expected count, not a guarantee. The calculator outputs the relative frequency table; the bridge to probability is your own judgment about whether the sample justifies the estimate.

A Worked Example

Take 100 coin flips. You record 53 heads and 47 tails. The observed frequency of heads is 53, the total n is 100, so the estimated probability P̂ = 53 / 100 = 0.53. If you plan to flip the coin another 1000 times and want the long-run expected number of heads, you multiply: 0.53 × 1000 = 530 heads. That is the expected value of the count, using your observed proportion as the stand-in for the true probability.

The failure case arrives when n is small. Imagine 5 trials with 4 successes. P̂ = 4 / 5 = 0.80. If the true probability is 0.50, using 0.80 in an expected value calculation for 100 trials produces 80 expected successes instead of the correct 50. The small sample produced a biased estimate. The law of large numbers has not had enough trials to converge.

Calculation Steps

Every calculation of an expected value from an observed proportion must report the sampling uncertainty. The standard error of the proportion is sqrt(P̂(1-P̂)/n). For the 53-heads example, the standard error is sqrt((0.53 × 0.47) / 100) = sqrt(0.2491 / 100) = sqrt(0.002491) ≈ 0.0499. That means the estimated probability of heads is 0.53 with a sampling error of roughly 0.05. The true probability could reasonably be 0.48 or 0.58. Any expected value you compute inherits this range.

When you need the expected value for a future run of trials, plug P̂ into the expected value calculator that accepts an estimated probability. The calculator returns a point estimate. You must then add the error margin yourself from the standard error formula. The calculator does not do inference for you.

Why the Method Works

The condition that permits using an observed proportion as a probability has three parts. First, the sample must be a random sample from the same process you plan to model. A convenience sample of friends who all buy the same product does not represent the general population. Second, the trials must be independent and identically distributed. Drawing cards without replacement from a small deck violates independence because each draw changes the deck's composition. Third, the sample size must be large enough that the law of large numbers has started to work. There is no universal minimum sample size, but the standard error shrinks as n grows, giving you a tighter bound on the estimate.

The American Statistical Association guidelines on empirical probabilities require that uncertainty be reported alongside the estimate. If you state P̂ = 0.53, you must also say that the standard error is 0.05 or provide a confidence interval. An expected value calculated without this context is incomplete and potentially misleading.

When You Cannot Use the Observed Proportion

Do not use an observed proportion when n is below 30 and the event is rare. For a rare event with 1 success in 20 trials, P̂ = 0.05 but the standard error is sqrt((0.05 × 0.95) / 20) = sqrt(0.0475 / 20) = sqrt(0.002375) ≈ 0.0487. The estimate is nearly as large as its own error. An expected value built from it is unreliable. Also skip this approach when the data is not a random sample. A survey of only your own customers cannot be used to calculate the expected value for the entire population of buyers.

Conditions for Using Observed Proportion as Estimated Probability
ConditionWhat to CheckFailure Mode
Random sampleData collected without selection biasConvenience sample produces biased P̂
Independent trialsEach trial does not affect the nextDrawing without replacement from small deck
Large nStandard error below 0.05 for proportion near 0.50Small n gives estimate as large as its own error
Same processFuture trials come from the same distributionUsing historical data from a changed process

The One Practical Rule

The single most practical thing to do when you want to use an observed proportion as a probability is to calculate the standard error and report it. Without that number, your expected value is a guess. With it, you can say whether the estimate is tight enough to act on. If the standard error exceeds 0.10, collect more data before running the expected value calculation.

  • Compute P̂ = f / n from your sample.
  • Calculate the standard error: sqrt(P̂(1-P̂)/n).
  • If the standard error is above 0.10, do not use P̂ for an expected value.
  • If the standard error is below 0.05, P̂ is usable but still carries uncertainty.
  • Always state the standard error alongside any expected value.

Common Questions

What is the difference between observed frequency and probability?

Observed frequency describes past data: the count of events divided by total trials. Probability predicts future events using the theoretical total of all possible outcomes. The observed proportion is an estimate of probability, not the true value.

How large must n be to use an observed proportion as a probability?

There is no fixed number, but the law of large numbers requires enough trials for the sample average to converge. A standard error below 0.05 is a practical threshold. For a proportion near 0.50, that requires at least 100 trials.

What happens if my sample is not a random sample?

You cannot use the observed proportion as an estimated probability for the larger population. The estimate only describes your sample. Any expected value you calculate applies only to that sample, not to the real-world process you are trying to model.

Can I use an observed proportion from a small sample if I state the uncertainty?

You can report the estimate with its standard error, but the estimate may be far from the true probability. For n=5 with 4 successes, P̂=0.80 and the standard error is 0.18. The true probability could be anywhere from 0.44 to 1.00. The expected value is nearly useless.