Chapter 5: Continuous Random Variables
5.3 The Exponential Distribution
Learning Objectives
By the end of this section, the student should be able to:
- calculate exponential distribution and the probability density function.
The exponential distribution is often concerned with the amount of time until some specific event occurs. For example, the amount of time (beginning now) until an earthquake occurs has an exponential distribution. Other examples include the length, in minutes, of long distance business telephone calls, and the amount of time, in months, a car battery lasts. It can be shown, too, that the value of the change that you have in your pocket or purse approximately follows an exponential distribution.
Values for an exponential random variable occur in the following way. There are fewer large values and more small values. For example, the amount of money customers spend in one trip to the supermarket follows an exponential distribution. There are more people who spend small amounts of money and fewer people who spend large amounts of money.
The exponential distribution is widely used in the field of reliability. Reliability deals with the amount of time a product lasts.
Example
Let X = amount of time (in minutes) a postal clerk spends with his or her customer. The time is known to have an exponential distribution with the average amount of time equal to four minutes.
X is a continuous random variable since time is measured. It is given that [latex]\mu = 4[/latex] minutes. To do any calculations, you must know m, the decay parameter.
[latex]m=\frac{1}{\mu }[/latex]. Therefore, [latex]m=\frac{1}{4}=0.25.[/latex]
The standard deviation, [latex]\sigma[/latex], is the same as the mean. [latex]\mu = \sigma[/latex]
The distribution notation is [latex]X \sim Exp(m)[/latex]. Therefore, [latex]X \sim Exp(0.25)[/latex].
The probability density function is [latex]f(x) = me-mx[/latex]. The number [latex]e = 2.71828182846...[/latex] It is a number that is used often in mathematics. Scientific calculators have the key “[latex]e^{x}[/latex].” If you enter one for x, the calculator will display the value e.
The curve is:
[latex]f(x) = 0.25e–0.25x[/latex] where [latex]x[/latex] is at least zero and [latex]m = 0.25[/latex].
For example, [latex]f(5)=0.25e - (0.25)(5) = 0.072[/latex]. The postal clerk spends five minutes with the customers.
The graph is as follows:
Notice the graph is a declining curve. When [latex]x = 0[/latex],
[latex]f(x) = 0.25e(−0.25)(0) = (0.25)(1) = 0.25 = m[/latex]. The maximum value on the y-axis is m.
Your Turn!
The amount of time spouses shop for anniversary cards can be modeled by an exponential distribution with the average amount of time equal to eight minutes. Write the distribution, state the probability density function, and graph the distribution.
Solution
[latex]X \sim Exp(0.125)[/latex]; [latex]f(x)=0.125 e ^{-0.125x}[/latex];
Example
a. Using the information in the graph from the first example (shown below), find the probability that a clerk spends four to five minutes with a randomly selected customer.
Solution
a. Find [latex]P(4 \lt x \lt 5)[/latex].
The cumulative distribution function (CDF) gives the area to the left.
[latex]P(x \lt x) = 1 – e–mx[/latex]
[latex]P(x \lt 5) = 1 – e(–0.25)(5) = 0.7135[/latex] and [latex]P(x \lt 4) = 1 – e(–0.25)(4) = 0.6321[/latex]
You can do these calculations easily on a calculator.
The probability that a postal clerk spends four to five minutes with a randomly selected customer is [latex]P(4 \lt x \lt 5) = P(x \lt 5) – P(x \lt 4) = 0.7135 − 0.6321 = 0.0814[/latex].
On the home screen, enter (1 – e^(–0.25*5))–(1–e^(–0.25*4)) or enter e^(–0.25*4) – e^(–0.25*5).
b. Half of all customers are finished within how long? (Find the 50th percentile)
Solution
b. Find the 50th percentile.
[latex]P(x \lt k) = 0.50, k = 2.8[/latex] minutes (calculator or computer)
Half of all customers are finished within 2.8 minutes.
You can also do the calculation as follows:
[latex]P(x \lt k) = 0.50[/latex] and[latex]P(x \lt k) = 1 –e–0.25k[/latex]
Therefore, [latex]0.50 = 1 − e−0.25k[/latex] and [latex]e−0.25k = 1 − 0.50 = 0.5[/latex]
Take natural logs: [latex]ln(e–0.25k) = ln(0.50)[/latex]. So, [latex]–0.25k = ln(0.50)[/latex]
Solve for k:[latex]k=\frac{ln\left(0.50\right)}{-0.25}=2.8[/latex] minutes. The calculator simplifies the calculation for percentile k. See the following two notes.
A formula for the percentile k is [latex]k=\frac{ln\left(1-AreaToTheLeft\right)}{-m}[/latex] where ln is the natural log.
On the home screen, enter ln(1 – 0.50)/–0.25. Press the (-) for the negative.
c. Which is larger, the mean or the median?
Solution
c. From part b, the median or 50th percentile is 2.8 minutes. The theoretical mean is four minutes. The mean is larger.
Your Turn!
The number of days ahead travelers purchase their airline tickets can be modeled by an exponential distribution with the average amount of time equal to 15 days. Find the probability that a traveler will purchase a ticket fewer than ten days in advance. How many days do half of all travelers wait?
Solution
[latex]P(x \lt 10) = 0.4866[/latex]
50th percentile = 10.40
Example
On the average, a certain computer part lasts ten years. The length of time the computer part lasts is exponentially distributed.
a. What is the probability that a computer part lasts more than 7 years?
Solution
a. Let x = the amount of time (in years) a computer part lasts.
[latex]\mu = 10[/latex] so [latex]m=\frac{1}{\mu }=\frac{1}{10}=0.1[/latex]
Find [latex]P(x > 7)[/latex]. Draw the graph.
[latex]P(x > 7) = 1 – P(x \lt 7)[/latex].
Since [latex]P(X \lt x) = 1 –e–mx[/latex] then [latex]P(X > x) = 1 –(1 –e–mx) = e-mx[/latex]
[latex]P(x > 7) = e(–0.1)(7) = 0.4966[/latex]. The probability that a computer part lasts more than seven years is 0.4966.
On the home screen, enter e^(-.1*7).
b. On the average, how long would five computer parts last if they are used one after another?
Solution
b. On the average, one computer part lasts ten years. Therefore, five computer parts, if they are used one right after the other, would last, on the average, (5)(10) = 50 years.
c. Eighty percent of computer parts last at most how long?
Solution
c. Find the 80th percentile. Draw the graph. Let k = the 80th percentile.
Solve for k: [latex]k=\frac{ln\left(1–0.80\right)}{–0.1}=16.1[/latex] years
Eighty percent of the computer parts last at most 16.1 years.
On the home screen, enter [latex]\frac{\mathrm{ln}\left(1–0.80\right)}{–0.1}[/latex]
d. What is the probability that a computer part lasts between nine and 11 years?
Solution
d. Find [latex]P(9 \lt x \lt 11)[/latex]. Draw the graph.
[latex]P(9 \lt x \lt 11) = P(x \lt 11) – P(x \lt 9) = (1 – e(–0.1)(11)) – (1 – e(–0.1)(9)) = 0.6671 – 0.5934 = 0.0737[/latex]. The probability that a computer part lasts between nine and 11 years is 0.0737.
On the home screen, enter e^(–0.1*9) – e^(–0.1*11).
Your Turn!
On average, a pair of running shoes can last 18 months if used every day. The length of time running shoes last is exponentially distributed. What is the probability that a pair of running shoes last more than 15 months? On average, how long would six pairs of running shoes last if they are used one after the other? Eighty percent of running shoes last at most how long if used every day?
Solution
[latex]P(x > 15) = 0.4346[/latex]
Six pairs of running shoes would last 108 months on average.
80th percentile = 28.97 months
Example
Suppose that the length of a phone call, in minutes, is an exponential random variable with decay parameter = [latex]\frac{1}{12}[/latex]. If another person arrives at a public telephone just before you, find the probability that you will have to wait more than five minutes. Let X = the length of a phone call, in minutes.
What is m, [latex]\mu[/latex], and [latex]\sigma[/latex]? The probability that you must wait more than five minutes is _______ .
Solution
- [latex]m=\frac{1}{12}[/latex]
- [latex]\mu = 12[/latex]
- [latex]\sigma = 12[/latex]
[latex]P(x > 5) = 0.6592[/latex]
Your Turn!
Suppose that the distance, in miles, that people are willing to commute to work is an exponential random variable with a decay parameter [latex]\frac{1}{20}[/latex]. Let X = the distance people are willing to commute in miles. What is m, μ, and σ? What is the probability that a person is willing to commute more than 25 miles?
Solution
[latex]m = \frac{1}{20}[/latex]; [latex]\mu = 20[/latex]; [latex]\sigma = 20[/latex]; [latex]P(x > 25) = 0.2865[/latex]
Example
The time spent waiting between events is often modeled using the exponential distribution. For example, suppose that an average of 30 customers per hour arrive at a store and the time between arrivals is exponentially distributed.
- On average, how many minutes elapse between two successive arrivals?
- When the store first opens, how long on average does it take for three customers to arrive?
- After a customer arrives, find the probability that it takes less than one minute for the next customer to arrive.
- After a customer arrives, find the probability that it takes more than five minutes for the next customer to arrive.
- Seventy percent of the customers arrive within how many minutes of the previous customer?
- Is an exponential distribution reasonable for this situation?
Solution
- Since we expect 30 customers to arrive per hour (60 minutes), we expect on average one customer to arrive every two minutes on average.
- Since one customer arrives every two minutes on average, it will take six minutes on average for three customers to arrive.
- Let X = the time between arrivals, in minutes. By part a, [latex]/mu = 2[/latex], so [latex]m = \frac{1}{2}[/latex] = 0.5.
Therefore, [latex]X \sim Exp(0.5)[/latex].
The cumulative distribution function is [latex]P(X \lt x) = 1 – e(–0.5x)e[/latex].
Therefore [latex]P(X \lt 1) = 1 – e(–0.5)(1) \approx{0.3935}[/latex].
- [latex]P(X > 5) = 1 – P(X \lt 5) = 1 – (1 – e(–5)(0.5)) = e–2.5 \approx{0.0821}[/latex].
- We want to solve [latex]0.70 = P(X < x)[/latex] for x.
Substituting in the cumulative distribution function gives [latex]0.70 = 1 – e–0.5x[/latex], so that [latex]e–0.5x = 0.30[/latex]. Converting this to logarithmic form gives [latex]–0.5x = ln(0.30)[/latex], or [latex]x=\frac{ln\left(0.30\right)}{–0.5}\approx 2.41[/latex] minutes.
Thus, seventy percent of customers arrive within 2.41 minutes of the previous customer.
You are finding the 70th percentile k so you can use the formula [latex]k= \frac{ln\left(1–Area_To_The_Left_Of_k\right)}{\left(–m\right)}[/latex]
[latex]k = \frac{ln\left(1–0.70\right)}{\left(–0.5\right)}\approx 2.41[/latex] minutes
- This model assumes that a single customer arrives at a time, which may not be reasonable since people might shop in groups, leading to several customers arriving at the same time. It also assumes that the flow of customers does not change throughout the day, which is not valid if some times of the day are busier than others.
Your Turn!
Suppose that on a certain stretch of highway, cars pass at an average rate of five cars per minute. Assume that the duration of time between successive cars follows the exponential distribution.
- On average, how many seconds elapse between two successive cars?
- After a car passes by, how long on average will it take for another seven cars to pass by?
- Find the probability that after a car passes by, the next car will pass within the next 20 seconds.
- Find the probability that after a car passes by, the next car will not pass for at least another 15 seconds.
Solution
- At a rate of five cars per minute, we expect [latex]\frac{60}{5}[/latex] = 12 seconds to pass between successive cars on average.
- Using the answer from part a, we see that it takes (12)(7) = 84 seconds for the next seven cars to pass by.
- Let T = the time (in seconds) between successive cars.
The mean of T is 12 seconds, so the decay parameter is [latex]\frac{1}{12}[/latex] and [latex]T \sim Exp(\frac{1}{12})[/latex]. The cumulative distribution function of T is [latex]P(T < t) = 1 – e^{-\frac{t}{12}}[/latex]. Then [latex]P(T \lt 20) = 1 –e^{-\frac{20}{12}} \approx{0.8111}[/latex].
[latex]P(T > 15) = 1 – P(T \lt 15) = 1 – (1 – {e}^{-\frac{15}{12}}) = {e}^{-\frac{15}{12}} \approx{0.2865}[/latex].
Memorylessness of the Exponential Distribution
In the first example, recall that the amount of time between customers is exponentially distributed with a mean of two minutes ([latex]X \sim Exp (0.5)[/latex]). Suppose that five minutes have elapsed since the last customer arrived. Since an unusually long amount of time has now elapsed, it would seem to be more likely for a customer to arrive within the next minute. With the exponential distribution, this is not the case–the additional time spent waiting for the next customer does not depend on how much time has already elapsed since the last customer. This is referred to as the memoryless property. Specifically, the memoryless property says that
[latex]P (X > r + t | X > r) = P (X > t) \text{ for all } r \ge 0 and t \ge 0[/latex]
For example, if five minutes has elapsed since the last customer arrived, then the probability that more than one minute will elapse before the next customer arrives is computed by using [latex]r = 5[/latex] and [latex]t = 1[/latex] in the foregoing equation.
[latex]P(X > 5 + 1 | X > 5) = P(X > 1) = {e}^{(–0.5)(1)} \approx{0.6065}[/latex]
This is the same probability as that of waiting more than one minute for a customer to arrive after the previous arrival.
The exponential distribution is often used to model the longevity of an electrical or mechanical device. In [link], the lifetime of a certain computer part has the exponential distribution with a mean of ten years ([latex]X \sim Exp(0.1)[/latex]). The memoryless property says that knowledge of what has occurred in the past has no effect on future probabilities. In this case it means that an old part is not any more likely to break down at any particular time than a brand new part. In other words, the part stays as good as new until it suddenly breaks. For example, if the part has already lasted ten years, then the probability that it lasts another seven years is [latex]P(X > 17|X > 10) = P(X > 7) = 0.4966[/latex].
Example
Refer to [link] where the time a postal clerk spends with his or her customer has an exponential distribution with a mean of four minutes. Suppose a customer has spent four minutes with a postal clerk. What is the probability that he or she will spend at least an additional three minutes with the postal clerk?
The decay parameter of X is [latex]m = \frac{1}{4} = 0.25[/latex], so [latex]X \sim Exp(0.25)[/latex].
The cumulative distribution function is [latex]P(X \lt x) = 1 – e–0.25x[/latex].
We want to find [latex]P(X > 7|X > 4)[/latex]. The memoryless property says that [latex]P(X > 7|X > 4) = P (X > 3)[/latex], so we just need to find the probability that a customer spends more than three minutes with a postal clerk.
This is [latex]P(X > 3) = 1 – P (X \lt 3) = 1 – (1 – e–0.25⋅3) = e–0.75 ≈\approx{0.4724}[/latex].
[latex]1–(1–e^{–0.25*2}) = e^{–0.25*2}[/latex]
Your Turn!
Suppose that the longevity of a light bulb is exponential with a mean lifetime of eight years. If a bulb has already lasted 12 years, find the probability that it will last a total of over 19 years.
Solution
Let T = the lifetime of the light bulb. Then [latex]T \sim Exp(\frac{1}{8})[/latex].
The cumulative distribution function is [latex]P (T \lt t) = 1 − {e}^{-\frac{t}{8}}[/latex].
We need to find [latex]P(T > 19|T = 12)[/latex]. By the memoryless property,
[latex]P(T>19|T = 12) = P(T > 7) = 1 – P(T \lt 7) = 1 – (1 – e^{-\frac{7}{8}})= e^{-\frac{7}{8}}\approx{0.4169}[/latex].
Relationship between the Poisson and the Exponential Distribution
There is an interesting relationship between the exponential distribution and the Poisson distribution. Suppose that the time that elapses between two successive events follows the exponential distribution with a mean of [latex]\mu[/latex] units of time. Also assume that these times are independent, meaning that the time between events is not affected by the times between previous events. If these assumptions hold, then the number of events per unit time follows a Poisson distribution with mean [latex]\lambda = \frac{1}{\mu}[/latex]. Recall from the chapter on Discrete Random Variables that if X has the Poisson distribution with mean [latex]\lambda[/latex], then [latex]P\left(X=k\right)=\frac{{\lambda }^{k}{e}^{-\lambda }}{k!}[/latex]. [latex](k! = k \cdot (k-1) \cdot (k-2) \cdot (k-3) ... 3 \cdot 2 \cdot 1)[/latex] Conversely, if the number of events per unit time follows a Poisson distribution, then the amount of time between events follows the exponential distribution.
Suppose X has the Poisson distribution with mean [latex]\lambda[/latex]. Compute [latex]P(X = k)[/latex] by entering 2nd, VARS(DISTR), C: poissonpdf([latex]\lambda[/latex], k). To compute [latex]P(X ≤ k)[/latex], enter 2nd, VARS (DISTR), D:poissoncdf([latex]\lambda[/latex], k).
Example
At a police station in a large city, calls come in at an average rate of four calls per minute. Assume that the time that elapses from one call to the next has the exponential distribution. Take note that we are concerned only with the rate at which calls come in, and we are ignoring the time spent on the phone. We must also assume that the times spent between calls are independent. This means that a particularly long delay between two calls does not mean that there will be a shorter waiting period for the next call. We may then deduce that the total number of calls received during a time period has the Poisson distribution.
- Find the average time between two successive calls.
- Find the probability that after a call is received, the next call occurs in less than ten seconds.
- Find the probability that exactly five calls occur within a minute.
- Find the probability that less than five calls occur within a minute.
- Find the probability that more than 40 calls occur in an eight-minute period.
Solution
- On average there are four calls that occur per minute, so 15 seconds, or [latex]\frac{15}{60}[/latex] = 0.25 minutes, occur between successive calls on average.
- Let T = time elapsed between calls. From part a, μ = 0.25, so m = [latex]\frac{1}{0.25}[/latex] = 4. Thus, T ∼ Exp(4).
The cumulative distribution function is P(T < t) = 1 – e–4t.
The probability that the next call occurs in less than ten seconds (ten seconds = 1/6 minute) is [latex]P\left(T\text{ < }\frac{1}{6}\right)=1–{e}^{–4\frac{1}{6}}\approx 0.4866.[/latex]
- Let X = the number of calls per minute. As previously stated, the number of calls per minute has a Poisson distribution, with a mean of four calls per minute.
Therefore, X ∼ Poisson(4), and so P(X = 5) = [latex]\frac{{4}^{5}{e}^{-4}}{5!}[/latex] ≈ 0.1563. (5! = (5)(4)(3)(2)(1))
poissonpdf(4, 5) = 0.1563.
- Keep in mind that X must be a whole number, so P(X < 5) = P(X ≤ 4).
To compute this, we could take P(X = 0) + P(X = 1) + P(X = 2) + P(X = 3) + P(X = 4).
Using technology, we see that P(X ≤ 4) = 0.6288.
poisssoncdf(4, 4) = 0.6288
- Let Y = the number of calls that occur during an eight minute period.
Since there is an average of four calls per minute, there is an average of (8)(4) = 32 calls during each eight minute period.
Hence, Y ∼ Poisson(32). Therefore, P(Y > 40) = 1 – P (Y ≤ 40) = 1 – 0.9294 = 0.0707.
1 – poissoncdf(32, 40). = 0.0707
Your Turn!
In a small city, the number of automobile accidents occur with a Poisson distribution at an average of three per week.
- Calculate the probability that there are at most 2 accidents that occur in any given week.
- What is the probability that there is at least two weeks between any 2 accidents?
Solution
- Let X = the number of accidents per week, so that X ∼ Poisson(3). We need to find P(X ≤ 2) ≈ 0.4232
poissoncdf(3, 2)
- Let T = the time (in weeks) between successive accidents.
Since the number of accidents occurs with a Poisson distribution, the time between accidents follows the exponential distribution.
If there are an average of three per week, then on average there is μ = [latex]\frac{1}{3}[/latex] of a week between accidents, and the decay parameter is m = [latex]\frac{1}{\left(\frac{1}{3}\right)}[/latex]
= 3.To find the probability that there are at least two weeks between two accidents, P(T > 2) = 1 – P(T < 2) = 1 – (1 – e(–3)(2)) = e–6 ≈ 0.0025.
e^(-3*2).
a continuous random variable (RV) that appears when we are interested in the intervals of time between some random events, for example, the length of time between emergency arrivals at a hospital; the notation is X ~ Exp(m). The mean is μ = 1m and the standard deviation is σ = 1m. The probability density function is f(x) = me−mx, x ≥ 0 and the cumulative distribution function is P(X ≤ x) = 1 − e−mx.
The decay parameter describes the rate at which probabilities decay to zero for increasing values of x. It is the value m in the probability density function f(x) = me(-mx) of an exponential random variable. It is also equal to m = [latex]\frac{1}{\mu }[/latex], where μ is the mean of the random variable.
For an exponential random variable X, the memoryless property is the statement that knowledge of what has occurred in the past has no effect on future probabilities. This means that the probability that X exceeds x + k, given that it has exceeded x, is the same as the probability that X would exceed k if we had no knowledge about it. In symbols we say that P(X > x + k|X > x) = P(X > k).
A discrete random variable that counts the number of times a certain event will occur in a specific interval; characteristics of the variable:
• The probability that the event occurs in a given interval is the same for all intervals.
• The events occur with a known mean and independently of the time since the last event.
The distribution is defined by the mean μ of the event in the interval. Notation: X ~ P(μ). The mean is μ = np. The standard deviation is [latex]\sigma \text{ = }\sqrt{\mu }[/latex]. The probability of having exactly x successes in r trials is P(X = x) = [latex]\left({e}^{-\mu }\right)\frac{{\mu }^{x}}{x!}[/latex]. The Poisson distribution is often used to approximate the binomial distribution, when n is “large” and p is “small” (a general rule is that n should be greater than or equal to 20 and p should be less than or equal to 0.05).
The occurrence of one event has no effect on the probability of the occurrence of another event. Events A and B are independent if one of the following is true:
• P(A|B) = P(A)
• P(B|A) = P(B)
• P(A AND B) = P(A)P(B)
A discrete random variable that counts the number of times a certain event will occur in a specific interval; characteristics of the variable:
• The probability that the event occurs in a given interval is the same for all intervals.
• The events occur with a known mean and independently of the time since the last event.
The distribution is defined by the mean μ of the event in the interval. Notation: X ~ P(μ). The mean is μ = np. The standard deviation is [latex]\sigma \text{ = }\sqrt{\mu }[/latex]. The probability of having exactly x successes in r trials is P(X = x) = [latex]\left({e}^{-\mu }\right)\frac{{\mu }^{x}}{x!}[/latex]. The Poisson distribution is often used to approximate the binomial distribution, when n is “large” and p is “small” (a general rule is that n should be greater than or equal to 20 and p should be less than or equal to 0.05).
