Nonhomogeneous Poisson Processes

A non-homogeneous Poisson process is similar to an ordinary Poisson process, except that the average rate of arrivals is allowed to vary with time. Many applications that generate random points in time are modeled more faithfully with such non-homogeneous processes. The mathematical cost of this generalization, however, is that we lose the property of stationary increments.

Non-homogeneous Poisson processes are best described in measure-theoretic terms. Thus, you may need to review the sections measure theory, probability measures, and distribution functions. Our basic measure space in this section is

[0, \infty)

With the

σ

-algebra of Borel measurable subsets (named for Émile Borel). As usual,

λ

denotes Lebesgue measure on this space, named for Henri Lebesgue. Recall that the Borel

σ

-algebra is the one generated by the intervals, and

λ

is the generalization of length on intervals.

Definition and Basic Properties

Of all of our various characterizations of the ordinary Poisson process, in terms of the inter-arrival times, the arrival times, and the counting process, the characterizations involving the counting process leads to the most natural generalization to non-homogeneous processes.

Consider a process that generates random points in time. As usual, let $N_{t}$ denote the number of random points in the interval $(0, t]$ for $t \in [0, \infty)$ , so that $N = {N_{t} : t \geq 0}$ is the counting process. More generally, $N (A)$ denotes the number of random points in $A$ . for measurable $A \subseteq [0, \infty)$

N

is a random counting measure, and as before,

t \mapsto N_{t}

is a (random) distribution function and

A \mapsto N (A)

is the (random) measure associated with this distribution function.

Suppose now that $r : [0, \infty) \to [0, \infty)$ is measurable.

Define $m : [0, \infty) \to [0, \infty)$ by $m (t) = \int_{0}^{t} r (s) d s$ Then $m$ is increasing and right-continuous on $[0, \infty)$ and hence is distribution function.
The positive measure on $[0, \infty)$ associated with $m$ (also denoted by $m$ ) is defined for measurable $A \subseteq [0, \infty)$ by $m (A) = \int_{A} r (s) d s$ The measure $m$ is absolutely continuous with respect to $λ$ , and with density function $r$ .

Details:

Technically, the integrals are Lebesgue integrals (integrals with respect to $λ$ ). The properties of $m$ follow from general properties of the integral,

m (t) = m (0, t]

, and for

s, t \in [0, \infty)

with

s < t

m (s, t] = m (t) - m (s)

. Note the parallels between the random distribution function and measure

N

and the deterministic distribution function and measure

m

. With the setup involving

r

and

m

complete, we are ready for our main definition.

A process that produces random points in time is a non-homogeneous Poisson process with rate function $r$ if the counting process $N$ satisfies the following properties:

If ${A_{i} : i \in I}$ is a countable, disjoint collection of measurable subsets of $[0, \infty)$ then ${N (A_{i}) : i \in I}$ is a collection of independent random variables.
If $A \subseteq [0, \infty)$ is measurable then $N (A)$ has the Poisson distribution with parameter $m (A)$ : $P [N (A) = n] = e^{- m (A)} \frac{[m (A)]^{n}}{n!}, n \in N$

Property (a) is our usual property of independent increments, while property (b) is a natural generalization of the property of Poisson distributed increments. Clearly, if

r

is a positive constant, then

m (t) = r t

for

t \in [0, \infty)

and as a measure,

m

is proportional to Lebesgue measure

λ

. In this case, the non-homogeneous process reduces to an ordinary, homogeneous Poisson process with rate

r

. However, if

r

is not constant, then

m

is not linear, and as a measure, is not proportional to Lebesgue measure. In this case, the process does not have stationary increments with respect to

λ

, but does of course, have stationary increments with respect to

m

. That is, if

A, B

are measurable subsets of

[0, \infty)

and

λ (A) = λ (B)

then

N (A)

and

N (B)

will not in general have the same distribution, but of course they will have the same distribution if

m (A) = m (B)

In particular, recall that the parameter of the Poisson distribution is both the mean and the variance.

The function $m$ is called the mean function.

$E [N (A)] = var [N (A)] = m (A)$ for measurable $A \subseteq [0, \infty)$
$E (N_{t}) = var (N_{t}) = m (t)$ for $t \in [0, \infty)$ .

Since

m^{'} (t) = r (t)

(if

r

is continuous at

t

), it makes sense to refer to

r

as the rate function. Locally, at

t

, the arrivals are occurring at an average rate of

r (t)

per unit time. As before, from a modeling point of view, the property of independent increments can reasonably be evaluated. But we need something more primitive to replace the property of Poisson increments. Here is the main theorem.

A process that produces random points in time is a non-homogeneous Poisson process with rate function $r$ if and only if the counting process $N$ satisfies the following properties:

If ${A_{i} : i \in I}$ is a countable, disjoint collection of measurable subsets of $[0, \infty)$ then ${N (A_{i}) : i \in I}$ is a set of independent variables.
For $t \in [0, \infty)$ , $\begin{aligned} \frac{P [N (t, t + h] = 1]}{h} \to r (t) as h ↓ 0 \\ \frac{P [N (t, t + h] > 1]}{h} \to 0 as h ↓ 0 \end{aligned}$

So if

h

is small the probability of a single arrival in

[t, t + h)

is approximately

r (t) h

, while the probability of more than 1 arrival in this interval is negligible.

Arrival Times and Time Change

Suppose that we have a non-homogeneous Poisson process as defined in [1], [2], and [3], with continuous rate function

r

. As with the ordinary Poisson process, we have an inverse relation between the counting process and the arrival time sequence

Let $T_{0} = 0$ and let $T_{n}$ denote the time of the $n$ th arrival for $n \in N_{+}$ . The counting process $N = {N_{t} : t \in [0, \infty)}$ and the arrival time sequence $T = {T_{n} : n \in N}$ are related as follow:

$T_{n} = min {t \in [0, \infty) : N_{t} = n}$ for $n \in N$
$N_{t} = # {n \in N : T_{n} \leq t}$ for $t \in [0, \infty)$
${T_{n} \leq t} = {N_{t} \geq n}$ for $n \in N$ and $t \in [0, \infty)$ .

Details:

Both events in part (c) mean that there are at least $n$ random points in $(0, t]$ .

For $n \in N_{+}$ , $T_{n}$ has probability density function $f_{n}$ given by $f_{n} (t) = \frac{m^{n - 1} (t)}{(n - 1)!} r (t) e^{- m (t)}, t \in [0, \infty)$

Details:

From [6] the distribution function of $T_{n}$ is $P (T_{n} \leq t) = P (N_{t} \geq n) = \sum_{k = n}^{\infty} e^{- m (t)} \frac{m^{k} (t)}{k!}, t \in [0, \infty)$ Differentiating with respect to $t$ gives $f_{n} (t) = \sum_{k = n}^{\infty} [- m^{'} (t) e^{- m (t)} \frac{m^{k} (t)}{k!} + e^{- m (t)} \frac{k m^{k - 1} (t) m^{'} (t)}{k!}] = r (t) e^{- m (t)} \sum_{k = n}^{\infty} [\frac{m^{k - 1} (t)}{(k - 1)!} - \frac{m^{k} (t)}{k!}]$ The last sum collapses to $m^{n - 1} (t) / (n - 1)!$ .

In particular,

T_{1}

has probability density function

f_{1}

given by

f_{1} (t) = r (t) e^{- m (t)}, t \in [0, \infty)

Recall that in reliability terms,

r

is the failure rate function,

m

is the cumulative failure rate function, and the reliability function is the right distribution function:

F_{1}^{c} (t) = P (T_{1} > t) = e^{- m (t)}, t \in [0, \infty)

In general, the functional form of

f_{n}

is clearly similar to the probability density function of the gamma distribution, and indeed,

T_{n}

can be transformed into a random variable with a gamma distribution. This amounts to a time change which will give us additional insight into the non-homogeneous Poisson process.

Let $U_{n} = m (T_{n})$ for $n \in N_{+}$ . Then $U_{n}$ has the gamma distribution with shape parameter $n$ and rate parameter $1$

Details:

Let $g_{n}$ denote the PDF of $U_{n}$ . Since $m$ is strictly increasing and differentiable, we can use the standard change of variables formula. So letting $u = m (t)$ , the relationship is $g_{n} (u) = f_{n} (t) \frac{d t}{d u}$ Simplifying gives $g_{n} (u) = u^{n - 1} e^{- u} / (n - 1)!$ for $u \in [0, \infty)$ .

So the time change

u = m (t)

transforms the non-homogeneous Poisson process into a standard (rate 1) Poisson process. Here is an equivalent way to look at the time change result.

For $u \in [0, \infty)$ , let $M_{u} = N_{t}$ where $t = m^{- 1} (u)$ . Then ${M_{u} : u \in [0, \infty)}$ is the counting process for a standard, rate 1 Poisson process.

Details:

Suppose that $(u_{1}, u_{2}, \dots)$ os a sequence of points in $[0, \infty)$ with $0 \leq u_{1} < u_{2} < \dots$ . Since $m^{- 1}$ is strictly increasing, we have $0 \leq t_{1} < t_{2} < \dots$ , where of course $t_{i} = m^{- 1} (u_{i})$ . By assumption, the sequence of random variables $(N_{t_{1}}, N_{t_{2}} - N_{t_{1}}, \dots)$ is independent, but this is also the sequence $(M_{u_{1}}, M_{u_{2}} - M_{u_{1}}, \dots)$ .
Suppose that $u, v \in [0, \infty)$ with $u < v$ , and let $s = m^{- 1} (u)$ and $t = m^{- 1} (v)$ . Then $s < t$ and so $M_{v} - M_{u} = N_{t} - N_{s}$ has the Poisson distribution with parameter $m (t) - m (s) = v - u$ .

Equivalently, we can transform a standard (rate 1) Poisson process into a a non-homogeneous Poisson process with a time change.

Suppose that $M = {M_{u} : u \in [0, \infty)}$ is the counting process for a standard Poisson process, and let $N_{t} = M_{m (t)}$ for $t \in [0, \infty)$ . Then ${N_{t} : t \in [0, \infty)}$ is the counting process for a non-homogeneous Poisson process with mean function $m$ (and rate function $r$ ).

Details:

Let $(t_{1}, t_{2}, \dots)$ be a sequence of points in $[0, \infty)$ with $0 \leq t_{1} < t_{2} < \dots$ . Since $m$ is strictly increasing, we have $0 \leq m (t_{1}) < m (t_{2}) < \dots$ . Hence $(M_{m (t_{1})}, M_{m (t_{2})} - M_{m (t_{1})}, \dots)$ is a sequence of independent variables. But this sequence is simply $(N_{t_{1}}, N_{t_{2}} - N_{t_{1}}, \dots)$ .
If $s, t \in [0, \infty)$ with $s < t$ . Then $N_{t} - N_{s} = M_{m (t)} - M_{m (s)}$ has the Poisson distribution with parameter $m (t) - m (s)$ .

6. Non-homogeneous Poisson Processes

Basic Theory

Definition and Basic Properties

Arrival Times and Time Change