last updated: May 1, 2025

Stochastic Processes and Financial Mathematics
(part one)

4.2 Urn processes

Urn processes are ‘balls in bags’ processes. In the simplest kind of urn process, which we look at in this section, we have just a single urn (i.e. bag) that contains balls of two different colours.

At time 0, an urn contains 1 black ball and 1 red ball. Then, for each n=1,2,, we generate the state of the urn at time n by doing the following:

  • 1. Draw a ball from the urn, look at its colour, and return this ball to the urn.

  • 2. Add a new ball of the same colour as the drawn ball.

So, at time n (which means: after the nth iteration of the above steps is completed) there are n+2 balls in the urn. This process is known as the Pólya urn. Pólya was a Hungarian mathematician who made contributions across a wide spectrum mathematics, in the first half of the 20th century.

Let Bn be the number of red balls in the urn at time n, and note that B0=1. Set (Fn) to be the filtration generated by (Bn).

Our first step is to note that Bn itself is not a martingale. The reason is that over time we will put more and more red balls into the urn, so the number of red balls drifts upwards over time. Formally, we can note that

E[Bn+1|Fn]=E[Bn+1𝟙{(n+1)th draw is red}|Fn]+E[Bn+1𝟙{(n+1)th draw is black}|Fn]=E[(Bn+1)𝟙{(n+1)th draw is red}|Fn]+E[Bn𝟙{(n+1)th draw is black}|Fn]=(Bn+1)E[𝟙{(n+1)th draw is red}|Fn]+BnE[𝟙{(n+1)th draw is black}|Fn]=(Bn+1)Bnn+2+Bn(1Bnn+2)(4.4)=Bn(n+3)n+2>Bn. We do have BnmFn and since 1Bnn+2 we also have BnL1, so Bn is a submartingale, but due to (4.4) Bn is not a martingale.

However, a closely related quantity is a martingale. Let

Mn=Bnn+2.

Then Mn is the proportion of balls in the urn that are red, at time n. Note that Mn[0,1]. We can think of the extra factor n+2, which increases over time, as an attempt to cancel out the upwards drift of Bn. We now have:

E[Mn+1|Fn]=E[Mn+1𝟙{(n+1)th draw is red}|Fn]+E[Mn+1𝟙{(n+1)th draw is black}|Fn]=E[Bn+1n+3𝟙{(n+1)th draw is red}|Fn]+E[Bnn+3𝟙{(n+1)th draw is black}|Fn]=Bn+1n+3E[𝟙{(n+1)th draw is red}|Fn]+Bnn+3E[𝟙{(n+1)th draw is black}|Fn]=Bn+1n+3Bnn+2+Bnn+3(1Bnn+2)=Bn2+Bn(n+2)(n+3)+(n+2)BnBn2(n+2)(n+3)=(n+3)Bn(n+2)(n+3)=Bnn+2=Mn. We have MnmFn and since Mn[0,1] we have that MnL1. Hence (Mn) is a martingale.

We can think of Mn=Bnn+2 as a compensation mechanism; Bn tends to increase, and we compensate for this increase by dividing by n+2.

  • Remark 4.2.1 The calculation of E[Mn+1|Fn] is written out in full as a second example of the method. In fact, we could simply have divided the equality in (4.4) by n+3, and obtained E[Mn+1|Fn]=Mn.

On fairness

It is clear that the symmetric random walk is fair; at all times it is equally likely to move up as down. The asymmetric random walk is not fair, due to its drift (4.2), but once we compensate for drift in (4.3) we do still obtain a martingale.

Then urn process requires more careful thought. For example, we might wonder:

Suppose that the first draw is red. Then, at time n=1 we have two red balls and one black ball. So, the chance of drawing a red ball is now 23. How is this fair?!

To answer this question, let us make a number of points. Firstly, let us remind ourselves that the quantity which is a martingale is Mn, the proportion of red balls in the urn.

Secondly, suppose that the first draw is indeed red. So, at n=1 we have 2 red and 1 black, giving a proportion of 23 red and 13 black. The expected fraction of red balls after the next (i.e. second) draw is

23(2+1)4+1324=6+212=23

which is of course equal to the proportion of red balls that we had at n=1.

Lastly, note that it is equally likely that, on the first go, you’d pick out a black. So, starting from n=0 and looking forwards, both colors have equally good chances of increasing their own numbers. In fact, if we were to pretend, right from the start, that black was red, and red was black, we would see the same urn process. This type of fairness is known as symmetry. We’ve seen that Bn tends to increase (because we keep adding more balls), and we can think of Mn as a way of discovering the fairness ‘hiding’ inside of Bn.

To sum up: in life there are different ways to think of ‘fairness’ – and what we need to do here is get a sense for precisely what kind of fairness martingales characterize. The fact that (Mn) is a martingale does not prevent us from (sometimes) ending up with many more red balls than black, or vice versa. It just means that, when viewed in terms of (Mn), there is no bias towards red of black inherent in the rules of the game.