SigmaField
Mathematical Foundations for Quant Finance
0 of 256 lessons

Proof Gym PG4 ε–δ limits Lesson 1 of 6

ProofLesson PG4.1 in the Proof Gym, stage PG4: ε–δ limits. About 40 minutes.

What a limit means: ε and N

Simulate

Check the claim with numbers

Lesson 2.1.3 found that 3x+1x+2\frac{3x + 1}{x + 2} heads for 3 as xx grows, missing it by 5x+2\frac{5}{x + 2}. Take it as a sequence, an=3n+1n+2a_n = \frac{3n + 1}{n + 2} for whole numbers n≥1n \ge 1. Lesson 1.5.1 said what an→3a_n \to 3 means: for every tolerance, from some term on, every term is that close to 3.

The cell tests exactly that. For three tolerances it finds the last term outside the band, checking 20,000 terms with exact fractions.

⌘/Ctrl + Enter runs the cell

The last term outside is n=48n = 48 for 0.1, 498 for 0.01 and 4998 for 0.001. Each is the nn where the miss 5n+2\frac{5}{n + 2} equals the tolerance. A smaller tolerance needs a later start, but some start always seems to work.

A sequence with no limit fails the test. The terms of (−1)n(-1)^n jump between −1-1 and 1 for ever (lesson 1.5.1).

⌘/Ctrl + Enter runs the cell

Take the tolerance 0.5. For L=1L = 1 every odd term stays outside the band, for L=−1L = -1 every even one, and for L=0L = 0 all of them. No LL can work: the band is 1 wide, and the terms are 2 apart.

Conjecture

3n+1n+2→3as n→∞\frac{3n + 1}{n + 2} \to 3 \quad \text{as } n \to \infty

Three tolerances worked, each from some term on. A proof must handle every tolerance, however small, with a rule that names the starting term.

The definition

Lesson 1.5.1 described a limit in words. The precise version names the tolerance ε\varepsilon (the Greek letter epsilon) and the starting term NN.

Rule: Limit of a sequence

an→L means: for every ε>0there is a whole number N with∣an−L∣<ε for every n>N\begin{gathered} a_n \to L \text{ means: for every } \varepsilon > 0 \\ \text{there is a whole number } N \text{ with} \\ |a_n - L| < \varepsilon \text{ for every } n > N \end{gathered}

∣an−L∣<ε|a_n - L| < \varepsilon says that ana_n lies strictly between L−εL - \varepsilon and L+εL + \varepsilon (lesson 0.3.3). The number NN may depend on ε\varepsilon, and usually does.

Read it as a game, in which a challenger names a tolerance ε>0\varepsilon > 0. You must answer with a whole number NN such that every term after the NN-th is within ε\varepsilon of LL. The limit is LL if you can always answer.

The order matters: ε\varepsilon comes first, and NN is chosen after it. Stage PG1 practised reading statements of this shape.

The simulation found the smallest answers, 48, 498 and 4998. Any larger NN works too, since the terms after it are among those already checked. So a proof may pick a convenient NN, not the smallest one.

Writing an ε–N proof

First comes scratch work, which is not part of the proof. Work out the distance ∣an−L∣|a_n - L|, and find which nn make it less than ε\varepsilon. For our sequence, 3−an=5n+23 - a_n = \frac{5}{n + 2}, and 5n+2<ε\frac{5}{n + 2} < \varepsilon when n+2>5εn + 2 > \frac{5}{\varepsilon}.

Then write the proof. Start from "let ε>0\varepsilon > 0", name NN in terms of ε\varepsilon, and show that every n>Nn > N works. Here any whole number N≥5εN \ge \frac{5}{\varepsilon} will do: it is a little larger than needed, and simpler.

Such an NN exists for every ε\varepsilon, because some whole number is larger than any given real number. This is the Archimedean property; lesson PG4.4 proves it from the completeness of the real numbers.

Try it

The cell takes NN to be the smallest whole number at least 5ε\frac{5}{\varepsilon}, which math.ceil computes. For each tolerance it then checks the next 10,000 terms after the NN-th.

All three print True, with N=50N = 50, 500 and 5000.

⌘/Ctrl + Enter runs the cell

Format 1

Reorder the steps

Here is the ε–N proof of the conjecture, with its lines shuffled. Put them in order with the arrows, or drag a line by its handle.

  1. For this nn, ∣an−3∣=∣3n+1−3(n+2)n+2∣=5n+2|a_n - 3| = \left| \dfrac{3n + 1 - 3(n + 2)}{n + 2} \right| = \dfrac{5}{n + 2}.
  2. By the Archimedean property, choose a whole number NN with N≥5εN \ge \dfrac{5}{\varepsilon}.
  3. So ∣an−3∣<ε|a_n - 3| < \varepsilon for every n>Nn > N. As ε>0\varepsilon > 0 was arbitrary, an→3a_n \to 3.
  4. Now take any whole number n>Nn > N.
  5. Since n+2>N≥5εn + 2 > N \ge \dfrac{5}{\varepsilon}, this is less than 5÷5ε=ε5 \div \dfrac{5}{\varepsilon} = \varepsilon.
  6. Let ε>0\varepsilon > 0 be given.

Bound, do not solve

Solving ∣an−L∣<ε|a_n - L| < \varepsilon exactly can be hard. It is enough to find a simpler expression that is larger than the distance and still tends to 0.

Take an=n2+1n2+na_n = \frac{n^2 + 1}{n^2 + n}, which tends to 1. Making its distance from 1 less than ε\varepsilon exactly means solving a quadratic inequality. Instead, compare the distance with 1n\frac{1}{n}.

Try it

The distance stays below 1n\frac{1}{n}: 0.081818 against 0.1 at n=10n = 10, and 0.000998 against 0.001 at n=1000n = 1000. At n=1n = 1 it is 0, since a1=1a_1 = 1.

With tolerance 0.001 the last term outside the band is n=997n = 997. The bound 1n\frac{1}{n} asks for n>1000n > 1000, a little later, and that is allowed.

⌘/Ctrl + Enter runs the cell

Format 2

Fill the gap

The proof that an=n2+1n2+n→1a_n = \frac{n^2 + 1}{n^2 + n} \to 1, with its key steps left out. Type each missing piece in nn, or as a number, then check.

For every n≥1n \ge 1, 1−an=1 - a_n = . Its top is at least 0 and its bottom is positive, so this is also the distance ∣an−1∣|a_n - 1|.

Replace the top by the bigger nn, and the bottom by the smaller n2n^2. That gives ∣an−1∣<|a_n - 1| < , for every n≥1n \ge 1.

Now let ε>0\varepsilon > 0, and choose a whole number N≥1εN \ge \frac{1}{\varepsilon}. For every n>Nn > N, ∣an−1∣<1n<1N≤ε|a_n - 1| < \frac{1}{n} < \frac{1}{N} \le \varepsilon. So an→1a_n \to 1.

For example, with ε=0.001\varepsilon = 0.001 this proof takes N=N = . The cell found that 997 would do, but a larger NN is fine.

How to type answers
  • Powers with ^, brackets round a power that is a sum: r^k, r^(k+1).
  • Fractions with / and brackets: (1-r)/(1+r). Multiply with * or side by side: 2k+1.
  • Press Enter in any box to check them all.

Format 3

Find the error

A proof of a false claim. One line claims more than the lines before it have shown. Select it.

Summary card

  • an→La_n \to L means: for every ε>0\varepsilon > 0 there is a whole number NN with ∣an−L∣<ε|a_n - L| < \varepsilon for every n>Nn > N. NN may depend on ε\varepsilon.
  • To prove a limit, find NN from ε\varepsilon in scratch work. The proof names NN and checks every n>Nn > N.
  • Any larger NN works too, so bound the distance by something simpler, such as 1n\frac{1}{n}.
  • Some whole number exceeds any real number (the Archimedean property, lesson PG4.4), so the NN always exists.
  • A sequence has no limit LL if one ε\varepsilon defeats every NN: for (−1)n(-1)^n, ε=0.5\varepsilon = 0.5 does.

Free further reading

Optional. This lesson covers what you need; these add more examples and practice. All are free to read.