Back to Gram-Schmidt Orthogonalization

Exercise 14

Avg difficulty 3.0

Bessel’s Inequality. Consider these orthonormal sets

B1={e⃗1}B2={e⃗1,e⃗2}B3={e⃗1,e⃗2,e⃗3}B4={e⃗1,e⃗2,e⃗3,e⃗4}B_{1}=\text{$\{\hskip 1.00006pt\vec{e}_{1}\hskip 1.00006pt\}$}\quad B_{2}=\text{$\{\hskip 1.00006pt\vec{e}_{1},\vec{e}_{2}\hskip 1.00006pt\}$}\quad B_{3}=\text{$\{\hskip 1.00006pt\vec{e}_{1},\vec{e}_{2},\vec{e}_{3}\hskip 1.00006pt\}$}\quad B_{4}=\text{$\{\hskip 1.00006pt\vec{e}_{1},\vec{e}_{2},\vec{e}_{3},\vec{e}_{4}\hskip 1.00006pt\}$}

along with the vector v⃗∈R4\vec{v}\in\mathbb{R}^{4} whose components are 44, 33, 22, and 11.

  • Find the coefficient c1c_{1} for the projection of v⃗\vec{v} into the span of the vector in B1B_{1}. Check that ∣v⃗ ∣2≥∣c1∣2\lvert\vec{v}\,\rvert^{2}\geq\lvert c_{1}\rvert^{2}.

  • Find the coefficients c1c_{1} and c2c_{2} for the projection of v⃗\vec{v} into the spans of the two vectors in B2B_{2}. Check that ∣v⃗ ∣2≥∣c1∣2+∣c2∣2\lvert\vec{v}\,\rvert^{2}\geq\lvert c_{1}\rvert^{2}+\lvert c_{2}\rvert^{2}.

  • Find c1c_{1}, c2c_{2}, and c3c_{3} associated with the vectors in B3B_{3}, and c1c_{1}, c2c_{2}, c3c_{3}, and c4c_{4} for the vectors in B4B_{4}. Check that ∣v⃗ ∣2≥∣c1∣2+⋯+∣c3∣2\lvert\vec{v}\,\rvert^{2}\geq\lvert c_{1}\rvert^{2}+\dots+\lvert c_{3}\rvert^{2} and that ∣v⃗ ∣2≥∣c1∣2+⋯+∣c4∣2\lvert\vec{v}\,\rvert^{2}\geq\lvert c_{1}\rvert^{2}+\dots+\lvert c_{4}\rvert^{2}.

Show that this holds in general: where {κ⃗1,…,κ⃗k}\{\hskip 1.00006pt\vec{\kappa}_{1},\ldots,\vec{\kappa}_{k}\hskip 1.00006pt\} is an orthonormal set and cic_{i} is coefficient of the projection of a vector v⃗\vec{v} from the space then ∣v⃗ ∣2≥∣c1∣2+⋯+∣ck∣2\lvert\vec{v}\,\rvert^{2}\geq\lvert c_{1}\rvert^{2}+\dots+\lvert c_{k}\rvert^{2}. Hint. One way is to look at the inequality 0≤∣v⃗−(c1κ⃗1+⋯+ckκ⃗k)∣20\leq\lvert\vec{v}-(c_{1}\vec{\kappa}_{1}+\dots+c_{k}\vec{\kappa}_{k})\rvert^{2} and expand the cc’s.

Hefferon, Linear Algebra, Maps Between Spaces, Gram-Schmidt Orthogonalization, Exercise 14

AI Tutor

Adapted from Linear Algebra © 2016 Jim Hefferon. Licensed under CC BY-SA 3.0 US. Source: Linear Algebra. Imported at revision df2262e.