C S C I     5 3 0 4


Lecture Notes

Note: Reduced means 4 viewgraphs per page. Full size is one per page.
[ For any problems send me e-mail ! ]

• Set number 14 : Full size: PDF.   Reduced: PDF .   Posted on: Mon Dec 9 06:02:57 CST 2019
  Topics: [Last set of notes] Large Sparse eigenvalue problems; Rayleigh-Ritz projection; Subspace iteration; Lanczos algorithms; Loss of orthogonality; Golub-Kahan-Lanczos bidiagonalization.
      Supplement: Solutions to exercises and more. PDF    

• Set number 13 : Full size: PDF.   Reduced: PDF .   Posted on: Wed Nov 20 16:10:10 CST 2019
  Topics: Eigenvalue problems (continued); The QR algorithm; Practical variants; Symmetric eigenvalue problems -Min-max theorem; The law of intertia; The QR algorithm for symmetric matrices; The Jacobi algorithm.
      Supplement: Solutions to exercises and more. PDF    

• Set number 12 : Full size: PDF.   Reduced: PDF .   Posted on: Tue Nov 19 15:29:15 CST 2019
  Topics: Eigenvalue problems; Brief background; the Schur form; Perturbation analysis; conditioning of a simple eigenvalues; The power method and related techniques.
      Supplement: Solutions to exercises and more. PDF    

• Set number 11 : Full size: PDF.   Reduced: PDF .   Posted on: Sun Nov 17 16:54:04 CST 2019
  Topics: A few applications of the SVD; Regularization; Information retrieval; Principal Component Analysis (PCA); Dimension reduction.
      Supplement: Solutions to exercises and more. PDF    

• Set number 10 : Full size: PDF.   Reduced: PDF .   Posted on: Mon Nov 11 17:28:10 CST 2019
  Topics: The Pseudo inverse; Application to least-squares; More-Penrose Pseudo-inv Ill-conditioned systems and the SVD; Numerical rank and the SVD;
      Supplement: Solutions to exercises and more. PDF    

• Set number 9 : Full size: PDF.   Reduced: PDF .   Posted on: Mon Nov 4 10:50:40 CST 2019
  Topics: Orthogonal subspaces & orthogonal projectors; Orthogonal decomposition; The 4 fundamental subspaces; the URV decomposition. Introduction to the Singular Value Decomposition. The singular value decomposition and its properties.
      Supplement: Solutions to exercises and more. PDF    

• Set number 8 : Full size: PDF.   Reduced: PDF .   Posted on: Sun Nov 3 16:00:50 CST 2019
  Topics: The Householder QR; the rank Deficient case; Computational cost; Solving Least-squares problems with the householder QR; Givens rotations and the Givens QR.
      Supplement: Solutions to exercises and more. PDF    

• Set number 7 : Full size: PDF.   Reduced: PDF .   Posted on: Sun Oct 20 19:44:08 CDT 2019
  Topics: The Gram-Schmidt algorithms and the QR Factorization; Least-squares problems; Applications; Data fitting;
      Supplement: Solutions to exercises and more. PDF    

• Set number 6 : Full size: PDF.   Reduced: PDF .   Posted on: Sun Oct 13 11:52:19 CDT 2019
  Topics: Positive Definiteness; Symmetric Positive Matrices; The LDLT and Cholesky factorizations; Banded systems
      Supplement: Solutions to exercises and more. PDF    

• Set number 5 : Full size: PDF.   Reduced: PDF .   Posted on: Tue Oct 8 14:21:22 CDT 2019
  Topics: Perturbation theory for linear systems; sensitivity analysis; Condition numbers; Error bounds; Norm-wise error analysis; Estimating cond. numbers; Estimating forward errors from residual norms.
      Supplement: Solutions to exercises and more. PDF    

• Set number 4 : Full size: PDF.   Reduced: PDF .   Posted on: Tue Oct 1 16:56:29 CDT 2019
  Topics: Concepts in floating point arithmetic; Error analysis Forward and backward errors; Errors in inner products; Application to linear systems.
      Supplement: Solutions to exercises and more. PDF    

• Set number 3 : Full size: PDF.   Reduced: PDF .   Posted on: Fri Sep 13 11:02:50 CDT 2019
  Topics: Solving Linear Systems; Background; Gaussian Elimination (review); Gauss-Jordan; The LU factorization; Pivoting.
      Supplement: Solutions to exercises and more. PDF    

• Set number 2 : Full size: PDF.   Reduced: PDF .   Posted on: Tue Sep 10 10:21:25 CDT 2019
  Topics: Inner products and norms; Vector norms; Convergence of vector sequences; Matrix norms.
      Supplement: Solutions to exercises and more. PDF    

• Set number 1 : Full size: PDF.   Reduced: PDF .   Posted on: Tue Sep 3 10:34:07 CDT 2019 [reposted. Only change: numbering of 'todo' exercises]
  Topics: Introduction; Types of problems seen in this course ; Math. background; Matrices; Eigenvalues and eigenvectors; Null space and range; Rank; Types of matrices; Special matrices.
      Supplement: Solutions to exercises and more. PDF    

---

csci 5304 - Fall 2019