Source Guide: Subspaces, Basis, and Dimension

A curated source guide for learning subspaces, basis, and dimension from first pass through research bridge.

Keywords

source guide, subspace, basis, dimension

1 How To Use This Guide

Use one layer at a time:

• First pass for honest subspace language
• Second pass for proof and exercise depth
• Paper bridge for seeing why low-dimensional structure matters in practice

2 Stable Core

• MIT 18.06SC: Basis and Dimension - First pass - best official source for the span/basis/dimension chain. Checked 2026-04-24.
• Introduction to Applied Linear Algebra – Vectors, Matrices, and Least Squares - First pass - strong applied framing once you want low-dimensional modeling language. Checked 2026-04-24.
• Hefferon, Linear Algebra - Second pass - stronger self-study source for proof and exercise depth. Checked 2026-04-24.

3 Current Bridge

• Deep learning, transformers and graph neural networks: a linear algebra perspective - Second pass - current bridge from low-dimensional structure to representation learning. Checked 2026-04-24.

4 Paper Bridge

• A Survey: Potential Dimensionality Reduction Methods - Paper bridge - best current first bridge from subspace language to method families. Checked 2026-04-24.
• Low-rank approximations - Second pass - useful next stop once you want to see how low-dimensional subspaces become practical approximation models in a concrete application area. Checked 2026-04-24.

5 Recommended Reading Paths

5.1 Path 1: First serious understanding

1. MIT 18.06SC Basis and Dimension
2. Subspaces, Basis, and Dimension
3. Hefferon for more exercises

5.2 Path 2: From basis language to applications

1. Subspaces, Basis, and Dimension
2. Low-Dimensional Subspace Models
3. Computation Lab: Basis and Column Space Geometry

5.3 Path 3: Bridge to dimensionality reduction

1. Subspaces, Basis, and Dimension
2. SVD and Low-Rank Approximation
3. Dimensionality Reduction as Subspace Modeling

6 Sources Checked Online

All links above were checked on 2026-04-24.

The verification pass included:

• official MIT OCW pages
• official Stanford or author-maintained textbook pages
• current arXiv survey page for dimensionality reduction
• current journal page for the 2025 linear-algebra perspective survey