Advanced -> Parallel Algorithms
Theory-breadth parallel coverage taught first through work/span reasoning and a Blelloch exclusive-scan simulator over an explicit array.
- Topic slug:
advanced/parallel-algorithms
- Tutorial page: Open tutorial
- Ladder page: Open ladder
- Repo problems currently tagged here:
1
- Repo companion pages:
4
- Curated external problems:
2
Microtopics
- parallel-prefix-sum
- blelloch-scan
- work-span
- brents-theorem
- pram
- upsweep-downsweep
- exclusive-scan
Learning Sources
Follow-Up Reading
Repo Companion Material
Curated External Problems
Core
| Problem |
Source |
Difficulty |
Context |
Style |
Prerequisites |
Tags |
Why it fits |
| Parallel Prefix Sum Benchmark |
CMU / Blelloch |
Theory |
Scan |
Theory Benchmark; Simulator |
Associativity; Prefix Sums; Tree Reduction |
Prefix Sum; Blelloch Scan; Work Span; Pram |
The canonical first parallel benchmark for this repo because scan makes the work-vs-span lens concrete without pretending the repo already provides a full multicore runtime. |
Stretch
| Problem |
Source |
Difficulty |
Context |
Style |
Prerequisites |
Tags |
Why it fits |
| Parallel algorithms notes: Brent and work-efficient scan |
MIT 6.854 |
Theory |
Further Theory |
Lecture Notes; Theory Breadth |
Prefix Sum; Work Span |
Brent's Theorem; Work Efficient; Pram; Parallel Prefix |
A strong follow-up once the scan route clicks and you want the first serious work-efficient simulation lens instead of only the tree mechanics. |
Repo Problems
| Code |
Title |
Fit |
Difficulty |
Pattern |
Note |
Solution |
PARALLELPREFIXSUM |
Parallel Prefix Sum Benchmark |
primary |
medium |
- |
Note |
Code |
Regeneration
python3 scripts/generate_problem_catalog.py