18-746 Storage Systems (Fall 2024): Syllabus

Tentative Schedule

The schedule is also available as an ical file that you can subscribe to.

Lectures and projects can only be accessed by clients with a CMU IP address. CMU students who are off campus can use Cisco AnyConnect VPN to obtain a CMU IP. Most readings require that you have access to ACM or IEEE's digital library. You will automatically have access if you are using a client with a CMU IP.

Lecture Date Lecturer Topics Required readings Optional readings Notes
1 Mon 08/26 Greg Overview and Flash SSD Operation
[pdf]
Syllabus, ArpaciDusseau2015 ch44, Agrawal2008 Hennessy2002, Harchol2000
2 Wed 08/28 Greg Flash SSD Operation and Lab 1 Walkthrough
[pdf]
Agrawal2008 He2017, Mogul2009, McAllister2024 Slides for the myFTL project is available here. Lab 1, Checkpoints 0 and 1 are released.
Mon 09/02 Neither No class (Labor Day)
3 Wed 09/04 George Disk Drive Operation
[pdf]
Ruemmler1994, Worthington1994 Massiglia1986 ch2 1, Massiglia1986 ch2 2, Massiglia1986 ch12, ArpaciDusseau2015 ch37 Read pages 2-1 to 2-20 from Massiglia_ch2_1, 2-38 to 2-52 from Massiglia_ch2_2, and 12-1 to 12-11 from Massiglia_ch12.
4 Mon 09/09 Greg File System Storage Layout
[pdf]
McKusick1996 ch8, Lee2015 Ren2013, Rodeh2013, ArpaciDusseau2015 ch40, ArpaciDusseau2015 ch43
5 Wed 09/11 Greg File System Storage Layout (cont'd)
[pdf]
McKusick1996 ch8, Lee2015 Ren2013, Rodeh2013, ArpaciDusseau2015 ch40, ArpaciDusseau2015 ch43
6 Mon 09/16 George File System Organization
[pdf]
Vahalia1995 ch8 Giampaolo1998 ch2, ArpaciDusseau2015 ch39, ArpaciDusseau2015 ch40
7 Wed 09/18 Greg Caching and File System Integrity
[pdf]
Ganger2000, Giampaolo1998 ch7 ArpaciDusseau2015 ch42, Fryer2012
8 Mon 09/23 George Disk Array Organization
[pdf]
Chen1994, Schroeder2007 Schroeder2016, ArpaciDusseau2015 ch38
9 Wed 09/25 George Disk Array Systems
[pdf]
Chen1994, Hetzler2011 Greenan2010, Krioukov2008, Daly1995
10 Mon 09/30 All Exam 1 Q&A
Wed 10/02 All Exam 1
[pdf]
Exam1 F19 Q, Exam1 F20 Q, Exam1 F21 Q, Exam1 F22 Q, Exam1 F23 Q Exam1 F19 A, Exam1 F20 A, Exam1 F21 A, Exam1 F22 A, Exam1 F23 A Exam 1 covers all material up to and including the lecture before the exam, including the projects. Try taking the Practice exams without looking at the answers.
11 Mon 10/07 Brian Gold (Founding Engineer, Pure Storage FlashBlade) Scaling all-Flash storage arrays with HW/SW co-design
12 Wed 10/09 Rekha Pitchumani (Sr. Research Manager, Samsung) Current and Future Roles of Datacenter NAND Flash SSDs
Lee2021, SamsungWhitePaper2021, Coughlin2022
Mon 10/14 Neither No class (Fall break)
Wed 10/16 Neither No class (Fall break)
13 Mon 10/21 George Distributed FS and NAS Interfaces
[pdf]
McKusick1996 ch9 Howard1988, ArpaciDusseau2015 ch47, ArpaciDusseau2015 ch48, ArpaciDusseau2015 ch49, RFC1813
14 Wed 10/23 All Distributed FS (cont'd) and Exam 1 Review
15 Mon 10/28 Greg Multi-server Distributed FSes
[pdf]
Ghemawat2003 Kadekodi2020
16 Wed 10/30 Greg Extremely scalable storage
[pdf]
Ghemawat2003
17 Mon 11/04 Greg Reliability Enhancement Techniques
[pdf]
Holland1994, Welch2008 Kadekodi2022
18 Wed 11/06 Greg Scalable Table Stores
[pdf]
Chang2006 Spanner, Dean2004, Burrows2006
19 Mon 11/11 George Backup and data protection
[pdf]
Keeton2004 Amvrosiadis2016
20 Wed 11/13 George LSM Trees and Applications
[pdf]
LSM-Tree Ren13, Zheng20 From required reading, read Chapters 1, 2, 3.3, and 4
21 Mon 11/18 Matthew Leonard (Head of Storage Engineering, Bloomberg LP) Storage Engineering
[pdf]
22 Wed 11/20 Larry Greenfield (Distinguished Software Engineer, Storage Group, Google) Evolution of Google FSs
Dean2013
23 Mon 11/25 Wenguang Wang (Distinguished Engineer, VMware/Broadcom) vSAN, VDFS, and Practical Cache Design in Storage Systems
[pdf]
Take a look at this animation.
Wed 11/27 Neither No class (Thanksgiving)
24 Mon 12/02 Jeff Butler (Partner Architect, Microsoft) and Ellis Wilson (Principal Software Engineer Manager, Microsoft) Data Management and Coherency Challenges in Bringing an HPC Filesystem to the Cloud
[pdf]
LustreIntro Schwan2003
Wed 12/04 All Exam 2
[pdf]
Exam2 F19 Q, Exam2 F20 Q, Exam2 F21 Q, Exam2 F22 S, Exam2 F23 Q Exam2 F19 A, Exam2 F20 A, Exam2 F21 A, Exam2 F22 A, Exam2 F23 A Exam 2 covers all material up to and including the week before the exam, including the projects. Try taking the Practice exams without looking at the answers.

Last updated: 2024-12-11 00:09:32 -0500