CS 561

Data Systems Architectures

Syllabus

Class Projects

Announcements

Note: The material of the website is currently updated. Please visit periodically to monitor updates as the beginning of the semester approaches.

Class at a glance

Class: Tue/The 11:00am-12:15pm (CDS 364)
Instructor: Manos Athanassoulis

Lab: Fri 1:25-2:15pm (MCS B33)
Teaching Fellow: Teona Bagashvili

Office: CDS 928
Office Hours: Posted on Piazza

Discussion on Piazza / Grades on Gradescope
TF Office Hours: Posted on Piazza

Announcements

Semester starts on Jan 21 - stay tuned for updates.

Class Milestones - Important Dates

Keep in mind the Official Semester Dates.

January 31, submit project 0
February 14, submit project 1
February 23, submit your project proposal
February 25, last day to drop (without a "W")
March 3 - March 7, meet with your assigned mentor (graded)
March 6, Student-led discussion
March 22, submit your mid-semester progress report
March 27, Student-led discussion
March 31 - April 4, meet with your assigned mentor (graded)
April 4, last day to drop (with a "W")
April 8, Student-led discussion
April 26, final submission of project code and report

Class Schedule (tentative)

Here you can find the tentative schedule of the class (which might change as the semester progresses).

Class : Introduction to Data Systems and CS561

Readings

Slides

Class : Data Systems Architectures Essentials – Part 1

Readings

Slides
Architecture of a Database System, Foundations and Trends in Databases, 2007
The Design and Implementation of Modern Column-Oriented Database Systems, Foundations and Trends in Databases, 2012
Data Structures for Data-Intensive Applications: Tradeoffs and Design Guidelines, Foundations and Trends in Databases, 2023
Massively Parallel Databases and MapReduce Systems, Foundations and Trends in Databases, 2013
The Seattle Report on Database Research, SIGMOD Record, 2022

Class : Data Systems Architectures Essentials – Part 2

Readings

Slides
Architecture of a Database System, Foundations and Trends in Databases, 2007
The Design and Implementation of Modern Column-Oriented Database Systems, Foundations and Trends in Databases, 2012
Massively Parallel Databases and MapReduce Systems, Foundations and Trends in Databases, 2013
The Seattle Report on Database Research, SIGMOD Record, 2022

Class : LSM intro and Class Project Overview

Readings

Slides
Dissecting, Designing, and Optimizing LSM-based Data Stores, SIGMOD 2022
LSM-based Storage Techniques: A Survey, arXiv 2018

A: Storage Layouts

Class : Row-Stores vs. Column-Stores

Readings

Slides
Column-Stores vs. Row-Stores: How Different Are They Really?, SIGMOD 2008
C-Store: A Column-oriented DBMS, VLDB 2005

Class : Log-Structured Merge (LSM) Trees

Readings

Slides
Constructing and Analyzing the LSM Compaction Design Space, VLDB 2021
Monkey: Optimal Navigable Key-Value Store, SIGMOD 2020
Compactionary: A Dictionary for LSM Compactions, SIGMOD 2022 [DEMO]
Dostoevsky: Better Space-Time Trade-Offs for LSM-Tree Based Key-Value Stores via Adaptive Removal of Superfluous Merging, SIGMOD 2018 [conf. present. video]

Class : Scans in Key-Value Stores

Readings

B. Indexing

Class : Introduction to Indexing Design

Readings

Slides
LSM-based Storage Techniques: A Survey, arXiv 2018
Modern B-Tree Techniques, Foundations and Trends in Databases 2011
Prefix B-trees, TODS 1977
Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing, VLDB 1998
Bitmap Index Design and Evaluation, SIGMOD 1998
Column imprints: a secondary index structure, SIGMOD 2013
Database Cracking, CIDR 2007

Class : The design space of data structures

Readings

Slides
LSM-based Storage Techniques: A Survey, arXiv 2018

Class : Guest Lecture on Robust and Learned Tuning: Andy Huynh

Readings

Slides
ENDURE: A Robust Tuning Paradigm for LSM Trees, VLDB 2022 [conf. present. video]
CliffGuard: A Principled Framework for Finding Robust Database Designs, SIGMOD 2015
Automatic Database Management System Tuning Through Large-scale Machine Learning, SIGMOD 2017

Class : Guest Lecture on Sortedness-Aware Indexing: Aneesh Raman

Readings

Slides
QuIT your B+ tree for Quick Insertion Tree, EDBT 2025
Indexing for Near-Sorted Data, ICDE 2023

Class : Adaptive Radix Trees

Readings

Slides
The Adaptive Radix Tree: ARTful Indexing for Main-Memory Databases, ICDE 2013

Class : Bitmap indexing (Student Discussion )

Readings

Slides
UpBit: Scalable In-Memory Updatable Bitmap Indexing, SIGMOD 2016
CUBIT: Concurrent Updatable Bitmap Indexing, VLDB Endowement 2024

C. Modern Hardware

Class : Modern hardware trends

Readings

Slides
Data Management Over Flash Memory, SIGMOD 2011
A Parametric I/O Model for Modern Storage Devices, DaMon 2021

Class : Guest Lecture on SSD Design Elements: Teona Bagashvii

Readings

Class : ACE storage Management

Readings

Slides
ACEing the Bufferpool Management Paradigm for Modern Storage Devices, ICDE 2023
A Parametric I/O Model for Modern Storage Devices, DaMon 2021
Enhancing Data Systems Performance by Exploiting SSD Concurrency & Asymmetry, ICDE 2024 PhD Symposium
The Need for a New I/O Model, CIDR 2021

Class : Serverless Computing (Student Discussion )

Readings

Slides

D. Query Processing

Class : Skew-aware Optimal Joins

Readings

Slides

Class : Guest Lecture: TBD

Slides

Class : BMI-based Query Optimization (Student Discussion )

Readings

Slides
Selection Pushdown in Column Stores using Bit Manipulation Instructions, SIGMOD 2023
SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units, VLDB 2009
Boosting Data Filtering on Columnar Encoding with SIMD, DaMoN 2018
ByteSlice: Pushing the Envelop of Main Memory Data Processing with a New Storage Layout, SIGMOD 2015

Class : Guest lecture on OSDB: George Neville-Neil

Slides
OSDB: Exposing the Operating System's Inner Database, CIDR 2025

E. ML For Data Systems

Class : ML for Systems and Learned Query Evaluation

Readings

Slides
DBEst: Revisiting Approximate Query Processing Engines with Machine Learning Models, SIGMOD 2019
AB-tree: Index for Concurrent Random Sampling and Updates, VLDB 2022
Approximate Queries over Concurrent Updates, VLDB 2023 (demo of AB-tree)

Class at a glance

Announcements

Class Milestones - Important Dates

Class Schedule (tentative)

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Introduction to Data Systems and CS561

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Data Systems Architectures Essentials – Part 1

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Data Systems Architectures Essentials – Part 2

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : LSM intro and Class Project Overview

Readings

A: Storage Layouts

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Row-Stores vs. Column-Stores

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Log-Structured Merge (LSM) Trees

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Scans in Key-Value Stores

Readings

B. Indexing

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Introduction to Indexing Design

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : The design space of data structures

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Guest Lecture on Robust and Learned Tuning: Andy Huynh

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Guest Lecture on Sortedness-Aware Indexing: Aneesh Raman

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Adaptive Radix Trees

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Bitmap indexing (Student Discussion document.write("S" + (studpres++)); )

Readings

C. Modern Hardware

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Modern hardware trends

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Guest Lecture on SSD Design Elements: Teona Bagashvii

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : ACE storage Management

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Serverless Computing (Student Discussion document.write("S" + (studpres++)); )

Readings

D. Query Processing

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Skew-aware Optimal Joins

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Guest Lecture: TBD

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : BMI-based Query Optimization (Student Discussion document.write("S" + (studpres++)); )

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Guest lecture on OSDB: George Neville-Neil

E. ML For Data Systems

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : ML for Systems and Learned Query Evaluation

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Guest lecture on cloud data Lakes: Andrew Lamb

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Learned Indexes

Readings

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Exam

Project Presentation

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Project Presentations A

document.write("<a id=\"class" + (cday + 1) + "\"></a>"); Class document.write(cday + 1) : Project Presentationa B

Project Awards (by popular vote)

Awards

Class : Introduction to Data Systems and CS561

Class : Data Systems Architectures Essentials – Part 1

Class : Data Systems Architectures Essentials – Part 2

Class : LSM intro and Class Project Overview

Class : Row-Stores vs. Column-Stores

Class : Log-Structured Merge (LSM) Trees

Class : Scans in Key-Value Stores

Class : Introduction to Indexing Design

Class : The design space of data structures

Class : Guest Lecture on Robust and Learned Tuning: Andy Huynh

Class : Guest Lecture on Sortedness-Aware Indexing: Aneesh Raman

Class : Adaptive Radix Trees

Class : Bitmap indexing (Student Discussion )

Class : Modern hardware trends

Class : Guest Lecture on SSD Design Elements: Teona Bagashvii

Class : ACE storage Management

Class : Serverless Computing (Student Discussion )

Class : Skew-aware Optimal Joins

Class : Guest Lecture: TBD

Class : BMI-based Query Optimization (Student Discussion )

Class : Guest lecture on OSDB: George Neville-Neil

Class : ML for Systems and Learned Query Evaluation

Class : Guest lecture on cloud data Lakes: Andrew Lamb

Class : Learned Indexes

Class : Exam

Class : Project Presentations A

Class : Project Presentationa B