M1522.006300 Distributed Systems 2020 Fall
-
Professor: Hyeonsang Eom
Office : Bldg. 302 #324
TEL : 880-6755
E-mail : hseom at snu.ac.kr
-
Assistants: Mansub Song, Dong Kyu Sung
Office : Bldg. 302 #319
E-mail : ds2020 at dcslab.snu.ac.kr
Announcement [top]
- Credits
- 3
- Lecture
- Tuesday, Thursday ( ~ ) @ Bldg. 302 #106
- Interview
- Tuesday, Thursday ( ~ ) @ Bldg. 302 #324
- Prerequisites
- Knowledge of Basics of Software, Systems, and Distributed Processing
- The information provided on this web page is subject to change. If you have any question, feel free to send e-mail or ask the question
Objectives [top]
The main goal of this course is to study the basics of research regarding distributed systems that transmit, process, and protect data efficiently in order to meet the user requirements of value creation via using data in distributed computing environments. Students learn how to perform research to develop technologies needed in such environments, by deeply understanding major distributed systems issues regarding effective, efficient data protection, processing, & transmission and performance engineering, and by obtaining relevant skills.
Topics [top]
- Fundamentals of Distributed Systems
- Distributed Memory/File Systems
- Other Distributed Systems Topics
- Peer-to-Peer Computing
- Embedded Software/Systems
- Information Protection Systems
- Security & Digital Rights Management Systems
- Performance Debugging & Dynamic Adaptation
- Distributed Computing Frameworks
- Cloud Computing Systems Issues
- Dynamic Resource Management Systems
- Blockchain Systems
Textbook [top]
- Distributed Systems: Concepts and Design by George Coulouris, Jean Dollimore, and Tim Kindberg, Addison Wesley, June 2005 (4thEdition)/Jan 2012 (5th Edition)
- Distributed Systems: Principles and Paradigms by Andrew S. Tanenbaum and Maarten van Steen, Prentice Hall, 2006 (2nd Edition)/2007 (International Edition)
ISBN13 | TITLE | AUTHOR | EDITION |
---|---|---|---|
9780273760597 | DISTRIBUTED SYSTEMS | Coulouris | 5 |
9781292025520 | DISTRIBUTED SYSTEMS | Tanenbaum | 2 |
Reading Materials [top]
- The papers, titles of which are highlighted in black with the numbering will be presented by two course takers.
-
Fundamentals of Distributed Systems
- * [Lamport78] L. Lamport, "Time, Clocks, and the Ordering of Events in a Distributed System" , Communications of the ACM (CACM) Vol. 21, No. 7, July 1978, pp. 558-564 *
- * [Kleinrock85] L. Kleinrock, "Distributed Systems" , Communications of the ACM (CACM) Vol. 28, No.11, November 1985, pp.1200-1213 *
-
Distributed Memory/File Systems
-
[1] K. Liand P. Hudak.
"Memory Coherence in Shared Virtual Memory Systems"
,
ACM Transactions on Computer Systems (TOCS) Vol. 7, No. 4, November 1989, pp. 321-359
Current semester (pptx) Previous presentation material (pptx) -
[2] P. Keleher, S. Dwarkadas, A. Cox, and W. Zwaenepoel,
"Treadmarks: Distributed Shared Memory on Standard Workstations and Operating Systems"
,
Proceedings of the Winter Usenix Conference, January 1994, pp. 115-131
Current semester (pptx) Previous presentation material (pptx) -
[3] J. Howard, M. Kazar, S. Menees, D. Nichols, M. Satyanarayanan, R. Sidebotham, and
M.West.,
"Scale and Performance in a Distributed File System"
,
ACM Transactions on Computer Systems (TOCS) Vol. 6, No. 1, February 1988, pp. 51-81
Current semester (pptx) Previous presentation material (pptx) -
[4] S. Ghemawat, H. Gobioff, and S. Leung,
"The Google File System",
Proceedings of `the Nineteenth ACM Symposium on Operating Systems Principles (SOSP),
October 2003, pp.29-43
Current semester (pptx) Previous presentation material (pdf)
-
[1] K. Liand P. Hudak.
"Memory Coherence in Shared Virtual Memory Systems"
,
ACM Transactions on Computer Systems (TOCS) Vol. 7, No. 4, November 1989, pp. 321-359
-
Scalable, Dynamic Resource Management
- * [Lo15] Lo, David, et al, "Heracles: Improving Resource Efficiency at Scale", In Proceedings of the 42nd Annual International Symposium on Computer Architecture, pp. 450-462. 2015
-
Peer-to-Peer Computing
-
[5] S. Androutsellis-theotokis and D. Spinellis,
"A Survey of Peer-to-Peer Content Distribution Technologies"
,
ACM Computing Surveys (CSUR) Vol. 36, Issue 4, December 2004, pp. 335-371
Current semester (pptx) Previous presentation material (pptx)
-
Embedded Software/Systems
-
[6] E. A. Lee,
"What’s Ahead for Embedded Software"
,
IEEE Computer, September 2000
Current semester (pptx) Previous presentation material (pptx) -
[7] I.F. Akyildix, W. Su, Y. Sankarasubramaniam, and E. Cayirci,
"A Survey on Sensor Networks",
IEEE Communications, 2002
Current semester (pptx) Previous presentation material (pdf)
-
[6] E. A. Lee,
"What’s Ahead for Embedded Software"
,
IEEE Computer, September 2000
-
Information Protection, Security & Digital Rights Management
-
[8] E. Spafford,
"Crisis and Aftermath",
Communications of the ACM (CACM), Vol. 32, No. 6, June 1989, pp. 678-687
Current semester (pptx) Previous presentation material (pptx) -
[9] R. Anderson,
"Why Cryptosystems Fail",
Proceedings of the 1st ACM Conference on Computer and Communications Security, 1993,
pp.215-227
Current semester (pptx) Previous presentation material (pptx) -
*
[Saltzer75] J. Saltzer and M. Schroeder,
"The Protection of Information in Computer Systems",
Proceedings of the IEEE, Vol. 63, No. 9, September 1975, pp. 1278-1300
-
*
[Costan16] Costan, V. and Devadas S.,
"Intel SGX Explained",
IACR Cryptol. ePrint Arch. 2016, no. 86 (2016): 1-118.
-
[10] C. Karlof and D. Wagner,
"Secure Routing in Wireless Sensor Networks: Attacks and Countermeasures"
,
In Proceedings of the 1st IEEE International Workshop on Sensor Network Protocols and
Applications, May 2003
Current semester (pptx) Previous presentation material (pdf) -
[11] T. S. Messerges and E. A. Dabbish,
"Digital Rights Management in a 3G Mobile Phone and Beyond"
,
Proceedings of the 2003 ACM workshop on Digital rights management, Washington, DC, USA,
October 2003, pp. 27-38
Current semester (pptx) Previous presentation material (pdf)
-
[8] E. Spafford,
"Crisis and Aftermath",
Communications of the ACM (CACM), Vol. 32, No. 6, June 1989, pp. 678-687
-
Performance Debugging & Dynamic Adaptation
-
[12] M. K. Aguilera, J. C. Mogul, J. L. Wiener, P. Reynolds, and A. Muthitacharoen,
"Performance Debugging for Distributed Systems of Black Boxes"
,
Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles (SOSP), October 2003
Current semester (pptx) -
[13] T. D. Nguyen, R. Vaswani and J. Zahorjan,
"Maximizing Speedup through Self-Tuning of Processor Allocation"
,
Proceedings of the Tenth International Parallel Processing Symposium (IPPS), April 1996, pp.
463-468
Current semester (pptx) Previous presentation material (pdf) -
* [Diao03] Y. Diao, J. L. Hellerstein, S. Parekh and J. P. Bigus,
"Managing Web Server Performance with AutoTune Agents"
,
IBM Systems Journal, Vol. 42, Issue 1, January 2003, pp. 136-149
Current semester (pptx) Previous presentation material (pptx)
-
[12] M. K. Aguilera, J. C. Mogul, J. L. Wiener, P. Reynolds, and A. Muthitacharoen,
"Performance Debugging for Distributed Systems of Black Boxes"
,
Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles (SOSP), October 2003
-
Distributed Computing Framework
-
[15] Jeffrey Dean and Sanjay Ghemawat,
"MapReduce: Simplified Data Processing on Large Clusters"
,
Google, Inc.
Current semester (pptx) Previous presentation material (pptx) -
* [Chilimbi14] Chilimbi, Trishul, et al.,
"Project Adam: Building an Efficient and Scalable Deep Learning Training System"
,
11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14), pp. 571-582. 2014.
Current semester (pptx) Previous presentation material (pptx) -
[17] Abadi, Martin, et al.,
"TensorFlow: A System for Large-Scale Machine Learning"
,
12th USENIX symposium on operating systems design and implementation (OSDI 16), pp. 265-283. 2016.
Current semester (pptx) Previous presentation material (pptx) -
[18] Arnauov, Sergei, et al.,
"SCONE: Secure Linux Containers with Intel SGX"
,
12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), pp. 689-703. 2016.
Current semester (pptx) Original presentation material (pptx)
-
[15] Jeffrey Dean and Sanjay Ghemawat,
"MapReduce: Simplified Data Processing on Large Clusters"
,
Google, Inc.
-
Blockchain System
- * [Dinh18] Dinh, Tien Tuan Ahn, et al., "Untangling Blockchain: A Data Processing View of Blockchain Systems" , IEEE Transactions on Knowledge and Data Engineering, 30(7), 1366-1385.
-
[19] Wang, J., & Wang, H.,
"Monoxide: Scale out Blockchains with Asynchronous Consensus Zones"
,
16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19) (pp. 95-112).
Current semester (pptx) Original presentation material (pptx)
-
Cloud Computing System
-
* [Shah19] Shah, J., & Dubaria, D.,
"Building Modern Clouds: Using Docker, Kubernetes & Google Cloud Platform"
,
2019 IEEE 9th Annual Computing and Communication Workshop and Conference (CCWC), pp. 0184-0189. IEEE, 2019.
(Providing information for Performing the Project)
- * Luis M. Vaquero1, Luis Rodero-Merino1, Juan Caceres1, "A Break in the Clouds: Toward a Cloud Definition" , ACM SIGCOMM Computer Communication Review, Volume 39, Issue 1 (January 2010), Pages 50-55
- * Chappell, David (August 2008) (PDF). "A Short Introduction to Cloud Platforms.", David Chappell & Associates. Retrieved 2008-08-20.
- Cloud computing (pptx)
-
* [Shah19] Shah, J., & Dubaria, D.,
"Building Modern Clouds: Using Docker, Kubernetes & Google Cloud Platform"
,
2019 IEEE 9th Annual Computing and Communication Workshop and Conference (CCWC), pp. 0184-0189. IEEE, 2019.
References [top]
-
Fundamentals of Distributed Systems
- [Chandy85] K. M. Chandy and L. Lamport, "Distributed Snapshots: Determining Global States of Distributed Systems" , ACM Transactions on Computer Systems (TOCS) Vol. 3, No. 1, February 1985, pp.63-75
-
Distributed Memory/File Systems
- [Levy90] E.Levy and A.Silberschatz, "Distributed file systems: concepts and examples", ACM Computing Surveys (CSUR) Vol. 22, Issue. 4, December 1990, pp. 321-374
-
Peer-to-Peer Computing
- [Kiefer03] C. Kiefer, "Chord: A Scalable Peer-to-Peer Look-Up Protocol for Internet Applications (by R. Morris, et al)" , Writeup, Department of Computer Science, Saarland University, November 2002
- [Stoica01] Stoica, R. Morris, D. Karger, M. Kaashoek, and H. Balakrishna, "Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications" , Proceedings of the ACM Special Interest Group on Data Communications (SIGCOMM), San Diego, CA, August 2001
- [Zhao01] B. Y. Zhao, J. D. Kubiatowicz, and A. D. Joseph, "Tapestry: An Infrastructure for Fault-Tolerant Wide-Area Location and Routing" , Tech. Rep. CSD-01-1141, University of California at Berkeley, April 2001
- [Zhao04] B. Y. Zhao, L. Huang, J. Stribling, S. C. Rhea, J. D. Kubiatowicz, and A. D. Joseph, "Tapestry: A Resilient Global-Scale Overlay for Service Deployment" , IEEE Journal on Selected Areas in Communications (JSAC), Vol. 22, No. 1, January 2004, pp.41-53
Grading Policy [top]
- Midterm 20%, Final 30%, Homework Assignments 10%, Project 30% Attendance & Presentation 10%
- Penalty Scheme
- If you copy other people’s code or solutions, you lose 100%.
- If your assignment is late for no more than two days, you lose 20%, more than two days late, you can no longer turn in the assignment
Lecture Schedule [top]
- You are supposed to attend the zoom meetings as the lectures via ETL except for midterm and final (in a room TBA).
- You may download lecture slides by clicking the corresponding date.
- You may download additional slides/paper by clicking "+" next to the corresponding date.
- This schedule is subject to change.
Topic | Lecture Slide | Reading Materials (related lecture note) |
Comments |
---|---|---|---|
Introduction | Lecture1 |
HW : Self-Introduction
Email yours to an assistant by Sep 6th |
|
Fundamentals of Distributed Systems | |||
Lecture2 |
Paper preference Email your or your group's preference to TA by 9/13 (Sun) |
||
Lecture3 | |||
Lecture4 | |||
Distributed Memory File Systems | |||
Other Distributed Systems Topics | |||