CS655: Advanced Topics in Distributed Systems [Fall 2013]

[Announcements] [Syllabus] [Grading] [Schedule] [Assignments]



Instructor Lecture Coordinates

Shrideep Pallickara
Office: Room 346, Computer Science
Office Hours: 3:30-4:30 pm TTH or by appointment
E-mail: shrideep {aT} cs.colostate.edu
(with the obvious change)
Tel: 970.492.4209


TTH: 11:00 am -12:15 pm
CSB Room 425

Note on Presentations:
  • The idea is to weave a narrative around 1 main paper and 2 related papers
    • The presenter is expected to contribute another relevant paper
  • You will meet with me regularly to plan the composition of your presentation
    • Make sure that you rehearse the presentation before class
  • The presenter’s critical review and slides will be posted 2 hours before class
  • Each student is expected to ask at least one question in class.
    • The questions should not be softball questions with obvious answers
    • The questions should be framed as outlined in class
  • Take a look at the section on critical reviews for additional content in these presentations

Week Date Readings Notes Critical Review Presenter
1 8/27 Introduction. [Lecture 1]

8/29 Above the Clouds: A Berkeley View of Cloud Computing. Michael Armbrust et al. [Paper] [Lecture 2]

2 9/3 Scalable, Distributed Data Structures for Internet Service Construction. Steven D. Gribble, Eric A. Brewer, Joseph M. Hellerstein, and David Culler , UC Berkeley. Proceedings of OSDI 2000. [Paper] [Lecture 3]


Application Development

9/5 The Google File System. Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leun. [Paper] [Lecture 4]

  Dynamo: Amazon's Highly Available Key-value Store. Giuseppe DeCandia et al. [Paper]
  The Andrew File System
3 9/10 Granules: A Lightweight, Streaming Runtime for Cloud Computing With Support for Map-Reduce. Shrideep Pallickara et al. [Paper] [Lecture 5]



Improving MapReduce Performance in Heterogeneous Environments. Zaharia, M., Konwinski, A., Joseph, A. D., Katz, R. H., and Stoica, I. In Proceedings of OSDI. 2008, 29-42. [Paper]

[Slides] [Alsaraan-CR] Hessah
  Mapreduce: Simplified Data Processing on Large Clusters.
Jeffrey Dean and Sanjay Ghemawat. [Paper]

  MapReduce and parallel DBMSs: friends or foes? Michael Stonebraker, Daniel J. Abadi, David J. DeWitt, Samuel Madden, Erik Paulson, Andrew Pavlo, Alexander Rasin. Commun. ACM 53(1): 64-71 (2010). [Paper]

  Initial Findings for Provisioning Variation in Cloud Computing. M. Rehman and M. Sakr. CloudComm 2010. [Paper]

  Enhancement of Xen’s Scheduler for MapReduce Workloads. Hui Kang et al. HPDC 2011. [Paper]

  P2P-MapReduce: Parallel data processing in dynamic Cloud environments. Marozzo, F., Talia, D., and Trunfio, P. [Paper]


4 9/17
Dryad: Distributed Data-Parallel Programs from Sequential Building Blocks. Michael Israd et. al. EuroSys 2007: 59-72. [Paper]

[Slides] [Rabiet-CR] Louis
  Biologically-inspired distributed middleware management for stream processing systems. ACM Middleware conference, 2008. G. T. Lakshmanan and R. Strom. [Paper]

  Pegasus: A framework for mapping complex scientific workflows onto distributed systems. Ewa Deelman et. al. Journal of Scientific Programming. Volume 13 Issue 3, July 2005. [Paper]

      Ciel: A universal execution engine for distributed data-flow computing. NSDI 2012. Derek G. Murray et al [Paper]

5 9/24
BOINC: A System for Public-Resource Computing and Storage. David Anderson. GRID 2004. [Paper]

[Slides] [Stern-CR] Ryan
  BOINC: Designing a Runtime System for Volunteer Computing. David P. Anderson, Carl Christensen and Bruce Allen. [Paper]

  Performance Evaluation of Scheduling Policies for Volunteer Computing. Derrick Kondo, David P. Anderson and John McLeod VII. eScience 2007. [Paper]

  Performance Prediction and Analysis of BOINC Projects: An Empirical Study with EmBOINC. Trilce Estrada, Michela Taufer, David Anderson. Journal of Grid Computing. 2009. [Paper]
6 10/1
Condor: Deploying a High Throughput Computing Cluster. Jim Basney and Miron Livny. [Paper]

[Slides] [Budgaga- CR] Walid
    The Anatomy of the Grid: Enabling Scalable Virtual Organizations. I. Foster, C. Kesselman, S. Tuecke. International J. Supercomputer Applications, 15(3), 2001. [Paper]


Process Migration

7 10/8
& 10/10
Survey: Process migration. Dejan S. Milojicic, Fred Douglis, Yves Paindaveine, Richard Wheeler and Songnian Zhou. ACM Computing Surveys. 32:3, 2000. [Paper]

[Slides] [Alsaraan- CR] Hessah
  Rate of change load balancing in distributed and parallel systems. Miguel Campos, L.; Scherson, I. 10th Symposium on Parallel and Distributed Processing, 1999. [Paper]


Data Storage Systems

8 10/15 & 10/17 Bigtable: A Distributed Storage System for Structured Data. Fay Chang et al. [Paper]

[Slides] [Rabiet-CR] Louis
  The Google File System. Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leun. [Paper]

  The Chubby lock service for loosely-coupled distributed systems. Mike Burrows. [Paper]

9 10/22
Building a Database on S3. Matthias Brantner et al. [Paper]

[Slides] [Alsaraan-CR] Hessah
  PNUTS: Yahoo!’s Hosted Data Serving Platform. Brian F. Cooper et. al. [Paper]

  SQL in the Clouds. James Johnson. [Paper]
10 10/29
Cassandra - A Decentralized Structured Storage System. Avinash Lakshman and Prashant Malik. [Paper]

[Slides] [Budgaga-CR] Walid
  Dynamo: Amazon's Highly Available Key-value Store. Giuseppe DeCandia et al. [Paper]

  Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility. A. Rowstron and P. Druschel. SOSP 2001. [Paper]

11 11/5
Data Management in the Cloud: Limitations and Opportunities. Daniel Abadi. [Paper]

[Slides] [Stern-CR] Ryan
  Adapting Microsoft SQL Server for Cloud Computing. Philip A. Bernstein et al. [Paper]



12 11/12
Xen and the Art of Virtualization. Paul Barham et al. [Paper]

[Slides] [Budgaga-CR] Walid
  Optimizing Network Virtualization in Xen. Aravind Menon et al. [Paper]

  Denali: Lightweight Virtual Machines for Distributed and Networked Applications. Andrew Whitaker, Marianne Shaw, and Steven D. Gribble. [Paper]

13 11/19
Performance Issues In Clouds: An Evaluation of Virtual Image Propagation and I/O Paravirtualization. D. Armstrong, K. Djemame The Computer Journal, June 2011, vol. 54, iss. 6, pp. 836-849. [Paper]

[Slides] [Stern-CR] Ryan
  kvm: the Linux Virtual Machine Monitor. A. Kivity, Y. Kamay, D. Laor, U. Lublin, A. Liguor. Proc. 2007 Ottawa Linux Symposium (OLS 2007), Ottawa, Canada, June 27-30, 2007, pp. 225-230. [Paper]

  Virtualization of Linux servers. F. Camargos, G. Girard, B. Ligneris. Proc. 2008 Linux Syposium, Ottawa, Ontario, Canada, July 23-26, 2008, pp. 63-76. [Paper]



14 12/3
Understanding Replication in Databases and Distributed Systems. Fernando Pedone, Matthias Wiesmann, André Schiper, Bettina Kemme, Gustavo Alonso. International Conference on Distributed Computing Systems - ICDCS , pp. 464-474, 2000. [Paper]

[Slides] [Rabiet-CR] Louis
  Concurrency problems with replication in DFS and DDB - Jim Gray, Pat Helland, Patrick O'Neil, and Dennis Shasha. 1996. The dangers of replication and a solution. SIGMOD Rec. 25, 2 (June 1996), 173-182. [Paper]

  Jeong-Hyon Hwang, Magdalena Balazinska, Alex Rasin, Ugur Çetintemel, Michael Stonebraker, Stanley B. Zdonik: High-Availability Algorithms for Distributed Stream Processing. ICDE 2005: 779-790. [Paper]
15 12/10
Measuring Pay-per-Install: The Commoditization of Malware Distribution by Juan Caballero et al [Paper]

16 12/13 Student project/term-paper presentations      



Department of Computer Science, Colorado State University,
Fort Collins, CO 80523 USA
© 2013 Colorado State University