CS655: Advanced Topics in Distributed Systems [Fall 2011]

[Announcements]

[Syllabus]

Schedule

Instructor		Lecture Coordinates
	Shrideep Pallickara Office: Room 346, Computer Science Office Hours: 3:30-4:30 pm TTH or by appointment E-mail: shrideep {aT} cs.colostate.edu (with the obvious change) Tel: 970.492.4209		TTH: 2:00-3:15 pm CSB Room 425

Note on Presentations:

The idea is to weave a narrative around 1 main paper and 2 related papers
- The presenter is expected to contribute another relevant paper
You will meet with me regularly to plan the composition of your presentation
- Make sure that you rehearse the presentation before class
The presenter’s critical review and slides will be posted 2 hours before class
Each student is expected to ask at least one question in class.
- The questions should not be softball questions with obvious answers
- The questions should be framed as outlined in class
Take a look at the section on critical reviews for additional content in these presentations

Lecture notes, presentations and critical-reviews are accessible from any machine on campus as well as from the campus-wide CSU-NET wireless network. If you are off-campus, you will need to use a VPN. Information about the CSU VPN can be found here.

Alternatively, if you don't want to install a VPN you can go to secure.colostate.edu, add a bookmark for this course, and then click on the bookmark to access notes from off-campus.

Week	Date	Readings		Notes	Critical Review	Presenter
1	8/23	Introduction.		[Print]
	8/25	Above the Clouds: A Berkeley View of Cloud Computing. Michael Armbrust et al. [Paper]		[Print]

2	8/30	Scalable, Distributed Data Structures for Internet Service Construction. Steven D. Gribble, Eric A. Brewer, Joseph M. Hellerstein, and David Culler , UC Berkeley. Proceedings of OSDI 2000. [Paper]		[Print]
	Application Development
	9/1	Granules: A Lightweight, Streaming Runtime for Cloud Computing With Support for Map-Reduce. Shrideep Pallickara et al. [Paper]		[Print]

3	9/6 & 9/8	Improving MapReduce Performance in Heterogeneous Environments. Zaharia, M., Konwinski, A., Joseph, A. D., Katz, R. H., and Stoica, I. In Proceedings of OSDI. 2008, 29-42. [Paper]		[Print]	[CR-Lloyd]	Wesley Lloyd
			Mapreduce: Simplified Data Processing on Large Clusters. Jeffrey Dean and Sanjay Ghemawat. [Paper]
			MapReduce and parallel DBMSs: friends or foes? Michael Stonebraker, Daniel J. Abadi, David J. DeWitt, Samuel Madden, Erik Paulson, Andrew Pavlo, Alexander Rasin. Commun. ACM 53(1): 64-71 (2010). [Paper]
			Initial Findings for Provisioning Variation in Cloud Computing. M. Rehman and M. Sakr. CloudComm 2010. [Paper]
			Enhancement of Xen’s Scheduler for MapReduce Workloads. Hui Kang et al. HPDC 2011. [Paper]

4	9/13 & 9/15	Dryad: Distributed Data-Parallel Programs from Sequential Building Blocks. Michael Israd et. al. EuroSys 2007: 59-72. [Paper]		[Print]	[CR-Malensek]	Matthew Malensek
			Biologically-inspired distributed middleware management for stream processing systems. ACM Middleware conference, 2008. G. T. Lakshmanan and R. Strom. [Paper]
			Pegasus: A framework for mapping complex scientific workflows onto distributed systems. Ewa Deelman et. al. Journal Scientific Programming. Volume 13 Issue 3, July 2005. [Paper]

5	9/20 & 9/22	BOINC: A System for Public-Resource Computing and Storage. David Anderson. GRID 2004. [Paper]		[Print]	[CR-Fan]	Chengyu Fan
			BOINC: Designing a Runtime System for Volunteer Computing. David P. Anderson, Carl Christensen and Bruce Allen. [Paper]
			Performance Evaluation of Scheduling Policies for Volunteer Computing. Derrick Kondo, David P. Anderson and John McLeod VII. eScience 2007. [Paper]
			Performance Prediction and Analysis of BOINC Projects: An Empirical Study with EmBOINC. Trilce Estrada, Michela Taufer, David Anderson. Journal of Grid Computing. 2009. [Paper]

6	9/27 & 9/29	Condor: Deploying a High Throughput Computing Cluster. Jim Basney and Miron Livny. [Paper]		[Print]	[CR-Shannigrahi]	Susmit Shannigrahi
			The Anatomy of the Grid: Enabling Scalable Virtual Organizations. I. Foster, C. Kesselman, S. Tuecke. International J. Supercomputer Applications, 15(3), 2001. [Paper]

	Process Migration
7	10/4 & 10/6	Survey: Process migration. Dejan S. Milojicic, Fred Douglis, Yves Paindaveine, Richard Wheeler and Songnian Zhou. ACM Computing Surveys. 32:3, 2000. [Paper]		[Print]	[CR-Shah]	Anantkumar Shah
			Rate of change load balancing in distributed and parallel systems. Miguel Campos, L.; Scherson, I. 10th Symposium on Parallel and Distributed Processing, 1999. [Paper]

	Data Storage Systems
8	10/11 & 10/13	Bigtable: A Distributed Storage System for Structured Data. Fay Chang et al. [Paper]		[Print]	[CR-Zhang]	Han Zhang
			The Google File System. Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leun. [Paper]
			The Chubby lock service for loosely-coupled distributed systems. Mike Burrows. [Paper]

9	10/18 & 10/21	Building a Database on S3. Matthias Brantner et al. [Paper]		[Print]	[CR- Strizhov]	Mikhail Strizhov
			PNUTS: Yahoo!’s Hosted Data Serving Platform. Brian F. Cooper et. al. [Paper]
			SQL in the Clouds. James Johnson. [Paper]

10	10/25 & 10/27	Cassandra - A Decentralized Structured Storage System. Avinash Lakshman and Prashant Malik. [Paper]		[Print]	[CR-Malensek]	Matthew Malensek
			Dynamo: Amazon's Highly Available Key-value Store. Giuseppe DeCandia et al. [Paper]
			Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility. A. Rowstron and P. Druschel. SOSP 2001. [Paper]

11	11/1 & 11/3	Data Management in the Cloud: Limitations and Opportunities. Daniel Abadi. [Paper]		[Print]	[CR-Fan]	Chengyu Fan
			Adapting Microsoft SQL Server for Cloud Computing. Philip A. Bernstein et al. [Paper]

	Virtualization
12	11/8 & 11/10	Xen and the Art of Virtualization. Paul Barham et al. [Paper]		[Print]	[CR-Shannigrahi]	Susmit Shannigrahi
			Optimizing Network Virtualization in Xen. Aravind Menon et al. [Paper]
			Denali: Lightweight Virtual Machines for Distributed and Networked Applications. Andrew Whitaker, Marianne Shaw, and Steven D. Gribble. [Paper]

		The Eucalyptus Open-source Cloud-computing System. Paper by Daniel Nurmi et al. [Paper]		[Print]	[CR-Zhang]	Han Zhang
			Dynamic virtual clusters in a grid site manager. Paper by Chase, J.S.; Irwin, D.E.; Grit, L.E.; Moore, J.D.; Sprenkle, S.E. [Paper]

13	11/15 & 11/17	Performance Issues In Clouds: An Evaluation of Virtual Image Propagation and I/O Paravirtualization. D. Armstrong, K. Djemame The Computer Journal, June 2011, vol. 54, iss. 6, pp. 836-849. [Paper]		[Print]	[CR-Lloyd]	Wesley Lloyd
			kvm: the Linux Virtual Machine Monitor. A. Kivity, Y. Kamay, D. Laor, U. Lublin, A. Liguor. Proc. 2007 Ottawa Linux Symposium (OLS 2007), Ottawa, Canada, June 27-30, 2007, pp. 225-230. [Paper]
			Virtualization of Linux servers. F. Camargos, G. Girard, B. Ligneris. Proc. 2008 Linux Syposium, Ottawa, Ontario, Canada, July 23-26, 2008, pp. 63-76. [Paper]


	Replication
14	11/29 & 12/1	Understanding Replication in Databases and Distributed Systems. Fernando Pedone, Matthias Wiesmann, André Schiper, Bettina Kemme, Gustavo Alonso. International Conference on Distributed Computing Systems - ICDCS , pp. 464-474, 2000. [Paper]		[Print]	[CR-Shah]	Anantkumar Shah
			Concurrency problems with replication in DFS and DDB - Jim Gray, Pat Helland, Patrick O'Neil, and Dennis Shasha. 1996. The dangers of replication and a solution. SIGMOD Rec. 25, 2 (June 1996), 173-182. [Paper]
			Jeong-Hyon Hwang, Magdalena Balazinska, Alex Rasin, Ugur Çetintemel, Michael Stonebraker, Stanley B. Zdonik: High-Availability Algorithms for Distributed Stream Processing. ICDE 2005: 779-790. [Paper]


15	12/6 & 12/8	Measuring Pay-per-Install: The Commoditization of Malware Distribution by Juan Caballero et al [Paper]		[Print]	[CR- Strizhov]	Mikhail Strizhov
16	12/13	Student project/term-paper presentations

CS655: Advanced Topics in Distributed Systems [Fall 2011]

Schedule

Application Development

Process Migration

Data Storage Systems

Virtualization

Replication