Skip to main content



supercloud

People

Zhiming Shen (Cornell University)

Qin Jia (Cornell University)

Weijia Song (Cornell University)

Hakim Weatherspoon (Cornell University)

Robbert van Renesse (Cornell University)

Overview

Supercloud is a cloud architecture that enables application migration as a service across different availability zones or cloud providers. The Supercloud provides interfaces to allocate, migrate, and terminate resources such as virtual machines and storage and presents a homogeneous network to tie these resources together. The Supercloud can span across all major public cloud providers such as Amazon EC2, Microsoft Azure, Google Compute Engine, and Rackspace etc., as well as private clouds. Supercloud users have the freedom to re-locate VMs to many data centers across the world, irrespective of owner and without having to implement complex re-configuration and state re-synchronization in their applications. Using the Supercloud, an application can easily offload from an overloaded data center to another one with a different infrastructure.

In implementing support for live application-level VM migration we had to address various challenges relating to heterogeneity, networking, and storage. The Supercloud leverages nested virtualization, eliminating the need for VM management support from underlying providers. We designed and implemented a new distributed storage system optimized for wide-area cross-provider VM migration. It decouples providing strong consistency from update propagation, improving latency while reducing overhead. We deploy a high performance Software-Defined Network (SDN) built with Open-vSwitch and VXLAN (Virtual Extended LAN) tunnels crossing cloud boundaries and a Frenetic controller. We also designed and evaluated various solutions to deal with migrating services that use public IP addresses. The Supercloud runs the OpenStack platform and appears to users as a single private OpenStack cloud. A new scheduler monitors workload and automatically determines the optimal location for running services.

Code Release

Supercloud Installation Script: Supercloud-core

Xen-Blanket: Xen-Blanket-AGN

Talks and Slides

Demo

Publications

Zhiming Shen, Qin Jia, Eyal Sela, Weijia Song, Hakim Weatherspoon, Robbert van Renesse Supercloud: A Library Cloud for Exploiting Cloud Diversity In ACM Transactions on Computer Systems (TOCS).

Zhiming Shen, Qin Jia, Eyal Sela, Ben Rainero, Weijia Song, Robbert van Renesse, Hakim Weatherspoon Follow the Sun through the Clouds: Application Migration for Geographically Shifting Workloads In Proceedings of ACM Symposium on Cloud Computing (SoCC), Santa Clara, California, October 2016.

Ian Kash, Qin Jia, Zhiming Shen, Weijia Song, Robbert van Renesse and Hakim Weatherspoon Economics of a Supercloud In Proceedings of the 3rd Workshop on CrossCloud Infrastructures & Platforms (CrossCloud), in conjunction with Eurosys, London, UK, April 2016.

Qin Jia, Zhiming Shen, Weijia Song, Robbert van Renesse, Hakim Weatherspoon Smart Spot Instances for the Supercloud. In Proceedings of the 3rd Workshop on CrossCloud Infrastructures & Platforms (CrossCloud), in conjunction with Eurosys, London, UK, April 2016.

Qin Jia, Zhiming Shen, Weijia Song, Robbert van Renesse, Hakim Weatherspoon Supercloud: Opportunities and Challenges. In ACM Operating Systems Review (OSR).

Dan Williams, Hani Jamjoom, and Hakim Weatherspoon. The Xen-Blanket: Virtualize Once, Run Everywhere. In Proceedings of ACM EuroSys, Bern, Switzerland, April 2012.

Dan Williams, Eslam Elnikety, Mohamed Eldehiry, Hani Jamjoom, Hai Huang, and Hakim Weatherspoon. Unshackle the Cloud! In Proceedings of the 3rd USENIX Workshop on Hot Topics in Cloud Computing (HotCloud), Portland, OR, June 2011.

Email Lists

: To subscribe, send an email with "join" as the subject to the following address: .

Click here for more information regarding to using Cornell E-Lists.

Slack