Skip to content

3.3_spikes

Jump to bottom Edit New page
chris grzegorczyk edited this page Nov 5, 2012 · 11 revisions

Table of Contents

Keywords

There are several keywords which are used to identify the deliverable for each spike:

  • Document means produce a document which records the relevant information, references, and unresolved questions.
  • Evaluate means to define an experimental scenario which is focused on evaluating the exact characteristic under study, describing the experiment, performing the experiment, and documenting the procedures, outcomes, and obstacles.
  • Prototype means to produce a quick-and-dirty implementation which serves only the purpose of the given evaluation.
In all cases these spikes are for the purpose of information gathering and investigation. They are not for the purpose of deciding, designing, or building a solution to the given problem -- we do not need to overcome problems. We need to investigate whether what are problems and whether we can overcome them in a reasonable amount of time in the future. The spikes are meant to be achievable w/in no more than a day and, to that end, their definition is (perhaps artificially) constrained.

Maintenance Mode

The main questions we must evaluate have to do with the management of devices and data which are managed by Eucalyptus and may not be understood by virtualization management system (KVM/libvirt, VCenter/ESXi).

  • Bridges
  • Ephemeral storage
  • File backed console log
  • Best-friend EBS: iSCSI-backed root filesystem
  • Volume attachments: dynamically attached iSCSI devices

General

For both KVM/libvirt and VMware we need to evaluate:

  1. Status evaluation of live migration in the following scenarios
    1. Note: these evaluations should be using as close as possible of a libvirt.xml as Eucalyptus uses as possible, but done outside Eucalyptus. Their purpose is to evaluate the state of the union of KVM and not to evaluate integration with Eucalyptus.
    2. Trivial configuration: no ephemeral, no network device, no console log, file backed virtual machine, etc.
      1. Here the focus is on evaluating the basics of migration along with the failure characteristics.
    3. Limited Instance-store configuration: file backed root file system, network device, console log but without ephemeral
      1. Here the focus is on the handling of basic devices essential for an instance.
    4. Ephemeral configuration: file backed root file system, network device, console log, and ephemeral
      1. Like the previous one, but adds ephemeral storage into the equation.
    5. Volume Attached configuration: file backed root file system, with attached iscsi volume but without network device, console log, ephemeral
      1. Here the focus is on evaluating the handling of dynamically attached iscsi devices.
    6. Limited Best-friend EBS configuration: iscsi backed root file system without network device, console log, etc.
      1. Here the focus is on having the root filesystem device be backed by iscsi

KVM/libvirt

www.linux-kvm.org/page/Migration blog.allanglesit.com/2011/08/linux-kvm-management-live-migration-without-shared-storage/ blog.allanglesit.com/2011/08/linux-kvm-management-offline-migration/ wiki.qemu.org/Features/LiveBlockMigration

  1. Stages of live migration
    1. Document the steps involved in VM migration.
    2. Special focus on understanding the possible integration points for external operations (e.g., some kind of hooks).
    3. Evaluate and report on the feasibility of using hooks in CentOS 6.3, if such a thing exists.
  2. Support for VM pause/snapshot
    1. Document the support for pausing a VM
      1. What is possible to do to a paused VM? (e.g., detach block devices?)
      2. Can we snapshot a VM to disk? If so
    2. Evaluate and report on the procedures and characteristics of the above in CentOS 6.3.
  3. Live migration
    1. Evaluate and report on the support for the above listed scenarios

VMware 5.0 and before

Here we assume that a user who wishes to use migration mode does so because they are already setup to do VMotion. That means that the evaluation setup must presume shared storage.

  1. VMotion
    1. Document the deployment and configuration requirements to support VMotion
    2. Evaluate and report on the support for the above listed scenarios

VMware 5.1

Here we are interested only in direct node-to-node migration w/o shared storage. blogs.vmware.com/performance/2012/08/vmware-vsphere-5-1-vmotion-architecture-performance-and-best-practices.html

  1. VMotion
    1. Document the deployment and configuration requirements to support VMotion
    2. Evaluate and report on the support for the above listed scenarios.

Enterprise: the next generation of networking

The next generation of networking must preserve support for the existing AWS network semantics and accommodate expansion to

  • Current AWS semantics
    • Security Groups
      • Private addressing for participating VMs (note: this does not imply a subnet restriction)
      • Network level isolation of security groups
      • Internet traffic ingress/egress firewalling
      • Cross-group ingress/egress firewalling
      • Dynamic reconfiguration of the above types of rules
    • Elastic IPs
  • Pending AWS semantics
    • Security Groups
      • VM participation in multiple security groups (membership vs. firewall groups)
    • VPC
      • Dynamic definition of private subnets
      • Dynamic configuration of DHCP per private subnet
      • Static private address control for private subnets
    • IPv6

Edge

  1. Revive eucanetd
    1. Evaluate and report on the state of eucanetd.
    2. Evaluate and report on the conformance of eucanetd to the above set of requirements.
  2. openvswitch - http://openvswitch.org/
    1. Evaluate and report on
      1. The state of openvswitch in distributions. Identify the recommended install procedure.
      2. The configuration modes available in the current version on CentOS 6.3.
      3. The functionality and characteristics of each of the available configuration modes above in light of the above network requirements.

SDNs

For each of the below referenced SDN technologies the following

  1. Document the support for the above set of AWS semantics.
  2. Document the logical model
    1. Control interfaces
    2. Logical abstractions, their behaviours, their lifecycles
    3. API overview
  3. Document the physical model
    1. What pieces need to get installed, where?
    2. How are they connected to each other?
    3. What is the recommended deployment model?
    4. What are the environmental assumptions?
  4. Document the functional characteristics
    1. What is the failure behaviour when the control plane components have failed?
    2. What is the failure behaviour when the data plane components have failed?
    3. Is there support for high availability in the control plane?
  5. Evaluate and report on
    1. The installation, administration, and control options which are available.
    2. The feasibility of transitioning existing networking modes to use this system
    3. The feasibility of integration with our existing automated QA system.

SDN List

  1. nicira - http://nicira.com/en/network-virtualization-platform
  2. midokura - http://www.midokura.com/midonet/
  3. floodlight - http://floodlight.openflowhub.org/
  4. trema - http://trema.github.com/trema/
  5. beacon - https://openflow.stanford.edu/display/Beacon/Home
  6. maestro - http://code.google.com/p/maestro-platform/

AWS java sdk

The purpose of this investigation is to determine what obstacles exist to pursuing support for the AWS Java SDK.

  1. AWS Java SDK testing
    1. Prototype HMACv4 support in Eucalyptus to the extent needed for evaluating AWS Java SDK. This does not need to be a committable prototype and serves this evaluation.
    2. Evaluate and report on changes needed to the current version of the AWS Java SDK to point it at a Eucalyptus install.
    3. Evaluate and report on other obstacles to using AWS Java SDK after the above changes are made.

ELB

The purpose of this investigation is to evaluate viable software based load balancers and vet their conformance to fundamental requirements for ELB. These are:

  • Fundamental ELB requirements
    • SSL termination
    • Runtime reconfiguration of the service (i.e., no restarting allowed)
    • Multi-tenancy (i.e., possible to configure multiple load balancing inbounds with seperate pools of outbound endpoints)
    • Arbitrary TCP load balancing
    • HTTP/HTTPs Session stickiness (both application level and load balancer level)
    • DNS vhosting
    • Endpoint health monitoring
    • Metric collection
      • Latency
      • RequestCount
      • HTTP Response code counts (e.g., 400, 404, 500, etc.)

Load Balancers

For each of the below listed load balancers:

  1. Evaluate and report on
    1. The support for functionality in the above listed requirements.
    2. The availability in distributions.
    3. A simple performance experiment comparing native execution vs. execution in a virtual machine.

Software Load Balancers

  1. nginx - http://wiki.nginx.org/Main
  2. HA proxy - http://haproxy.1wt.eu/
  3. Zen - http://sourceforge.net/projects/zenloadbalancer/
  4. pound - http://www.apsis.ch/pound/
Add a custom footer
  • Contact Info
Clone this wiki locally