Vendor lock-in, severity across cloud architectures

Several people have asked me in the recent past about the vendor-lock-in issue with various deployment architectures. The below picture should be self-explanatory on the amount of lock-in across SaaS, PaaS and IaaS. The lock-in that I am referring-to here is a combined aggregate of Vendor lock-in + data lock-in + dev environment lock-in + data lock-in.

Java platform as a service for cloud

I used to think about the alternatives for Google platform for the java world and came across CloudFoundry today. They provide the java stack, similar to SpikeSource' LAMP stack, on the cloud. Though the stack is not very flexible for various types of Java apps (4 layer models, server types, EJBs etc) - it works for the common deployments. You just make the .war file and upload it - watch it to get deployed in a couple of minutes.

Microsoft & RedHat sign deal on Virtualization interoperability

Red Hat and Microsoft have signed reciprocal agreements today to enable increased interoperability for the companies' virtualization platforms. Each company will join the other's virtualization validation/certification program and will provide technical support for their mutual server virtualization customers.

Server virtualization is moving towards the commodity model and this is a natural transformation. Crucially, Red Hat's interoperability deal with Microsoft does not include any patent covenants.

Gartner Report - Virtualization to grow 43% in 2009

Cost reduction, resource utilization and management advantages drive market growth - says Gartner Report.

... Global virtualisation penetration is on pace to reach 20 per cent in 2009 from 12 per cent in 2008...

...Virtualisation helps organisations to cut costs, better utilise assets and reduce implementation and management time and complexity, all of which are crucial in this economic environment...

Gartner recommends that vendors take advantage during this disruptive period by introducing leading-edge management tools in support of virtualisation initiatives and ensure that virtualisation-specific management products can integrate within existing management frameworks.

Cloud Computing - Top 10 Obstacles & Opportunities

Quick Preview of Top 10 Obstacles to and Opportunities for Growth of Cloud Computing (from UC Berkeley's Research Publication, Feb 10 2009).

# Obstacle Opportunity
1 Availability of Service Use Multiple Cloud Providers; Use Elasticity to Prevent DDOS
2 Data Lock-In Standardize APIs; Compatible SW to enable Surge Computing
3 Data Confidentiality and Auditability Deploy Encryption, VLANs, Firewalls; Geographical Data Storage
4 Data Transfer Bottlenecks FedExing Disks; Data Backup/Archival; Higher BW Switches
5 Performance Unpredictability Improved VM Support; Flash Memory; Gang Schedule VMs
6 Scalable Storage Invent Scalable Store
7 Bugs in Large Distributed Systems Invent Debugger that relies on Distributed VMs
8 Scaling Quickly Invent Auto-Scaler that relies on ML; Snapshots for Conservation
9 Reputation Fate Sharing Offer reputation-guarding services like those for email
10 Software Licensing Pay-for-use licenses; Bulk use sales

Bespin - Cloud based application development

Mozilla's Bespin, released today, is a cloud based development environment that acts as a collaborative working space. This has HTML5 Canvas, runs the tools in the cloud and pretty response - see the screen capture that I posted here.

There is a very decent editor on the hosted & extensible dev environment. There is also an integrated CLI, emacs and collaboration features.

What is missing are the publishing, caching capbilities, ability to do version control, client-side customizations and the standards enforcements. Hence - but this is just version 0.1

Kidaro - Microsoft Desktop Virtualization

Microsoft released the beta version of a enterprise desktop virtualization, MED-V, based on Kidaro. This would allow execution of any Windows OS applications on Vista.

MED-V is a solution for Application-to-OS incompatibility and accelerates the usage path on Windows Vista and any future OS. You can download the beta of MED-V here.

This is a step towards IT management of OS images across the corporate on any type of hardware (including flash drives) and data management using Active Directory controls.

The picture here would be self-explanatory on the architecture & lifecycle of virtual images:

Best practices for zoning in SAN

Ever wondered if the same best practices of SAN zoning are applicable with or without server virtualization? Let me give some pointers to create a stable, manageable & secure SAN zone.

• Always go for Zoning, even if LUN Masking is being used
• Always implement a default zone
  
• Disable any unused storage ports on the switch to increase security and avoid potential problems
• Use pWWN identification for all Zoning configuration unless D,P identification is required
  
• Create Zoning aliases and names with only as long as required to allow maximum scaling
• Single Initiator Zoning are to be used with separate zones if a HBA is carrying both types of traffic (eg for tape and disk traffic)
• Use accurate Zoning terminology
  
• Describe Zoning by enforcement method and identification type
• Always use the vendor given software to validate the zoning configuration
• Zones should use frame-based hardware enforcement

Business benefits of deploying & central management of OS images

In the first look, it might appear just as any other Desktop Virtualization or Application Virtualization - but the key difference is in the ability to manage OS images and in giving offline access.

The LivePC solution from MokaFive allows to create and distribute controlled OS images across the group with a single click. This helps in identical image replication across users, and control images from a central place.

Business benefits are to user OS images dynamically, work anywhere, and start up in an instant. As with any other virtualization, this technology works onl for x86 OS images. Task based users & test organizations would be the greatest benefactors of this!

Virtualization (in Real-time) for mobile devices

I was always a strong proponent of Virtualization on mobile devices from a criticality perspective (imagine a lost call from your spouse, because of calendar app hanging!). VirtualLogix has now announced a real-time virtualization solution for ARM based SoCs. The picture is self-explanatory on how multiple execution environments run on a single core. The critical phone service runs in a real-time isolated environment, while other apps run in regular OS – Linux/Windows/Symbian.

This solution also guarantees the reliability & performance of critical phone services, while advancing features for other apps. This also provides device management functions eg OS monitoring and automatic restart, allowing the system to be repaired or restored independently of the rich OS.

Dispersed storage - save costs on replication for DR

Did you know that there is an optimized way to achieve storage replication & reliability via "dispersed storage"? Essentially, the data resides behind a gateway which disperses data across physically separated storage units and reassembles it when needed. Based on the solution you use - this would be efficient, flawless & quick.

Traditional replication is achieved by maintaining duplicates of data, at 200% or more storage capacity needs. Attached picture from CleverSafe explains the concept of dispersed storage.

The average storage savings are about 60% with this mechanism for the same reliability.
Even if some of storage servers fail, one can get your entire, uncorrupted and undamaged file back, as long as you have access to a minimum threshold for retrieval [example, if six of 16 slices are down, you can still get the entire file back]. One also doesn't need to worry about the security of individual storage, because the data on any individual server cannot be interpreted!

3 most used VMware ESXServer features

Question: Do you know what are the 3 most used features of VMware ESXServer by a typical IT data center?
Answer: They are vMotion, HA & DRS! Though all of these 3 features are similar in nature, and are likely to have a common code-base, the implementation (customer's use cases) are different. The differences being:

• vMotion is the user initiated live migration of a guest VM across hosts (ESXServers). The guest OS is hot (running) and will be moved to a new host with the most minimal delay. The network & storage connectivity are not lost during this process. The requirements for this to happen are to have a shared storage (NAS, iSCSI or FC) among the two ESXServers where the guest OS resides and access data + common CPU architectures on the hosts. Both hosts need to be on the same virtual center too.
  
• HA involves load balancing of the physical systems to maximize the usage of guest OS instances. If there is higher load, the guest OSes would be distributed uniformly across servers. Conversely, if one or more the ESXServers are under-utilized they would also go to power down mode
• DRS involves kick-starting guest OS instances on another ESXserver in case of server crashes or hardware issues on ESXServer

Both vMotino & DRS requires VirtualCenter, but not HA.

VI4... Just wait... vSphere

The upcoming release of VMware virtual infrastructure product would be called as vSphere, per a VMUG announcement. This would support a maximum of 1TB memory on the host and a max 256GB for guest OS.

By the way what would be the equivalent name of ESXi in this release? Any guesses?

Live VM migration across CPU Platforms with RedHat KVM

Those of who you who are familiar with vMotion know that it doesn't work for cross-platform migration (VM to migrate from an Intel to AMD or vice versa). There is no vendor who can provide this feature, except for RedHat KVM.

The below demonstration shows for the first time live migration of a virtual machine across vendor platforms (Intel to AMD or Vice Versa). Live migration enables the movement of running virtual machines (VMs) from one physical server to another without disrupting service to the end user. This is a great news, where RedHat is leading in the virtualization market.

Note that oVirt/KVM is not yet officially released from RedHat.

Watch the demo on Youtube here.

Hyper-V and Virtual Devices in Windows Guest OS

In the Hyper-V environment, when you do a fresh install of Win2008 guest OS - you will observe that the guest OS automatically gets all the virtual devices giving the 100% portability and the best possible performance. Watch how the device manager shows up on a native Win2008 installation and on a virtual machine installation.

Community benchmarking of VMs - Will it work?

There is a new virtualization community resource, from vKernel, called CompareMyVM. It’s a community of users where virtualization users around the globe can submit and share their VM & virtual hardware sizing information - described as:

CompareMyVM is a community site where you learn how to right size your VMs. Compare your virtual machine resource allocations with that of the community at large. You can compare by application category to see how your peers are allocating resources to gain the most efficiency out of their environments. You can also contribute your VM sizings to the community. Your submissions are anonymous.

Things you can do with CompareMyVM…
* Browse Community Submissions
* Vote Submissions Up or Down
* Edit Submissions
* Submit Your Own VMs

This seems to be addressing the need of a benchmark source for information, highlighting that there is a clear lack of this information analysis to be provided by any other tool.

Who would provide opportunities to improve based on the data submitted?

Virtual Hard Disk in Windows 7 - Game Changing?

Virtual Hard Disk allows you to create, mount, and unmount OS images and Microsoft did a wonderful job by providing a native support in Win7. This allows users to use virtualization on Win7 without any additional software, a turf that VMware cannot play! The guest OS residing in VHD can be booted directly without the host OS. Microsoft have effectively created a "loopback HBA", and the bootloader can use to address VHD's as any regular disk. I used this on my PC and admit that this feature works rock solid on Win7, though still in beta phase.


This could be a game changing technology, since one doesn't need additional software (like VirtulBox or VMware Workstation) to use Virtualization for booting multiple OS. This gives new abilities to test even a native device driver in the guest OS as it works just as the host OS. Realize that Win2008 Server also supports this feature, but the kernel implementations of Win2008 and Win7 are totally different!

In order to use this feature, just know to use the specifics of Win7 VHD commands diskpart, bcedit and you are good to go.

Cloud Storage - QoS & Adoption

I was at the Cloud Computing track of SNIA winter symposium this week, and got a good pulse of the industry happenings. The cloud enablers are gaining momentum, and are geared towards driving the adoption. Similar to what we saw with the adoption of low-cost SATA drives during the 2001 downturn, this year is likely to see a greater adoption of cloud computing to save on capital expenditure. All that – assuming the focus is on QoS!

‘Cloud storage’ data is mostly (~96%) is either the backup/archive or files and only the rest (4%) is of transactional data. The minority transactional data (coming from live applications) is because of the current barriers in ‘cloudifying’ applications as well as cloud storage. Talking purely about cloud storage, the entry barriers are more of the security, SLA compliance, vertical industry needs & transfer times in/out of the cloud.

There is also an unpleasant reality that the ‘unstructured’ data is growing @10% YOY and unless there is a strong audit-ability and quotas on the cloud – your monthly cloud invoices are only going to go up!

Virtualization: If not planned right!

Hadoop & Use Cases

I spent a little time in digging out various use cases for Hadoop. Here are some of the use cases, listed by business use:

• Search: Yahoo, Zvents, Amazon A9,
  
• Log processing: Facebook, ContextWeb, Yahoo, Joost
• Recommendation Systems: Facebook, Amazon (eg, ad placements or site suggestions)
  
• Data Warehouse: Facebook, AOL
• Video and Image Analysis: Eyealike, New York Times

Note that even the search use cases of Yahoo or A9 do not use Hadoop when a user clicks "Search" button, but merely parses the web data and generates the index files on the back-end. Hadoop takes care of the node failures during the processing and provides massive scalability & load balancing.