May 17, 2012

Fistful of Cloud : Interactive Cloud Demo

This project start to finish was just over one week. I had a three day birthday weekend where I did the bulk of the work and then spent evenings till early AM finishing this up. And without a doubt this was the most fun to create.

Really this blog post is a really a *video* blog post so without further ado I present:

[Read more...]

Creating a vApp : UBER UIM

I recently jumped in to help my team create a vAppliance for Unified Infrastructure Manager (UIM). This was to help enable both the EMC and Cisco field teams to demo and standup proof of concepts. As part of this I decided to try and create a web-only wizard for setting up the appliance. I used a combination of PHP/Perl/Bash and smashing my head on the keyboard. I made a short uber-video (just coined that term) which demonstrates how a simple 60 seconds web wizard let’s the user deploy UIM automatically. My goal is web-based configuration for everything I do from now on. [Read more...]

Play it again, Sam: Celerra UBER v3.2

The UBER VNX VSA was just released. Go HERE to download the new version.

PLAY_IT_AGAIN_SAM_poster

 

Another bug and another fix. I can’t tell if I am getting better at finding bugs or worse at testing.

Today I was able to replicate a weird issue that caused iSCSI LUNs to not show up with the ESXi 4.1 iSCSI adapter. Quick fix but if you are going to do iSCSI instead of NFS and are having issues, download the new VSA below:

Workstation Version
(MD5: a2136179d4d9544e4f8e3b43b7cc182e)

vSphere Version OVA
(MD5: c3d8abfb536aecca34c83d318c2c3e5f)

Thanks,

.nick

Smoothed Edges : Celerra UBER VSA Update v3.1

It came to my attention pretty quick that something was amiss with the last Celerra VSA UBER release. I heard strange stories of disks not adding and the OVA not deploying. Since this thing is drawing close on a couple thousand downloads some environmental, transfer, and operational bugs/errors will cause problems.

But I finally nailed this down myself when I was doing my iSCSI testing. I had run into a SRM bug (see post here) this week. And as I was parsing the logs I noticed a couple lines that confirmed it. There was definitely a bug as iSCSI objects were not pulling the new instantiated ID that is created with the wizard.

So after 8 hours or so of diving through and reversing engineering I finally found the culprit. It went all the way back to the original build I get from engineering. I wrote a patch, tested against my running VSA’s, and confirmed I had the fix. But while I was about rebuilding the VSA’s I decided to do a couple more things that didn’t make the last list. Here is the running list of changes:

bugs-dessin-011

  1. Bugfix: Passphrase for peer connections is will now save correctly. This is related to the ID bug. Before if you rebooted the VSA replications (NFS or iSCSI) would no longer work.
  2. Bugfix: iSCSI replication now creates LUN’s and Replication sessions with proper naming ID’s.
  3. Bugfix: NTP settings for Data Mover will update time during wizard immediately to correct large skew.
  4. Bugfix: Either SCSI or IDE disks will add correctly to automatic volumes now. This was a random error for some installs.
  5. VSA is now a fresh built VM (Hardware version 7). This cleans up the VMX considerably.
  6. OVA is now built from OVFTOOL 2.01. I tested deployments through Standalone Converter and VI Client deploy.
  7. Downloads now also have MD5 hashes available to verify no errors/changes in transit. I highly recommend checking the MD5 as several people have gotten bit errors from our FTP.
  8. Confirmed both the current Virtual Storage Integrator (VSI) plug-in and Celerra NFS plug-in works great with VSA. Videos soon with config.

 

 

Here are the new downloads for 3.1. I recommend replacing all previous versions of 3.0:

Now get to downloading… (***UPDATE links below are the updated 3.2 version fixing 3.1 bugs. ****) – LINK

Workstation Version
(MD5: a2136179d4d9544e4f8e3b43b7cc182e)

vSphere Version OVA
(MD5: c3d8abfb536aecca34c83d318c2c3e5f)

.nick

Have no fear of perfection – you’ll never reach it.  ~Salvador Dali

Fix coming soon : DART 6.0 / iSCSI / SRM Celerra SRA

So transparency is a good thing right? Especially since I just found out I have a ‘vendor’ blog *eek* ;)

I will make this short and sweet. I have been working on a home lab SRM thingy for a couple weeks. I had completed all my testing with NFS replication and plug-ins. Pretty darn sweet stuff but that is another post coming. When I moved on to the the iSCSI testing everything was kosher until I ran into issues with the Celerra Replicator SRA. It will crash out with a ‘discoverLuns’ error when searching the Celerra for the replicated session. In my lab I am using the new DART 6.0 UBER VSA.

Turns out this issue is known and just related to a naming change. EMC already has a fix (I tested and it works) and it is on its way through the official channels as we speak.

So once again with iSCSI replicated sessions on DART 6.0 there is an issue with the ‘discoverLuns’ command only. This does not affect the NFS replication with the Celerra SRA or other Clariion, Recoverpoint, Symmetrix  replications/SRA’s.

As soon as the release is out watch for it here or on Chad’s site.

.nick

UBERTastic : Celerra UBER VSA v3 – Unisphere

Man this has been a busy couple months. I have a whole different blog post about VMworld and the MADNESS. But suffice to say I have been busy. So busy in fact that I didn’t really have time to work on the new Celerra UBER VSA until this week. Which also happens to be a week vacation for me.

Now for a normal 9-5 kind of guy, working a little bit on your vacation is ok. Some people frown, some people smile and approve. But, on the vSpecialists this is a big "no-no". So because of my strong desire to get this awesome piece of virtual goodness in your hands I have risked the smack down from my teammates and managers for working on it during my vacation. I shall likely be banned from a console for a bit so remember me when you are checking out the UBER cool new Unisphere interface.

And so I am excited to announce the release of the Celerra UBER VSA version 3.
I got quite a bit of new features as well as the new code/management interface you have been hearing about. Here is the list of changes and additions:

  • DART is now 6.0.36.4
  • Unisphere management console (rocks!)
  • The Celerra VSA is now 64 bit! This means you can throw RAM at it for bigger setups and it will use it. Over 8GB becomes less beneficial without code changes to simulation services. Future updates will fix this from the Celerra VSA engineering teams.
  • The biggest and most difficult change to construct is that the configuration is now adaptive depending on the virtual machine setup. This version is now intelligent in seeing how many resources you have given it.
  • The new Celerra UBER VSA uses this intelligence to now allow *Thin* mode. If you give the VSA under 2GB of RAM it will automatically size the memory limits, processes, and management interface settings to allow it to run with as low as 1024MB of RAM. You won’t do replication or host a ton of VM’s but you can use this mode to host a few and fully demonstrate/test the new Unisphere interface on even a 2GB laptop.
  • The new VSA also uses this intelligence to automatically allow the configuration of single or dual Data Mover version based on the memory assigned. If you give the VSA more than 4GB of memory you will be given the option to enable an additional Data Mover for use as a standby or load balancing experimentation. This means this single appliance can be a small lightweight NFS unit at 1024MB of RAM or can be a 2 Data Mover powerhouse at 8GB of RAM. All automatically configured on first boot through the wizard.
  • Automatic VMDK/Storage additions have been adjusted for new 64 bit OS. This means this still works. Shutoff the VM, add VMDK(s), turn on and you have more space. Automagic
  • Since automagic is so cool, I have changed the Data Mover Ethernet binding to be automatic also. The VM starts with 1 interface for management and 1 interface for the Data Movers. If you want more for the DM(s), just shutoff the VM, add NIC cards (up to 6 additional), and turn back on. It will automatically bind the Data Mover (yes it works with the 2 DM mode also) to the new interfaces and virtual slots. Just go back into Unisphere and assign away. This allows scale up for the bigger 2 Data Mover 8GB of RAM versions easily.
  • Configuration is now Perl/Bash based instead of just Bash to keep things cleaner and slicker and allow for some coolness later on ;)
  • NTP from the configuration portion of the wizard works correctly. It sets both the Control Station and all Data Movers and enables NTP as a running service. Make sure your NTP server is valid.

So let’s summarize:

  1. New Unisphere
  2. 64 Bit
  3. Automatic sizing
  4. Thin Mode
  5. Optional 2 Data Mover mode
  6. Automatic Data Mover Ethernet adding (along with fixed Storage [VMDK] adding)
  7. NTP works now

Just my opinion but this my favorite version yet. Even without one single piece of my code this version is faster than the last.

Couple things to note:

Adding an extra Data Mover can extend the setup time up to 5-10 minutes depending on your hardware. I will speed this up in the future but for now this is a one-time penalty for being Data Mover greedy. Also remember to give it the extra RAM/vCPU before turning it on the first time.

You cannot change the number of Data Movers without redeploying a new version. Once it is born with two heads it stays that way. Same thing with the Thin mode. Once it is deployed Thin, adding more RAM will not refactor the VSA.

Thin mode (< 2GB of RAM) will still incur some mild swapping the closer to 1024MB you get. If you have a laptop with an SSD putting the first drive on it will almost completely negate any noticeable slowdown with mild loads.

From now on Eth0 is the management interface. This corresponds to NIC1 in your VM. Every other interface after is for the Data Movers and will start at CGE0 and increment. So NIC2 is Eth1 is CGE0 (per DM) inside Unisphere and NIC3 is Eth3 is CGE1 inside Unisphere. Pretty easy…

Now that this is 64 bit you can no longer run it inside a virtual ESX(i) inside Workstation 7. It has to be run directly on ESX(i) or Workstation 7.

Now get to downloading… (***UPDATE links below are the updated 3.2 version fixing 3.0/3.1 bugs. ****) – LINK

Workstation Version
(MD5: a2136179d4d9544e4f8e3b43b7cc182e)

vSphere Version OVA
(MD5: c3d8abfb536aecca34c83d318c2c3e5f)

Ton of work, ton of lost brain cells so pretty please comment and provide feedback. I am releasing videos on how to configure very soon and maybe a surprise or two. If there is something you would like to see please leave it in the comments below.

.nick