How to deploy the SmartFabric OMNI plugin in VMware vSphere Step 3

Step 1: Enable SmartFabric Services on the ToR Switch

Step 2: Deploy VxRail Cluster incl. ToR with VxRail Manager

Step 3: Deploy the SmartFabric OMNI plugin in VMware vSphere

Next Blog : Step 4: Virtualization engineer controls Day 2 Ops for the Full Stack

Installing the OMNI plugin

At this point we have already run the first two steps to get SmartFabric installed, our Switches have SmartFabric services enabled and the VxRail Manager Gui deployment has automatically configured the switch and disabled the CLI. Now we will add the Open Manage Network Integration or OMNI plugin to vSphere, giving the virtualization engineer full visibility and control of the dedicated HCI switch fabric.

We begin by deploying the OMNI VM ova, which is available from VMware Solution Exchange here: https://marketplace.vmware.com/vsx/solutions/openmanage-network-integration-for-vmware-vcenter-1-0

Deploy the OVA

These steps are straightforward. Isn’t great that we can do the OVA deployment thru the HTML5 interface? Be sure to match up the source and destination networks correctly at Step 7 in the process. Later on we will configure an ipv4 address on vCenter network and enable ipv6 on the MGMT network.

Power on the VM and connect to a console on the OMNI vm. You need to establish a password here for the admin user.

Configure the OMNI appliance

Since this is a first run deployment, we are going to select option “0. Full Setup” at the Menu. As you can see you can re-run and do other admin tasks later if required from this interface.

Before we active the first connection, we will setup the Profile name “vCenter Server Network” and assign a valid ipv4 address for the OMNI VM here.

The second connection is for ipv6 discovery on the VxRail Management network, no ipv4 address needed here.

Be sure to activate both networks on the last screen.

You will be prompted at the CLI again for NTP, SSL Cert, the appliance ip address, FQDN for VCSA, VC Username and Password, and finally the OMNI ip for REST and REST username and password.

Log in and out of vSphere and the OMNI plugin will appear.

Please follow and like us:

VMware vExpert 2019. Thank You to my vCommunity

VMware vExpert is an award for members of the vCommunity

I am delighted to get the news today (on my Birthday-eve) that I was accepted into the VMware @vExpert program for the first time. A very Big Thanks to a bunch of people that helped and encouraged me along the way. Firstly my friend and colleague @vdiAllStar. There are too many friends to name where I work every day @DellEMCSolCtrs . The team at @DellEMCHol that are amazing like @Josephcorreia and @jensklasen and a load more on and off Twitter.

Thanks to my sponsor and all around gent @jasemccarty as well as @GarethEdwards who gave me some @vExpertPRO tips. Thanks also to the legends of #DellEMCElect @Dathbrun @victorforde @amitpanchal76 and @reddogmarc. Shout out to @VirtualisedReal and @BizTechMeg who gave me a shot. Also to @vmpete @lost_signal @aaronbuley @jeremymerril who inspired me without evening knowing it. I hope I can give back to the vCommunity as much as these people do.

Please follow and like us:

How to enable SmartFabric for VxRail Step 1

I decided to document the steps I used to deploy SmartFabric Services on VxRail.  These are partly notes for myself and Customer Solution Centre engineers that will likely need to showcase this capability very soon.  The demand for this solution is very high and the customers I have met are impressed by what is now possible (wait until you see the roadmap!). 

Note: This is not a guide for end user customers because a lot of what I write about is handled thru our automated deployment appliance; VxRail. A note of thanks to Allan Scott from New York CSC that helped with the first SFS deployment and documentation.

Step 1: Enable SmartFabric Services on the ToR Switch

  • Cabling the ToR Switches
  • Installing/Upgrading OS10 on Dell EMC Switch
  • Enable the VxRail Personality on OS10
  • Ready for Part2 – Deploying VxRail with Smart Fabric Services

Next Blog: Step 2: Deploy VxRail Cluster incl. ToR with VxRail Manager

Step 3: Deploy the SmartFabric OMNI plugin in VMware vSphere

Step 4: Virtualization engineer controls Day 2 Ops for the Full Stack


Getting Started :


How to enable SmartFabric Services on the ToRs

SmartFabric is supported on the 4100 series from Dell EMC. Current models are 10G – S4112 F/T, S4128 F/T or S4148 F/T  (25G coming soon). Sales can order these switches to be delivered from factory with OS10 and licenses already applied.

If you need the latest version of OS10 – get it here: force10networks.com , request login thru support page and download 10.4.1.x. Put OS10 .bin file and licence .xml file in a USB drive – insert USB drive into switch.

Cabling the TORs

Cable up ports 29 and 30 – 100GB cables for ISL (VLT).

Cable up ports 25 and 26 – 100GB cables for Uplink.

Cable laptop into port 1 on switch.

Cable new VxRail appliances in any other port starting at port 2.

Installing or Upgrading OS10 on switch:

This is an optional step. The switches can be ordered and configured in factory, and so should arrive ready to begin at Step 2.

Connect the laptop to the serial port on one of the switches and start putty. Putty settings are 115200, 8, stop, none, none. I used a USB serial port so my COM port was COM3.

Powerup the serial connected switch – and break into ONIE mode by hitting ESC during bootup.

Choose “onie-discovery-stop” from the menu.

At prompt type: fdisk -l

USB Thumbdrive should be /dev/sdb1

mkdir /mnt/usb

mount -t vfat /dev/sdb1 /mnt/usb

Install OS10:

cd /mnt/usb

onie-nos-install /mnt/usb/XXXXXXXXXX.bin

Check IOS10 Version & Install License:

show version

show license status (skip next step if already installed)

license install usb://xxxxxxxx-NOSEnterprise-License.xml

Configure mgmt interface if required:

conf

int mgmt 1/1/1

no ip address dhcp

ip address 10.204.86.250/24

no shut

exit

management route 10.204.86.0/24 managementethernet

exit

Repeat these steps for the second ToR switch.

Optional step. Configure 40GB uplinks:

My showcase lab is using 40GB uplinks rather than 100GB so I needed to change the profile of the uplinks before applying the VxRail SFS personality. You can skip this step if you are using 100GB links.

OS10(config)# switch-port-profile 1/1 profile-2

Warning: Switch port profile will be applied only after a save and reload. All management port configurations will be retained but all other configurations will be wiped out after the reload.

OS10(config)# exit

OS10# write memory

OS10# reload

Enable the VxRail personality:

The SFS personality script is included in OS10. Once applied to each ToR switch, the switches will reboot with SmartFabric Mode enabled and you are now ready to perform a VxRail deployment from the VxRail Manager.

system bash

sudo sfs_enable_vxrail_personality.py -d 20 -a-m 2002

‘-d 20’ is a unique Domain ID that you assign to each cluster

‘-m 2002’ is a non-routed vlan used to do the initial build, local to the ToR switches only (Internal management network)

‘-a’ indicates that the port-channel on the upstream switches is configured with LACP

VxRail personality profile script options :


 
Domain -d <id> Required numeric value unique to data center (1 to 254) applied to ToR switch configuration settings Default: 1
Uplink -u <port,port> Override default 100Gb uplink ports Default: ports 25& 26
ISL -I <port,port> Override default 100Gb ISL ports Default: ports 29 & 30
Uplink tagging -t Whether external management VLAN is tagged or untagged when passed through uplinks. Default: untagged
Uplink LACP -a Whether LACP is active on uplink port channel (dynamic) or not (static). Default: static
Uplink breakout -b <2X50GE, 4X25GE, 4X10GE> Breakout 100Gb uplinks. Used to support connectivity to upstream switches without 100Gb ports
Management VLAN -m <VLAN> VxRail Cluster Build Network VLAN.
Default: 1

Validate Personality:

system bash

sudo sfs_validate_vxrail_personality.py

Links to useful guides that helped us document this build:

VxRail Fabric Automation SmartFabric Services User Guide

Dell EMC OpenManage Network Integration for VMware vCenter

How to Install Dell Networking FTOS on Dell Open Networking (ON) Switches


Please follow and like us:

SmartFabrics is Smart for VxRail HCI

My guide to enable SmartFabric on Dell EMC switches is here.

Catch out my interview with Barry Coombs from ComputerWorld UK on SmartFabric… does everyone hate their own voice or just me?

Is networking in HCI complex?

Back in October I asked the question, is HCI networking easy? I stand by my assertion that it is already pretty simple once you understand the converged design for HCI does not require separate physical fabrics. Once you setup your required VLANS and appropriate MTU and multicast for IPv6 you are 90% of the way done.  So if it’s so easy already, then why am I so excited about Smart Fabrics for VxRail appliances? Start up a conversation with Ned the network engineer about the automated deployment and simplified life-cycle management capabilities of SmartFabrics and you will get back a blank dull stare. “That’s just a python script” Ned the Network Admin will say, “Take your fancy sales patter down to the Virtualization guys, we don’t want your kind round here!”

Ned the NetAdmin says “You’ll never take my switches!”

It’s not easy to impress a NetAdmin

Ned has a point I suppose. The Network Admins job is to move packets reliably from one part of the network to the other, monitor the network for any problems, and to design and build future networks.  The last thing Ned needs is dealing with end users complaining about network problems caused by poorly designed applications (its never the networks fault!). This is actually the main selling point FOR the use of Smart Fabrics. Let me explain why.

Before you understand why SmartFabrics for VxRail, you have to first understand the reason for choosing VxRail appliances in the first place.  I have written a few Blogs on this already here and here . In short it’s an engineered solution for vSAN that comes from Dell EMC fully validated and tested and automatically deployed and updated throughout its life-cycle.

VxRail appliances don’t require a Storage expert or Server guru and it even saves the Virtualization admin from having to spend countless hours reading design and deploy documentation. After deployment is done, day 2 simplified operations begins. As a result maintenance and updates and upgrades are made easy through a single bundle file that covers the entire stack (not just the software on top of somebody else’ hypervisor – and includes the hardware too.

Can SmartFabrics simplify HCI?

The last part of the HCI architecture that needed simplification was the network, so Dell EMC has had its sites on Ned’s cubicle for a while now. If we are going to provide a fully automated deployment experience for our customers, it only makes sense to include the Top of Rack switches that are being used by VxRail appliances.  After all why would the network admin want to be responsible for those HCI host ports anyways? If something goes wrong in the vSAN stack, Ned doesn’t want to be dragged in to a War Room to defend last weekend’s network changes. Ned knows the changes the network team made at the weekend were to the core only.

Now with Smart Fabrics for VxRail, Ned can still own the core, and leave the HCI network problems to the Virtualization team.  SmartFabric will fully configure a redundant TOR fabric for VxRail, and continue to maintain the network for the life-cycle of the HCI solution. When it’s time to patch the HCI network, SmartFabric will provide a bundle file, and perform a non-disruptive rolling upgrade to the network TORs leaving Ned free to watch old episodes of Futurama. If the HCI team needs to expand their existing VxRail cluster by adding a new node, then Smart Fabric will fully automate the changes to the TOR switch, no need for Ned to ever get involved.

Is BYO Networking still an Option?

One of the advantages for VxRail customers has been the fact that it is BYON (Bring Your Own Networking). This means that Dell EMC does not force you to take a switch from their portfolio into your datacenter. For some customers, this would be non-negotiable.  They may have standardized on a specific brand and prefer to stay that way, no matter what they run at the Storage or Virtualization layer.  VxRail networking is compatible with any modern low latent switch and the introduction of VxRail SmartFabrics does NOT mean that the BYON option is no longer a choice. Hopefully the automation that comes with SmartFabric for VxRail will entice some customers to converge the entire HCI stack and give Ned some peace of mind.

Here is a great Blog on vSAN and Network Switch choices from @LostSignal on this Blog: https://blogs.vmware.com/virtualblocks/2019/03/21/designing-vsan-networks-2019-update/

Update! This week I will be meeting Hasan Mansur at the Limerick Customer Solution Center who writes a great Dell EMC networking blog at https://hasanmansur.com/ . Hasan has written two great articles there about SmartFabric Services. Please check it out Part 1 here and Part 2 here.

Please follow and like us:

Is advice from an expired VCP like drinking dodgy milk?

Update! VMware has removed the mandatory re-certification requirement from all current certifications! Read More about what this means here.

The concept of certification expiration is irksome to  many in the IT industry. I remember when my MCSE timed out way back in the day – and later when I did the PMP i was very disheartened to learn after 2 years I could no longer put it down on my CV any more unless I logged 40 hours of volunteering to attend various lectures on Project Management.

VMware certification expired
Certificate Expired!

Keeping up with certifications in the technology world can be a daunting task. Even with the best of intentions to stay up to date, the day job can get in the way. If your role changes, sometimes so does your focus on keeping VMware VCPup with your training.  The next thing you know you are officially expired! Does this mean your past knowledge vanishes as well?

I suppose a more balanced view would be its always good to be contiously learning. Arent we all doing that though? Last week I signed up for the VMware vSphere: Install, Configure, Manage [V6.7] course through my employer. The is part of the Data Center Virtualization (DCV) track. There is only a current exam for certification for  VCP 6.5 as the 6.7 course is not yet ready.

The course I joined was delivered online with an Instructor (ILT) and the class had about a dozen students.  My old VCP certification was… well it was well expired at this stage! VCP 3 and 4 seems so long ago now. I was a little daunted joining a course thinking I might be out of place.   The first day our instructor had everyone give a short intro and I was surprised to discover most people were in the same boat as me!

Shares, Reservations and Limits – Oh My!

A few people had actually already passed the VCP 6.5 this year, but needed to attend the course in order to officially earn the VCP certification. It must be a challenge for any instructor, knowing that some students might lack the motivation to pay attention. I must say our instructor was excellent. If you ever get a chance to take a course led by Rita Thaker, do not hesitate! What I liked most was how she frequently used the whiteboard instead of the lecture slides. She has an excellent ability to explain a topic using a story and her pen and builds it up slowly over time.  Many students commented that they preferred her drawings and were busily taking screen grabs for later study.

You had to be there… Isolation or Partition What if Scenario.

The course included two EBooks (Lecture and Lab manuals) delivered online through Evantage by Gilmore Global. You sign up for an account and can access the content on any device. The classes were hosted through the  Adobe Connect platform, which allows the instructor to control the learning environment completely. Participation was encouraged but controlled, the mics were muted unless a hand was raised, and normally the chat window was where we interacted.  This has a huge benefit in preventing the classroom Know-It-All or that one painful student that disrupts every lesson with an off-topic question/rant/story (there is ALWAYS one!).

Since my VCP was well and truly out of date, I needed to do a bit more to get back on track. I needed to attend the course, complete the course eval (to get course credit) and then I need to pass the vSphere 6.5 Foundations exam before I can finally try for the VMware Certified Professional 6.5 – Data Center Virtualization Exam (VCP 6.5 DCV ) .

I know a few people have expressed their annoyance with certification expiration and dismissed the trend as a money racket, but to be fair the VMware training is really top notch and in my case I really did need to dust off the brain cells and get back into it.  Hopefully I will get a chance to take the exam in December (this year) and then I will hopefully do better at renewing within the 2 year time-frame, as you only need to pass the latest exam at that point.

Some of the helpful links and content for the VCP DCV track:

vSphere Documentation, lots of links from here.

Maximums!  Always guaranteed a question on this.

Online access to Ebooks for Manuals and Lab books.

Hands on Labs! Most people learn best thru practical lessons.

Foundations Practice Exam Sample.

Please follow and like us:

Meet the Experts at VMworld Barcelona

This year I was fortunate to be given a ticket to VMworld in Barcelona as a partner attendee. Normally when I get to go to a company conference like DTW I have at least some booth duty – but this time I could concentrate on learning and networking. I had read all the guides to surviving VMworld, and digested all the advice and tips. I was careful to book sessions with presenters I wanted to meet before they filled up.  The app was an excellent resource and I used it to plan my days and stuck to the schedule I committed to.  I was very surprised to see many of the sessions only sparsely attended, especially when I knew the speakers were top class and the sessions had been booked out!

I was only given one small task for the event by the boss. The task was to evaluate the Meet The Experts area and Expert Bar and to find out as much as possible on how it worked for the event.  The reason for this is the plan is to run something very similar in Dell Technologies World in Vegas next spring.  Last year the Customer Solution Center had a section near the Hands on Labs area where customers could meet with Solution Architects 1on1 and discuss different products and solutions they were interested in.  The area was a success, we had many conversations and whiteboards were filled – but next year they wanted to see if we could improve the concept.

I must say I was well impressed with how the Meet The Experts and Experts Bar area were run in Barcelona. From what I have read about past VMworld’s the Expert Bar has moved from the VMware booth and now sits next to the Meet the Experts area which used to be called Expert Roundtables.  The location that was chosen was ideal in my opinion.  It was away from the Rock and Roll of the VM Village and Solutions Exchange, and placed outside of the Breakout Rooms.

At the end of any session, there is limited time to ask questions to the presenters so the Expert Bar gives anyone a chance to walk up and speak to someone while the question is fresh in their minds. The Expert Bar was a simple setup of one long table where engineers (not bartenders) served knowledge not alcohol. The table had room for 8 pairs of experts and a screen behind them displayed the details of their primary and secondary skill-sets. As customers fired questions across the bar, the experts could use the table-top as a whiteboard to explain concepts. The action was fast and furious and the Expert Bar was as busy as any in Las Ramblas.

The Meet the Expert sessions were all booked out weeks before the event, through the online scheduler just like any of the breakout sessions. You could search for a specific speaker, or a Topic and book them online.  This is exactly what I did, I booked 2 sessions with speakers that I wanted to meet. The session were at least 45 minutes each, with room for 10 attendees.  To me this is one of the highlights of the show, an opportunity to get into a small sessions with a well-known speaker and get a chance to have a discussion. I was amazed as I passed the area often to see empty seats. I spoke with the person at the desk checking badges of attendees and learned you could grab a no-show seat if they were full when you booked them.

I joined a session by Pete Koehler @vmpete with 6 customers. Pete and I knew each other virtually when Pete did a skype demo for me on new vROPS features after Dell World 2017. It was great to get to meet him in person and I was delighted when he recognized my badge when I sat down – we had a quick chat before he went into a discussion on vSAN availability scenarios.  The session was informal, mostly whiteboard, and the customers were able to ask questions. I was able to intro myself to the group and pitch Solution Centers story, as it turned out one customer asked to contact me after the event for a POC.

I had a second session with Myles Grey @mylesagrey about Kubernetes on vSAN, and I was the only one that turned up! For me this was excellent, because I had heard a lot about Myles and would much prefer to just have a chat while we waited for others to turn up.  Myles was an absolute gent and stayed for the full time-slot, he didn’t need to do that I would have understood if he headed off.  I had another Breakout session later he delivered on NSX that was also excellent.

When I got home from the event I gave a detailed report on the show and I am hoping that we are able to emulate a similar Expert Bar and Meet The Experts session schedule for Dell Technologies World in Las Vegas. If you have time in your conference schedule you would be well advised to include one of these sessions as part of your itinerary.

Please follow and like us: