Posts tagged ‘Application Performance Management’
The Oscars of Private Cloud Management
By Russell Rothstein
March 7, 2010
It was fun to watch the Academy Awards this year – a glitzy evening replete with glamorous movie stars, stylish attire, and most importantly to those of us from the software industry, totally cool computer-generated characters. (Unless you preferred to spend the evening watching your favorite Super Bowl commercial for the umpteenth time or the latest OK Go video instead.) It’s a night where aspiring actors and screenwriters silently wish that next year they’ll get that break to make it to the Oscars, and we wish we had taken that extra course in computer graphics in college, observing the box-office proceeds from Avatar and Alice in Wonderland.
And while OpTier won’t be releasing a 3-D feature film any time soon, we do believe a multi-dimensional approach is critical to that new genre of enterprise IT service management – managing private clouds. Private clouds are becoming more pervasive – according to Gartner, by 2012 enterprises will spend more than half of their cloud dollars on private cloud services because of improvements in cost and management efficiency.
OpTier BTM provides performance management, resource management, and cost-based accounting for private clouds
That’s where the 3-D approach comes in. Some enterprises erroneously assume that since virtualization is the enabling technology for clouds, then virtualization-centric management systems are sufficient for managing cloud-based services. In effect, they are extending the flawed silo-based APM approach to IT management by applying another one-dimensional toolset to manage virtual hosts and guests in the cloud. (It’s no surprise that in these cases, when a performance issue occurs in the cloud – everyone first blames the “VM guy”.)
OpTier takes a multi-dimensional approach to the cloud. In order to provide true end-to-end service management in the cloud, you need to include visibility into both virtual and physical metrics. Only with a business transactional-based approach do you have 3-D visibility to cover the three key dimensions of transactions that flow through the cloud:
- Time per transaction (i.e. cloud performance management)
- Resource utilization per transaction (i.e. cloud capacity management)
- Cost per transaction (i.e. chargeback and activity-based costing for the cloud)
Frost and Sullivan found that two of the top three concerns about cloud are loss of control and availability. OpTier’s business transaction management approach to private clouds is the most efficient manner to address these concerns – enabling organizations to take control and assure 24/7 availability of services in the cloud.
So the OpTier 3-D feature film may be off in the future, but for some time already, OpTier customers have been using OpTier BTM’s 3-dimensional approach to manage services in the cloud on a daily basis. Now that’s worth an Oscar speech.
Virtualized in Vancouver
By Russell Rothstein
February 22, 2010
We’re fascinated by what’s going on in Vancouver this month. Sure, there’s a lot of drama, action and suspense going on over at the Winter Olympics (such as the valiant efforts of the Jamaican Freestyle Skier to be the first to restore the pride of winter sports to his homeland since the 1988 Jamaican Bobsled team) but we’re even more intrigued by the less mesomorphic young singles cross-town in Vancouver engaging their social skills in a flittering party – flirting virtually with one another through the twitter platform.
For those of you not previously familiar with flittering, it means sending a flirtatious tweet to someone that interests you in the room. And while having the option of flirting online is generally a good thing as it provides a new way for people to find their match, it presents a management challenge – keeping up with the fast pace of the tweets and achieving the visibility to link the virtual (witty tweets) with the physical (cute guy or gal – hopefully).
We find these issues remarkably similar to the management challenges companies face when deploying virtualization. While virtualization presents huge benefits in efficiency gains, it also creates three application management challenges:
- Lost Visibility: Applications become more difficult to manage because virtualization masks the underlying infrastructure layers. It becomes difficult to isolate the problematic tier when a problem occurs, or even understand that a problem is starting to occur before users are impacted. Likewise, it is difficult to determine the impact of VM changes on performance.
- Dynamic Environment: If becomes difficult to keep up with speed of changes in virtual infrastructure. As the folks at EMC call it – “VMotion Sickness”. Then when application performance begins to degrade, people tend to first blame the VM administrator, even if the problem lies elsewhere.
- Overprovisioning: Due to lack of visibility, enterprises often overprovision infrastructure in order to assure performance. Overprovisioning physical hosts (e.g. extra CPU) reduces the cost savings of virtualization.
Virtualization-aware Business Transaction Management addresses these challenges. With OpTier BTM you can regain the visibility lost from virtualization, keep up with changing VMs, and rightsize to maximize cost efficiencies. And while that last sentence would fit into a 140-character tweet, we’re not sure it would get us any dates at the next flittering party.
February 22, 2010 at 2:14 pm Russell Rothstein Leave a comment
BTM – the pain relief for CMDB?
by Anonymous, 2nd November 2009.
I have yet to meet a satisfied customer with a CMDB. It’s not like I go looking everyday but somehow the subject always seems to arise and people tend to get quite touchy on the subject. It wasn’t so long ago I worked for a company who spent a fortune acquiring an application discovery and mapping solution. It promised auto-discovery in real-time and all those wonderful things yet it seemed to die a cold death months after the acquisition closed. I listened to the sales pitches around “When applications go down the first question asked is ‘What changed’?” and the famous “75% of application outages are related to change”. To me that’s like stating the bloody obvious, of course something changed, if nothing changed the application would be still running.
The problem these early discovery & mapping solutions lacked is business context. They were inherently built to track IT interactions from server to server and technology to technology. They’d scan server ports, executables and protocols to try and piece together the relationships between IT assets within a data centre. Or they’d do it by listening to the actual interactions. They’d paint pretty little diagrams like the London Tube Map and then give you all the technology, versions and patch levels these assets were running. Some solutions were priced per cpu which can be highly lucrative when vendors told customers to put an agent on every server in their data centre. Unfortunately the one thing they didn’t discover or understand was the business services that ran across these IT assets. Applications and Business Services these days don’t just relate to 4 apache web servers, 8 weblogic servers and 1 Oracle database. The pervasiveness of SOA and mashups these days means a single IT asset can serve one or more business services. Applications and IT Assets no longer have a 1 to many relationship, an application isn’t simply a collection of segmented IT assets.
I did a search on Wikipedia for CMDB and found the quote “A key success factor in implementing a CMDB is the ability to automatically discover information about the CIs (auto-discovery) and track changes as they happen.”. If a business service is a CI then that’s a pretty tough proposition to auto-discover and track change on. How do you discover business context from IT assets? For starters you can stop looking at the IT assets for answers, you’ll get your versions and patch levels of Linux but you won’t get a description of your business services that flow through them.
I’ll put my head on a lance and state that Business Transaction Management (BTM) can add significant value to any CMDB project. When you start to monitor business transactions you start to acquire lots of key intelligence on how your business runs and maps to IT. You auto-discover transaction flows and the IT assets they interact with, all in real-time. It also gets better, you can store all this data historically so that you can report and compare business services and their CI’s before and after a change. You can even visualise how the business and IT asset dependencies change over time using transaction flow/topology diagrams as key evidence. When a change occurs on an IT asset you can instantly report whether this change had a positive or negative impact on your business services or transactions by reviewing related latency and SLA. I’m not claiming BTM is the answer to all CMDB pain but it solves some of the most basic and common challenges:
- Auto-discovers business services and their IT dependencies in real-time
- Stores information historically so you can track, report and quantify change when it occurs
Maybe BTM is the pain relief CMDB projects need right now.
BTM what is it for me?… really
While on my spinning bicycle in class this early morning on a cool New York day, I was cycling and grooving alon
g on Diana Ross “if there’s a cure for THIS, i don’t want it”….. Being thankful I have time to do things I love. It reminded me of discussion I had with people working in IT multiple times; we IT have it though there is very little time for personal life:
we know our users are complaining, we know we are losing business, we have been trying to identify the issue for days, I am losing credibility, I missed several friends dinner, I work every weekends, I have to leave the office now because I have to jump on a change management conference call while driving with the kids screaming in the back of the car. I have other things on my plate, like launching our new private banking services, budgeting for new servers to address our merger with ABC company, I need to grow my business, we can’t even have a feel on how our services behave nor identifying simple problem such as one out of five times the browser hangs when entering employee badge number. The assumption I made last week on where the problem might have been are now wrong, the change management team applied a patch against that specific application and the problem didn’t go away. I am stress and tired…. I am stress and tired…. I am stress and tired…. I am stress and tired….
IT experts would say: “I have tools several, several, several, several tools, and it is true after triaging all the alerts, the tools were able to isolate issues but I really just care about what impacted my users in company ABC. What is the behavior of my most revenue generating transactions today and what will it be after we merge the two companies’ systems next week, how would I know if it improves or degrades the overall business service?”Familiar with THIS? What if you would take a peek at introducing Business Transaction Management (BTM) into your IT process?
You would finally see at this moment the IT consumers and IT producers of business transaction information, knowing whom and what is impacted, focusing only on the most important services. What if you knew the exact flow of the information and the behavior of your special revenue generating credit card application transactions? BTM is a source of rich IT information. It is much more than incident management, you can not only understand the current behavior and plan for growing your business you can see the impact on your services of an unplanned or planned change.
This is the cure to resolve the “THIS”, today, tomorrow, next week, on a constantly changing fluid IT environment. Really who could have predicted that you would transact business via text messages? With this information on hand feel free to use those specialized tools and apply them appropriately to isolate granular application components issues but change the way you think about managing IT, It is not always about technical components. Now, I won’t cure all your stress and fatigue as there always be screaming kids, traffic, lines at the coffee shop but one less thing to worry about, getting a little more of your personal life back, one more thing to proudly walk to your management and really feeling good that you know the “THIS” at every moment of the day and I guarantee you will be grooving along a Disco song….
What’s Clear About Net Neutrality
By Russell Rothstein
October 12, 2009
The debate going on in Washington and the blogosphere around Net Neutrality is reaching fever pitch. If you haven’t been following the issue (no doubt due to spending too much time following your local gas station on twitter), it boils down to whether ISPs have the right to control what flows over their pipes or whether Internet users have the right to get unencumbered access to anything out on the Net. We’re especially intrigued by the debate going on in the Network World blogs between Johna Till Johnson and the dynamic duo of Sevcik and Wetzel. (Disclaimer: OpTier is a member of the Apdex alliance led by Peter Sevcik.)
Which brings us to our point that we can’t wait until someone buys the assets of Clear Corporate and restores the service. Clear is the company that created the speedy security lanes in the airport for those of us who hate to stand in long lines. Bidding is currently on to buy Clear’s assets from Morgan Stanley who took possession of the company when it went bust. (Note to our CFO: Don’t use money invested by Morgan Stanley in OpTier to make bid for Clear.)
You may be asking what Net Neutrality has to do with Clear. The answer, of course, is prioritization. Prioritization of data flowing over the network. Priority of people in airport security lines (very busy and important businesspeople, mind you). We here at OpTier think a lot about prioritization – prioritization of troubleshooting activities when outages occur, prioritization of infrastructure spending to maintain service levels, prioritization of virtualization deployments, and in general, prioritization of IT management in order to best support the goals of the business.
We believe prioritization is at the heart of the BTM approach and that’s what sets OpTier apart from the traditional APM vendors, even as they start to talk about business transactions in their pitches. While these vendors are cobbling together a group of silo monitoring tools using correlation techniques, we believe that true BTM means complete visibility into how every single business transaction executes from the end-user across all IT components with a complete breakdown of latency, resource consumption and SLA compliance.
Now that’s even worth waiting in line for.
October 12, 2009 at 8:57 am Russell Rothstein Leave a comment
Another “Less is More” Blog for ITSM and BSM Solutions
I’m jealous and in denial with several of my colleagues at work. It may have the “compare the meerkat” ring tone but my mobile phone was replaced last week with a new model of berry and I have to report I still feel inferior. It’s like I just traded a Porsche Boxster for a Boxster S, sure it’s a nice upgrade but everything is relative and unfortunately everyone around me is driving a 911 Turbo at the moment in the form of an iPhone.
Still, I’m not bitter. I think the introduction and innovation of the iPhone was exactly the kick up the ass that the mobile phone market needed. Think different is what Apple did and I think many IT vendors today should be following the same type of attitude for IT service management solutions. If I rewind the clock back just 5 years I owned a Sony Ericsson phone to make calls, a canon 2MegaPixel camera to take photos, an iPod “brick edition” to listen to music and a Dell laptop (also Brick Edition) to surf the web and do email. Today, I can get all that from an iPhone. The good news according to all my smug friends is that this iPhone thing actually works and is also quite sexy or something. The fact the camera, ipod, phone and browser are all integrated into the handset with an intuitive user interface is what is most impressive. If I owned an iPhone I wouldn’t need to buy 4 products from 4 different vendors.
ITSM & BSM - Lots of pieces integrated but not the picture you expected.
Now try comparing with what I just said against the IT service management landscape today. Customers are buying ten to twenty point products to manage the different functions and components of IT. Most of which were never intended to work with each other from day one and have so many customisations that migrating to new versions is like moving house rather than redecorating the one you already own. Customers buy separate tools to manage end users, networks, servers, JVM’s, CLR’s, databases, storage and that is just a short list. That’s a lot of GUI, in fact that’s a lot of user logins and products to physically deploy, train and support across your IT organisation. And yet so often we hear the words “Less is More” used in conversation and sales pitches despite many vendors being responsible for most of this huge complexity in the first place. The key issue isn’t so much the number of products, it’s the way in which real users can navigate and perform real use cases to exploit the information across multiple products so they can manage IT more effectively. Dashboards in my opinion do not solve this issue, they provide a quick fix and band aid which is often used by a sales team to try and promote “single pane of glass” views and “OOTB integration” yet in reality dashboards often limit navigation and task orientated use cases where you need to go from high level to low level data using a common context.
We announced a new product at OpTier last week which helps customers understand and manage their end user experience. Rather than create a new standalone product we listened to customers right from the start and did what they asked. We built the new product using the same framework we used to build our first product CoreFirst. Customers get all the benefits and features of a new product but they get it without all the drawbacks of buying yet another product to manage their IT services and components. They have a single GUI, a single data repository and a single user login to access both our products. Customers now get visibility of their end user experience with a complete profile of the business transactions that constructed those experiences all in a single click. We hid the technical complexity just like Apple did with the iPhone and on top of the integration we also decided to make the GUI more sexy in the process.
I may not own an iPhone but that doesn’t stop me appreciating what can be learnt from such innovation.
Manage IT with Business Impact not with Traffic Lights
I’ve been using the phrase “If everything is important then nothing is important” quite a lot in the last week. In my desperate attempts as a product manager to respond to every email, enhancement request, PRD, conference call and tweet it’s becoming quite challenging to say the least. I’m constantly fighting the battle of email and have even tried sending less email recently in the vain attempt that I’ll receive less…which didn’t seem to work at all. I even tried setting filters up on my inbox but still the emails keep getting through, it’s actually a novelty these days when someone picks up the phone and has the audacity to speak to me.
A typical day for me starts with a latte (and more often than not a chocolate chunk cookie) from Starbucks followed by a quick prioritization session. What things am I going to do today that will have the biggest impact on the company I work for? I could attempt each day to deal with email and tasks as they arrive on my desk in the vain attempt that I’ll keep everyone happy which normally requires working till 2am in the morning each day. Alternatively, I can be smart with how I work and push back of things that are less of a priority or have no tangible impact on the business.
Traffic lights don't always reflect the true business impact
What I go through daily as a product manager is pretty much identical to what operations and application support teams go through each day. Most support teams get email, in fact they get several hundred email or even several thousand emails as a result of the enterprise monitoring solutions they have hooked up to every component of their infrastructure. They have alerts and traffic lights configured for their OS, networks, storage, middleware, messaging, databases and users across hundreds of applications and thousands of physical servers. Customer’s enterprise dashboards turn red and stay red because they simply cannot deal with the volume they receive daily. It’s a monumental task to browse through alerts and put all the pieces together in the attempt that you can identify and isolate an issue before the business picks up the phone and starts asking questions.
More importantly, 99% of these alerts have no business context. The alerts contain technical information based on KPI metrics for a given threshold breach or state, they do not provide any visibility into how the alert is impacting the business. If an enterprise monitoring team receives 5,000 alerts a day how can they make sure they deal with the 3 or 4 alerts that are impacting the business vs. the 4,997 alerts that are just noise?
The answer is Business Transaction Management. When you can manage all business transactions across all tiers all of the time you have total visibility into how your business runs on IT. More importantly you can quantify business impact in real-time by seeing with your own eyes which business transactions, users and applications are experiencing service level breaches. You manage IT with business impact so that you can truly prioritise your teams and resources to deal with the incidents that are most detrimental your business. Gone are the days when your IT support department manages IT with traffic lights based on infrastructure alerts or by investigating each alert as it arrives in the inbox that is running out of disk quota.
Not all business transactions, users and applications are equal. Just like not all emails, enhancement requests and PRD’s are equal for a product manager. If you can’t prioritize and focus on the things that have an impact on your business then the amount of value you’re providing to that business is pretty questionable. In many organizations the business is IT and without IT the business would fail. It’s therefore essential that IT is aligned to the needs and priorities of the business.
Business Transaction Management has Disco Fever
Life is dull when you can predict everything that is going to happen. For instance, I was driving home last week in rush hour on the M4 in the fast lane and in my mirrors I could see a black car approaching quickly. A few seconds later this black TVR Tuscan with big yellow stripes was behind me, pretty cool and a pretty rare sight on a motorway. As the traffic ground to a halt the owner of the TVR pulled into the middle lane next to me and rev’d his engine to prove a point whilst looking at me with a smug grin. The first thing that entered my mind was “Your car’s not going to last long sitting in this traffic mate”. Guess what? A few minutes later smoke started pouring out the front of this TVR with the owner looking pretty stressed. I was laughing and feeling smug also but not surprised in the slightest as the TVR pulled into the hard shoulder in a cloud of white smoke. For those not familiar with TVR sports cars, they are about as reliable as the Windows Operating System with no firewall or anti-virus protection – you leave them to idle and your in trouble.
Today, I can’t help thinking that enterprise monitoring is largely predictable, or even somewhat dull despite servers and applications going up in flames occasionally. For the people who manage helpdesks or application support, monitoring software is about as interesting as watching a set of traffic lights for 8 hours a day. The lights turn red, all hell breaks loose and the blame finger comes out. The lights stay green and you can kick back on Face Book or Twitter and see whose updated his/her status (only joking) or read blogs that describe just how your feeling
Enterprise monitoring needs an adrenaline boost, it needs mojo, it needs to shock and deliver answers to problems that you would never have predicted or guessed. If you can predict or assume why outages might have occurred then it becomes quite boring blaming the same DBA or network administrator every week. When the database is slow everybody assumes it’s a missing index or the DBA hasn’t updates the table statistics for several years. If the JVM is firing OutOfMemory exceptions everybody assumes it’s a memory leak and gets paranoid about finding the irresponsible code without checking JVM memory parameters first like MaxPermSize which will often resolve 90% of memory issues. Another classic example is where a JMX metric shows connections to the database are being exhausted so the first thought is to increase the database connection pool size in the JVM without actually figuring out what’s holding onto the exhausted connections (like slow SQL) in the first place.
Imagine if your enterprise monitoring software provided you with answers that shocked you. Imagine if you were in denial for a split second or even freaked out at the prospect that the solution to your problem is something which you’ve never even considered before. To be shocked you and your enterprise monitoring software first needs to be able to discover new things. The traditional way to deploy enterprise monitoring software is to ask the customer “Which servers/tiers do we need to put an agent on or monitor?”. This approach means customers get visibility into the server/tiers they are expecting their application and business transactions to flow through. The data provided is therefore predictable and somewhat unexciting.
Forget about monitoring servers/tiers for a moment (or a few years). Imagine if you monitored business transactions instead and their respective flows – things start to get interesting very quickly. Wherever the business transaction goes so does your monitoring capabilities and visibility. You begin to discover servers and tiers that you never imagined your business transactions or applications utilised. You begin to learn new things about how your applications and business transactions behave, you learn their dependencies, their interactions and more importantly their contributions in managing your service levels and end user experience. Welcome to the world of Business Transaction Management (BTM).
Being shocked is a good thing
I’ve seen many customers shocked, in denial and more importantly buzzed about what BTM can do for them and their organisation. Seeing a customers face is priceless when you tell them that their business transactions flow from their production application servers to a UAT test database. It’s even more priceless when you here them pick up the phone and describe it to other people in their organisation that real users business transactions are executing against a UAT test database. Its also impressive to show customers their real application topology based on business transaction flow than to keep referencing the partial diagram they think their application actually uses. It was only last week where BTM pointed out four application tiers to a customer that had no idea the tiers actually existed. Shock, denial and then amazement would be how I described that customer.
Apologies to those reading this blog who were expecting references to Disco Funk, big hair, big flairs and the king of pop. All I can say is that Business Transaction Management discovers lot of things that make life a bit more exciting and unpredictable. If everything was predictable then managing IT wouldn’t be fun each day.
Why BTM Complements APM Solutions
Something that has become clear in my mind over the last year is that Business Transaction Management (BTM) is very different to the popular Application Performance Management (APM) solutions we’ve typically seen in the market place over the last 5 years. I base my opinion solely on an important group of people we’ve come to know over the years as “customers”.
My father once taught me an important lesson whilst he was arguing with a waiter in a restaurant, something along the lines of “The customer is always right”. In fact, it was only recently I used the exact same phrase whilst interacting with the security staff at EL AL airport check-in. After a few puzzled looks, baggage checks, several questions and two stickers I was on my way. Anyway, my point is that customers are generally a good indication as to whether something is good, bad, useful, different or valuable.
In the last year I’ve sat with several Fortune 500 customers who have ALL told me that BTM is changing the way they utilise their APM investments. In fact, two of these customers actually shared with me their IT service delivery and support processes so I could see with my own eyes where BTM and APM were playing a key role towards the common objectives of improving end user service levels, performance and availability. Simply put, BTM was used to identify, alert, prioritise (understand business impact) and isolate issues whereas APM was then used to understand root cause and resolution of these issues.
For example, in real-time BTM could detect a user specific transaction that breached in the application, it could then provide an immediate latency breakdown across all tiers where that problematic transaction traversed. Once the latency is isolated to a specific tier the customer can then focus their APM solutions to that tier and understand the root cause and apply a fix. The net result of all of this is that Mean Time To Resolution (MTTR) or Recovery (take your pick) is significantly reduced. One BTM customer dropped MTTR from 2 hours to under 15 minutes using both BTM and APM effectively together.
User’s experience transactions, its therefore important that BTM provides you with visibility of every transaction from every user across every tier so you can focus your APM solutions in seconds to the tiers that are causing issues. When your application spans tens or hundreds of tiers you need to isolate the right haystack before you start looking for that needle.
OpTier
Assaf Amit
Andy Wetzel
Russell Rothstein
Motti Tal
Linh C. Ho
Diego Lomanto
