Posts Tagged Application Performance Management
APM – Why bigger isn’t always better
by Stephen Burton, May 18th 2010.
I’ve been in the IT management/monitoring space now for almost 6 years. 6 years might not seem a lot but from what I’ve experienced not a lot has changed in the application performance management (APM) market. I glanced at the Gartner MQ a few weeks ago and the same old (and they are old let’s be honest) players were there in the leader quadrant, these vendors being HP, CA, Compuware and Quest. Leaders are normally people I aspire to be like or follow, they should inspire, excite and as their name suggests “Lead”, they should innovate and make the customers life easier. Please therefore excuse my sarcasm while I take a few seconds to think of all the innovation and inspiration these companies have given me…1 millisecond pause…right moving on.
The APM market from what I’ve seen over the last decade was driven from two needs a.) Database Performance Management and b.) J2EE Performance Management. Sure you had things like Road Runners and Profilers but those things were more used in dev/test rather than production environments where pain and business impact were real. And so database and J2EE performance management solutions came to market around the late 90’s with the premise to manage “application performance”. The simple fact is that these solutions were never built to manage applications across the enterprise, they were built to manage pieces of applications (e.g. JVM’s and databases). They became a victim of their own success to a large extent, they were fine at managing up to 100 database or J2EE nodes but they never really provided customers with that “End to End” application or enteprise view. The only end to end view they could provide was the end to end within a Java Virtual Machine (URL to SQL, Servlet to JDBC) or a relational database (SQL to Objects), many tried to correlate J2EE activity with database activity and failed, some succeeded but even seeing J2EE to database calls is not true “End to End” unless you ignore things like web servers, authentication servers, ESB’s, Mainframes, Message Brokers , 3rd party web services calls and other tiers which applications environment still have but are not covered in general by today’s APM vendors.
Yes, many vendors tried to expand their “End to End” coverage and acquired new technology in the space of end user monitoring, synthetic transactions & change mgmt but those solutions were never truly integrated together to make the customers life any easier. The result was a monumental jigsaw puzzle (known as the “APM suite”) held together with super glue and string. These giant jigsaws were put together and managed with professional services and support departments, all of which cost the customer money, patience and frustration. It’s therefore no surprise to learn that these vendors have spent the last 4 years re-writing their architectures to make all the bits work together. The bad news is that most of these vendors forgot about the most important piece of the jigsaw: business transactions.
I recently interviewed around 20 enterprises in the last 6 months for a project I’m working on. The purpose of my research was to learn about the strengths and weaknesses of today’s APM solutions. Pretty much all of the enterprises I interviewed already had solutions from who Gartner classified as “leader”. Therefore you’d expect to hear how APM was transforming the lives of customers and helping them generate more ROI than a city banker (pre 2008). To my surprise the results weren’t encouraging or good, the feedback I got was consistent and almost desperate from a few enterprises. APM solutions were great from a feature and data collection perspective but the physical effort, resource and investment to deploy these solutions was prohibitive. Too many moving parts, points of failure and pieces to deploy, configure, manage and support. Many of the people I met spent more time administering the performance of their APM solution management servers than their own applications! It seems many APM solutions just grew up to be big expensive monsters that were so impossible to manage many customers simply gave up, not because the solutions weren’t any good they just didn’t have enough time and patience to install and configure them across their portfolio of applications. When you’ve got to manage multiple applications across several hundred servers you want to be managing your applications and NOT your APM solution. That is unless you want to work long hours with many sleepless nights.
So what caused this response from enterprises? Well, by nature these APM solutions collect a lot of data to satisfy the needs of the technical people who develop and manage each and every application and database. Everyone has their own way of solving problems which is why you need thread metrics, JMX metrics, OS metrics, session metrics, invocation metrics, JDBC metrics, I/O metrics, CPU metrics, heap metrics, process metrics, SGA metrics, locking metrics, metric this, metric that, my favourite metric, his favourite metric, her favourite metric, my dogs favourite metric and so on. I think many APM vendors lost track of what is relevant when it comes to managing application performance and availability. They focused too much on monitoring application components rather than these things called business transactions that make their customers business run on IT. Customers care about their business, they don’t care about individual JVM’s, databases or other tiers. If the business is hurting they want to know the when, who, what & why so they can make it stop hurting. It’s about time IT was able to feel the business hurting and act accordingly rather than responding to infrastructure alerts, events, log files, exceptions and CPU spikes.
I’ve noticed now a lot of APM vendors talk about business transactions and are moving into the business transaction management, transaction performance management and business transaction performance space. This is a very good thing for customers, maybe we’ll finally see some innovation to help customers manage IT based on the needs and priorities of the business rather than JVM’s or Oracle databases.
Add comment May 18, 2010
Pages or people? OpTier has redefined end-user experience monitoring.
End-User Experience Monitoring. Real User Montoring. The key words here are Experience and Real. When you are choosing a solution for monitoring the experience of your customers, partners and employees, it’s critical to keep their perspective in mind.
What’s important to your users – pages or transactions? When you are banking online, and it’s taking a long time to view that suspicious-looking check that you supposedly wrote last week, do you care about the rest of the page? The page probably includes more information about your account activity and enables you to conduct additional transactions like transferring funds and tracking automatic payments. But you may not even know what page you are on. Your only concern is the business transaction that you are currently trying to complete – viewing your cancelled check.
Yet most end-user experience monitors track pages or page objects. Pages are significant to application developers, but they are rarely meaningful to users or the business. Of course we need to track information about pages in order to isolate and resolve problems. But in order to understand the user experience, and to triangulate that with SLAs and business priorities, you need to monitor and measure the performance of business transactions.
Part of the problem with monitoring pages lies in the definition of a page. Technically speaking, a page is a URI, a Unique Resource Identifier. But what the user views as a page may actually be a container displaying a number of URIs. When we are monitoring pages, it’s important to be able to track and analyze the page as a transaction – the way the user experiences it – as well as in its component parts. Given all of this complexity, it’s also important to be able to identify, classify and group the page components automatically, while leveraging as much meaningful information as possible. Otherwise, you are going to spend a lot of time manually “recreating” the application your users experience from an assortment of objects and content items with unrecognizable names.
According to one industry analyst, “One of the key goals in deploying end-user monitoring solutions is to move from an IT-centric view to actually realizing how IT is contributing to business goals. The value of end-user experience information significantly increases if organizations have capabilities for translating application performance metrics into business metrics such as lost revenue opportunities, conversions, the value of transactions failed, application utilization, disruptions of business processes, etc.” By using a Business Transaction Management (BTM) approach to End-User Experience Monitoring, you can evaluate your users “real experience” and measure its impact on your business.
Add comment April 28, 2010
Gartner, Forrester, et al: IT Spending and BTM
It’s no secret that the business transaction management (BTM) market has taken off big time. Whereas just a couple of years ago, OpTier was single-handedly pioneering and educating the market about BTM, today just about every application performance management (APM) vendor is pitching some type of transaction profiling capabilities. The marketing barrage and hype are reaching fever pitch, oftentimes confusing enterprises about what truly constitutes BTM. In a market with inflated expectations, a good industry analyst will help end-user organizations separate the wheat from the chafe and identify the vendors that can deliver the goods. (Whereas the less proficient analyst will focus on creating snazzy yet vapid infographics.)
The good analysts aren’t afraid to ask tough questions and dig down deep into the details of technology, strategy and vision to get to their conclusions. So it’s not without a bit of amusement that we find that the major analyst firms are themselves out of sync in their predictions about the size of overall IT budgets in 2010. Gartner predicts that IT spending will remain flat in 2010, Forrester says IT spending will rebound strongly in 2010, and to round things out, Ovum sees that IT spending will grow only slightly.
And while the analyst groups differ regarding 2010 IT budgets, they all agree about one thing – BTM is growing fast and consuming a larger part of the IT software budget. Forrester has reclassified the APM market to include both APM and BTM, reflecting the increasing role that BTM is playing in managing application performance. And Gartner says that BTM is fundamental because it is the very center of application management.
So it’s no surprise that OpTier closed out Q1 with another blow-out quarter, penetrating into new geographies and vertical markets. Go no further than recent tweets by our SVP of worldwide sales replete with CAPS and lots and lots of exclamation points:
Stay tuned for public announcements of new customer wins and exciting news – we promise to keep the punctuation marks to the bare necessity… (!!!)
Add comment April 19, 2010
The Oscars of Private Cloud Management
It was fun to watch the Academy Awards this year – a glitzy evening replete with glamorous movie stars, stylish attire, and most importantly to those of us from the software industry, totally cool computer-generated characters. (Unless you preferred to spend the evening watching your favorite Super Bowl commercial for the umpteenth time or the latest OK Go video instead.) It’s a night where aspiring actors and screenwriters silently wish that next year they’ll get that break to make it to the Oscars, and we wish we had taken that extra course in computer graphics in college, observing the box-office proceeds from Avatar and Alice in Wonderland.
And while OpTier won’t be releasing a 3-D feature film any time soon, we do believe a multi-dimensional approach is critical to that new genre of enterprise IT service management – managing private clouds. Private clouds are becoming more pervasive – according to Gartner, by 2012 enterprises will spend more than half of their cloud dollars on private cloud services because of improvements in cost and management efficiency.
OpTier BTM provides performance management, resource management, and cost-based accounting for private clouds
That’s where the 3-D approach comes in. Some enterprises erroneously assume that since virtualization is the enabling technology for clouds, then virtualization-centric management systems are sufficient for managing cloud-based services. In effect, they are extending the flawed silo-based APM approach to IT management by applying another one-dimensional toolset to manage virtual hosts and guests in the cloud. (It’s no surprise that in these cases, when a performance issue occurs in the cloud – everyone first blames the “VM guy”.)
OpTier takes a multi-dimensional approach to the cloud. In order to provide true end-to-end service management in the cloud, you need to include visibility into both virtual and physical metrics. Only with a business transactional-based approach do you have 3-D visibility to cover the three key dimensions of transactions that flow through the cloud:
- Time per transaction (i.e. cloud performance management)
- Resource utilization per transaction (i.e. cloud capacity management)
- Cost per transaction (i.e. chargeback and activity-based costing for the cloud)
Frost and Sullivan found that two of the top three concerns about cloud are loss of control and availability. OpTier’s business transaction management approach to private clouds is the most efficient manner to address these concerns – enabling organizations to take control and assure 24/7 availability of services in the cloud.
So the OpTier 3-D feature film may be off in the future, but for some time already, OpTier customers have been using OpTier BTM’s 3-dimensional approach to manage services in the cloud on a daily basis. Now that’s worth an Oscar speech.
Add comment March 7, 2010
Virtualized in Vancouver
We’re fascinated by what’s going on in Vancouver this month. Sure, there’s a lot of drama, action and suspense going on over at the Winter Olympics (such as the valiant efforts of the Jamaican Freestyle Skier to be the first to restore the pride of winter sports to his homeland since the 1988 Jamaican Bobsled team) but we’re even more intrigued by the less mesomorphic young singles cross-town in Vancouver engaging their social skills in a flittering party – flirting virtually with one another through the twitter platform.
For those of you not previously familiar with flittering, it means sending a flirtatious tweet to someone that interests you in the room. And while having the option of flirting online is generally a good thing as it provides a new way for people to find their match, it presents a management challenge – keeping up with the fast pace of the tweets and achieving the visibility to link the virtual (witty tweets) with the physical (cute guy or gal – hopefully).
We find these issues remarkably similar to the management challenges companies face when deploying virtualization. While virtualization presents huge benefits in efficiency gains, it also creates three application management challenges:
- Lost Visibility: Applications become more difficult to manage because virtualization masks the underlying infrastructure layers. It becomes difficult to isolate the problematic tier when a problem occurs, or even understand that a problem is starting to occur before users are impacted. Likewise, it is difficult to determine the impact of VM changes on performance.
- Dynamic Environment: If becomes difficult to keep up with speed of changes in virtual infrastructure. As the folks at EMC call it – “VMotion Sickness”. Then when application performance begins to degrade, people tend to first blame the VM administrator, even if the problem lies elsewhere.
- Overprovisioning: Due to lack of visibility, enterprises often overprovision infrastructure in order to assure performance. Overprovisioning physical hosts (e.g. extra CPU) reduces the cost savings of virtualization.
Virtualization-aware Business Transaction Management addresses these challenges. With OpTier BTM you can regain the visibility lost from virtualization, keep up with changing VMs, and rightsize to maximize cost efficiencies. And while that last sentence would fit into a 140-character tweet, we’re not sure it would get us any dates at the next flittering party.
Add comment February 22, 2010
You can only see what you can see.
by Stephen Burton, 6th December 2009.
I read a discussion last week on the internet where a person asked a simple question “How can I get an End to End latency breakdown of my business transactions”. Before I’d even had chance to comment I noticed that two software vendors had already replied with links to their website claiming that they deliver exactly what the original poster was asking for (imagine the odds of that eh? 
).
End to End beyond J2EE and .NET
1 comment December 6, 2009
BTM – the pain relief for CMDB?
by Stephen Burton, 2nd November 2009.
I have yet to meet a satisfied customer with a CMDB. It’s not like I go looking everyday but somehow the subject always seems to arise and people tend to get quite touchy on the subject. It wasn’t so long ago I worked for a company who spent a fortune acquiring an application discovery and mapping solution. It promised auto-discovery in real-time and all those wonderful things yet it seemed to die a cold death months after the acquisition closed. I listened to the sales pitches around “When applications go down the first question asked is ‘What changed’?” and the famous “75% of application outages are related to change”. To me that’s like stating the bloody obvious, of course something changed, if nothing changed the application would be still running.
The problem these early discovery & mapping solutions lacked is business context. They were inherently built to track IT interactions from server to server and technology to technology. They’d scan server ports, executables and protocols to try and piece together the relationships between IT assets within a data centre. Or they’d do it by listening to the actual interactions. They’d paint pretty little diagrams like the London Tube Map and then give you all the technology, versions and patch levels these assets were running. Some solutions were priced per cpu which can be highly lucrative when vendors told customers to put an agent on every server in their data centre. Unfortunately the one thing they didn’t discover or understand was the business services that ran across these IT assets. Applications and Business Services these days don’t just relate to 4 apache web servers, 8 weblogic servers and 1 Oracle database. The pervasiveness of SOA and mashups these days means a single IT asset can serve one or more business services. Applications and IT Assets no longer have a 1 to many relationship, an application isn’t simply a collection of segmented IT assets.
I did a search on Wikipedia for CMDB and found the quote “A key success factor in implementing a CMDB is the ability to automatically discover information about the CIs (auto-discovery) and track changes as they happen.”. If a business service is a CI then that’s a pretty tough proposition to auto-discover and track change on. How do you discover business context from IT assets? For starters you can stop looking at the IT assets for answers, you’ll get your versions and patch levels of Linux but you won’t get a description of your business services that flow through them.
I’ll put my head on a lance and state that Business Transaction Management (BTM) can add significant value to any CMDB project. When you start to monitor business transactions you start to acquire lots of key intelligence on how your business runs and maps to IT. You auto-discover transaction flows and the IT assets they interact with, all in real-time. It also gets better, you can store all this data historically so that you can report and compare business services and their CI’s before and after a change. You can even visualise how the business and IT asset dependencies change over time using transaction flow/topology diagrams as key evidence. When a change occurs on an IT asset you can instantly report whether this change had a positive or negative impact on your business services or transactions by reviewing related latency and SLA. I’m not claiming BTM is the answer to all CMDB pain but it solves some of the most basic and common challenges:
- Auto-discovers business services and their IT dependencies in real-time
- Stores information historically so you can track, report and quantify change when it occurs
Maybe BTM is the pain relief CMDB projects need right now.
5 comments November 2, 2009
BTM what is it for me?… really
While on my spinning bicycle in class this early morning on a cool New York day, I was cycling and grooving alon
g on Diana Ross “if there’s a cure for THIS, i don’t want it”….. Being thankful I have time to do things I love. It reminded me of discussion I had with people working in IT multiple times; we IT have it though there is very little time for personal life:
we know our users are complaining, we know we are losing business, we have been trying to identify the issue for days, I am losing credibility, I missed several friends dinner, I work every weekends, I have to leave the office now because I have to jump on a change management conference call while driving with the kids screaming in the back of the car. I have other things on my plate, like launching our new private banking services, budgeting for new servers to address our merger with ABC company, I need to grow my business, we can’t even have a feel on how our services behave nor identifying simple problem such as one out of five times the browser hangs when entering employee badge number. The assumption I made last week on where the problem might have been are now wrong, the change management team applied a patch against that specific application and the problem didn’t go away. I am stress and tired…. I am stress and tired…. I am stress and tired…. I am stress and tired….
IT experts would say: “I have tools several, several, several, several tools, and it is true after triaging all the alerts, the tools were able to isolate issues but I really just care about what impacted my users in company ABC. What is the behavior of my most revenue generating transactions today and what will it be after we merge the two companies’ systems next week, how would I know if it improves or degrades the overall business service?”Familiar with THIS? What if you would take a peek at introducing Business Transaction Management (BTM) into your IT process?
You would finally see at this moment the IT consumers and IT producers of business transaction information, knowing whom and what is impacted, focusing only on the most important services. What if you knew the exact flow of the information and the behavior of your special revenue generating credit card application transactions? BTM is a source of rich IT information. It is much more than incident management, you can not only understand the current behavior and plan for growing your business you can see the impact on your services of an unplanned or planned change.
This is the cure to resolve the “THIS”, today, tomorrow, next week, on a constantly changing fluid IT environment. Really who could have predicted that you would transact business via text messages? With this information on hand feel free to use those specialized tools and apply them appropriately to isolate granular application components issues but change the way you think about managing IT, It is not always about technical components. Now, I won’t cure all your stress and fatigue as there always be screaming kids, traffic, lines at the coffee shop but one less thing to worry about, getting a little more of your personal life back, one more thing to proudly walk to your management and really feeling good that you know the “THIS” at every moment of the day and I guarantee you will be grooving along a Disco song….
Add comment October 22, 2009
What’s Clear About Net Neutrality
The debate going on in Washington and the blogosphere around Net Neutrality is reaching fever pitch. If you haven’t been following the issue (no doubt due to spending too much time following your local gas station on twitter), it boils down to whether ISPs have the right to control what flows over their pipes or whether Internet users have the right to get unencumbered access to anything out on the Net. We’re especially intrigued by the debate going on in the Network World blogs between Johna Till Johnson and the dynamic duo of Sevcik and Wetzel. (Disclaimer: OpTier is a member of the Apdex alliance led by Peter Sevcik.)
Which brings us to our point that we can’t wait until someone buys the assets of Clear Corporate and restores the service. Clear is the company that created the speedy security lanes in the airport for those of us who hate to stand in long lines. Bidding is currently on to buy Clear’s assets from Morgan Stanley who took possession of the company when it went bust. (Note to our CFO: Don’t use money invested by Morgan Stanley in OpTier to make bid for Clear.)
You may be asking what Net Neutrality has to do with Clear. The answer, of course, is prioritization. Prioritization of data flowing over the network. Priority of people in airport security lines (very busy and important businesspeople, mind you). We here at OpTier think a lot about prioritization – prioritization of troubleshooting activities when outages occur, prioritization of infrastructure spending to maintain service levels, prioritization of virtualization deployments, and in general, prioritization of IT management in order to best support the goals of the business.
We believe prioritization is at the heart of the BTM approach and that’s what sets OpTier apart from the traditional APM vendors, even as they start to talk about business transactions in their pitches. While these vendors are cobbling together a group of silo monitoring tools using correlation techniques, we believe that true BTM means complete visibility into how every single business transaction executes from the end-user across all IT components with a complete breakdown of latency, resource consumption and SLA compliance.
Now that’s even worth waiting in line for.
Add comment October 12, 2009
Another “Less is More” Blog for ITSM and BSM Solutions
I’m jealous and in denial with several of my colleagues at work. It may have the “compare the meerkat” ring tone but my mobile phone was replaced last week with a new model of berry and I have to report I still feel inferior. It’s like I just traded a Porsche Boxster for a Boxster S, sure it’s a nice upgrade but everything is relative and unfortunately everyone around me is driving a 911 Turbo at the moment in the form of an iPhone.
Still, I’m not bitter. I think the introduction and innovation of the iPhone was exactly the kick up the ass that the mobile phone market needed. Think different is what Apple did and I think many IT vendors today should be following the same type of attitude for IT service management solutions. If I rewind the clock back just 5 years I owned a Sony Ericsson phone to make calls, a canon 2MegaPixel camera to take photos, an iPod “brick edition” to listen to music and a Dell laptop (also Brick Edition) to surf the web and do email. Today, I can get all that from an iPhone. The good news according to all my smug friends is that this iPhone thing actually works and is also quite sexy or something. The fact the camera, ipod, phone and browser are all integrated into the handset with an intuitive user interface is what is most impressive. If I owned an iPhone I wouldn’t need to buy 4 products from 4 different vendors.
ITSM & BSM - Lots of pieces integrated but not the picture you expected.
Now try comparing with what I just said against the IT service management landscape today. Customers are buying ten to twenty point products to manage the different functions and components of IT. Most of which were never intended to work with each other from day one and have so many customisations that migrating to new versions is like moving house rather than redecorating the one you already own. Customers buy separate tools to manage end users, networks, servers, JVM’s, CLR’s, databases, storage and that is just a short list. That’s a lot of GUI, in fact that’s a lot of user logins and products to physically deploy, train and support across your IT organisation. And yet so often we hear the words “Less is More” used in conversation and sales pitches despite many vendors being responsible for most of this huge complexity in the first place. The key issue isn’t so much the number of products, it’s the way in which real users can navigate and perform real use cases to exploit the information across multiple products so they can manage IT more effectively. Dashboards in my opinion do not solve this issue, they provide a quick fix and band aid which is often used by a sales team to try and promote “single pane of glass” views and “OOTB integration” yet in reality dashboards often limit navigation and task orientated use cases where you need to go from high level to low level data using a common context.
We announced a new product at OpTier last week which helps customers understand and manage their end user experience. Rather than create a new standalone product we listened to customers right from the start and did what they asked. We built the new product using the same framework we used to build our first product CoreFirst. Customers get all the benefits and features of a new product but they get it without all the drawbacks of buying yet another product to manage their IT services and components. They have a single GUI, a single data repository and a single user login to access both our products. Customers now get visibility of their end user experience with a complete profile of the business transactions that constructed those experiences all in a single click. We hid the technical complexity just like Apple did with the iPhone and on top of the integration we also decided to make the GUI more sexy in the process.
I may not own an iPhone but that doesn’t stop me appreciating what can be learnt from such innovation.
Add comment October 5, 2009
Lindsay Diamond
Assaf Amit
Andy Wetzel
Stephen Burton
Russell Rothstein
Motti Tal
Marie-Pierre Belanger
cpennoptier
Linh C. Ho
