Posts Tagged OpTier

BTM 2.0 | My Thoughts

Stephen Burton, 29th June 2010

Business Transaction Management (BTM) this year became 5 years old. It’s currently the new kid on the block and has subsequently forced many APM vendors to switch their strategy to focus on a more business centric value proposition around business transactions rather than their legacy of monitoring IT silo’s. In fact, you’d be hard pressed to find an APM vendor these days who isn’t talking about business transactions and their crusade around “End to End” performance management. From my perspective BTM 1.0 has been delivered to the market and I’m very much looking forward to contributing to the next generation of BTM capabilities, let’s call it BTM 2.0 for arguments sake.

BTM 1.0 in my opinion was about providing visibility of all business transactions across all tiers all of the time to allows customers to manage IT from a business perspective. BTM 1.0 implementations typically focused on a single mission critical application or “business service” (if we’re looking at things from the business perspective) in a production environment where business impact is real and pain is felt the most. Customers who experience BTM 1.0 see things they’ve never seen before, this is why more and more IT mgmt vendors are keen to develop or acquire BTM capabilities. Whilst BTM 1.0 is coming to market nicely I’m already thinking of the future and where BTM is heading.

End to End for an Application

BTM 1.0 - End to End for an Application

For customers who thought BTM 1.0 was good, things are about to get better as they’ll be more unique visibility on the way with BTM 2.0. Why? Because customers are telling me they want to see the complete picture of their inter-connected business services (and if you’ve read my previous blogs – the customer is always right). The pervasiveness of Service Orientated Architectures (SOA) has been very visible from the customers I’ve been chatting to. Combine the last five years of SOA with customer’s recent consideration around cloud computing and you really begin to understand why complete visibility of inter-connected business services along with their dependencies is becoming critical to IT mgmt.  When a business service relies upon another business service or several business services customers need complete visibility of these dependencies so they can understand and manage the business services and business transactions that is really impacting their end user experience and ultimately their business. Without this visibility customers today are managing their business services in a silo’d approach which is fine if youe business services have no dependencies with other business services or they don’t run on a grid, utility or shared services environment. If they do have dependencies, run on shared services or are distributed across data centres and/or in clouds then they’re going to need good visibility in order to manage them effectively. This is where I believe BTM 2.0 will help customers; once again helping them see things they’ve never seen before so they can make smarter decisions and manage IT more effectively with complete visibility of how the business runs on IT. When a business transaction is executed by a user the customer should have full visibility of how that business transaction interacted with other business services and the infrastructure which underpins them. Seeing a complete jigsaw is better than seeing the pieces individually laid out, in my opinion BTM needs to provide the complete jigsaw view.

End to End for the Enterprise

BTM 2.0 - End to End for the Enterprise

I’m looking forward to making BTM 2.0 happen with our customers, tracking business transactions across one business service is done, tracking business transactions across multiple business services is where it’s now at. End to End is about to shift from the application perspective to an enterprise perspective and I can’t wait to see what topologies we’ll be drawing for our customers over the next 18 months.

Add comment June 29, 2010

APM – Why bigger isn’t always better

by Stephen Burton, May 18th 2010.

I’ve been in the IT management/monitoring space now for almost 6 years. 6 years might not seem a lot but from what I’ve experienced not a lot has changed in the application performance management (APM) market. I glanced at the Gartner MQ a few weeks ago and the same old (and they are old let’s be honest) players were there in the leader quadrant, these vendors being HP, CA, Compuware and Quest. Leaders are normally people I aspire to be like or follow, they should inspire, excite and as their name suggests “Lead”, they should innovate and make the customers life easier. Please therefore excuse my sarcasm while I take a few seconds to think of all the innovation and inspiration these companies have given me…1 millisecond pause…right moving on.

The APM market from what I’ve seen over the last decade was driven from two needs a.) Database Performance Management and b.) J2EE Performance Management. Sure you had things like Road Runners and Profilers but those things were more used in dev/test rather than production environments where pain and business impact were real. And so database and J2EE performance management solutions came to market around the late 90’s with the premise to manage “application performance”. The simple fact is that these solutions were never built to manage applications across the enterprise, they were built to manage pieces of applications (e.g. JVM’s and databases). They became a victim of their own success to a large extent, they were fine at managing up to 100 database or J2EE nodes but they never really provided customers with that “End to End” application or enteprise view. The only end to end view they could provide was the end to end within a Java Virtual Machine (URL to SQL, Servlet to JDBC) or a relational database (SQL to Objects), many tried to correlate J2EE activity with database activity and failed, some succeeded but even seeing J2EE to database calls is not true “End to End” unless you ignore things like web servers, authentication servers, ESB’s, Mainframes, Message Brokers , 3rd party web services calls and other tiers which applications environment still have but are not covered in general by today’s APM vendors.

Yes, many vendors tried to expand their “End to End” coverage and acquired new technology in the space of end user monitoring, synthetic transactions & change mgmt but those solutions were never truly integrated together to make the customers life any easier. The result was a monumental jigsaw puzzle (known as the “APM suite”) held together with super glue and string. These giant jigsaws were put together and managed with professional services and support departments, all of which cost the customer money, patience and frustration. It’s therefore no surprise to learn that these vendors have spent the last 4 years re-writing their architectures to make all the bits work together. The bad news is that most of these vendors forgot about the most important piece of the jigsaw: business transactions.

I recently interviewed around 20 enterprises in the last 6 months for a project I’m working on. The purpose of my research was to learn about the strengths and weaknesses of today’s APM solutions. Pretty much all of the enterprises I interviewed already had solutions from who Gartner classified as “leader”. Therefore you’d expect to hear how APM was transforming the lives of customers and helping them generate more ROI than a city banker (pre 2008). To my surprise the results weren’t encouraging or good, the feedback I got was consistent and almost desperate from a few enterprises. APM solutions were great from a feature and data collection perspective but the physical effort, resource and investment to deploy these solutions was prohibitive. Too many moving parts, points of failure and pieces to deploy, configure, manage and support. Many of the people I met spent more time administering the performance of their APM solution management servers than their own applications! It seems many APM solutions just grew up to be big expensive monsters that were so impossible to manage many customers simply gave up, not because the solutions weren’t any good they just didn’t have enough time and patience to install and configure them across their portfolio of applications. When you’ve got to manage multiple applications across several hundred servers you want to be managing your applications and NOT your APM solution. That is unless you want to work long hours with many sleepless nights.

So what caused this response from enterprises? Well, by nature these APM solutions collect a lot of data to satisfy the needs of the technical people who develop and manage each and every application and database. Everyone has their own way of solving problems which is why you need thread metrics, JMX metrics, OS metrics, session metrics, invocation metrics, JDBC metrics, I/O metrics, CPU metrics, heap metrics, process metrics, SGA metrics, locking metrics, metric this, metric that, my favourite metric, his favourite metric, her favourite metric, my dogs favourite metric and so on. I think many APM vendors lost track of what is relevant when it comes to managing application performance and availability. They focused too much on monitoring application components rather than these things called business transactions that make their customers business run on IT. Customers care about their business, they don’t care about individual JVM’s, databases or other tiers. If the business is hurting they want to know the when, who, what & why so they can make it stop hurting. It’s about time IT was able to feel the business hurting and act accordingly rather than responding to infrastructure alerts, events, log files, exceptions and CPU spikes.

I’ve noticed now a lot of APM vendors talk about business transactions and are moving into the business transaction management, transaction performance management and business transaction performance space. This is a very good thing for customers, maybe we’ll finally see some innovation to help customers manage IT based on the needs and priorities of the business rather than JVM’s or Oracle databases.

Follow me on Twitter

Add comment May 18, 2010

Building a next generation BTM UI

by Stephen Burton, 20th April 2010.

It’s the day after we put the finishing touches to a brand new BTM UI and I feel like I’ve gone 12 rounds with Mike Tyson. It’s true what they say though, No Pain No Gain. I’ve been on the ropes, been knocked down several times but like Elton John says “I’m still standing”. A new baby is born and its certainly not an ugly one. I am expecting a few tears though when our field organization and customers gets their hands on it and start to shake it for the first time.

To be precise or wily it’s taken 18 months, 125 pages, 50+ detailed designs, 65 flights (most to Tel Aviv), 50+ customer meetings/webex’s, thousands of emails, hundreds of arguments, thousands of beers (5 beers per argument) and a good few hundred bugs. All for the sake of Business Transaction Management. Has it been worth it? Absolutely.

Visualise Transaction FlowAbout 18 months ago OpTier made a decision to build a next generation BTM user interface. It was becoming increasingly clear from customers and prospects that the value of BTM touched many stakeholders in the business and IT. Our previous GUI was more focused towards the technical audience being application support teams and application developers. When you track all transactions across all tiers all of the time and provide response time, SLA and resource consumption metrics by Application, Transaction, User, Location and Tiers you end up collecting a lot of valuable information. The problem is how do you show all this information to the right user in the right context? What is relevant for an application owner isn’t always relevant for an application support team or a capacity planner. Showing a technical view to a business stakeholder is like an English person receiving an Hebrew menu in an Israeli restaurant (not good when you’re hungry). Therefore one of the first decisions we made was to make our BTM GUI role based so we could support a variety of users and use cases. Simply put, a user logs in and is presented with a series of “activities” relevant to their role. Each activity (e.g. problem isolation) has a series of tailored views which allows the user to perform that activity using information which is only relevant to that user. For example, a business user is typically interested in business transaction volume, activity and SLA compliance – they don’t really care about CPU usage, tier chattiness or how many I/O operations happen when a business transaction is executed.

The second key decision we made was to make the GUI extensible from both an architecture and user perspective. It’s obviously good to provide out of the box roles, activities and views for our customers. However, the needs of every customer and user is different no matter how hard you try to support every use case. Therefore users can simply create their own roles, activities and views to make BTM information more relevant to them incorporating their own context, terminology and processes. With 13 dimensions (application, transaction, users, locations, tiers, …), 100+ available metrics, 3 working modes, 10 different visualizations (table, charts, clouds, GoogleMaps, …) and a slick graphic design built on top of Flex technology the possibilities to our users are now endless. In the current beta release we support 10 BTM activities with over 75 different BTM views, if users want something different they can go right ahead and create whatever activity and view they wish. Over the next 18 months we’ll be adding more dimensions, metrics and visualization that will help customers truly manage IT from a business perspective, the future is bright.

Visualise transaction SLA with geographical context using GoogleMapsThe last key decision was to outsource the whole usability and graphic design aspects of our GUI. OpTier specializes in tracking transactions across tiers, it does not specialize in designing user interfaces. BTM is our business, usability is someone else’s business (Puzzlehead in this case). I can tell you right now though usability is a political hot potato. Get 2 people in the same room and you’ll get two different opinions on what is intuitive, get 25 people in the room and you’ll get 25 different opinions. You’d be surprised how many times I heard the words “When I used to develop GUI we did it like this…”. As Einstein once said “Insanity: doing the same thing over and over again and expecting different results”. When you work with a usability company you’re implicitly trusting them to do the right thing based on your inputs and feedback. Unless your open minded with usability experts you’ll always look to the past instead of looking into the future. What was relevant 10 years ago in GUI might not be relevant in 2010. GUI from my perspective is more art than science, it has to capture the imagination and invite the user to play. Larry Ellison once said “When you innovate you’ve got to be prepared for people to tell you you’re crazy.”

Like anything which is brand new though, we’ll have our issues. I’m not naïve enough to think that our new GUI will be perfect from day one, it’s a significant improvement and departure from our existing GUI. We’ll be able to show more value than we could have possibly imagined 18 months ago with our previous GUI. Our users can access BTM value in a single click depending on what they are trying to accomplish. You want to see your application CPU consumption over time? Click on this view. You want to understand the business impact of the release you’ve just released to production? Click on this view. You want to see the individual transactions user X executed? Click on this view.

I see this GUI as the start of something new and exciting rather than the end of just another GUI project. GUI’s should evolve and provide users with something fresh, unique and exciting. Innovation isn’t about standing back and admiring what you’ve delivered in the past, it’s about constantly listening to what your customers want and coming up with killer ideas so you can deliver that competitive edge to your business and your customers business.

Follow me on Twitter

Add comment April 20, 2010

The Oscars of Private Cloud Management

It was fun to watch the Academy Awards this year – a glitzy evening replete with glamorous movie stars, stylish attire, and most importantly to those of us from the software industry, totally cool computer-generated characters. (Unless you preferred to spend the evening watching your favorite Super Bowl commercial for the umpteenth time or the latest OK Go video instead.) It’s a night where aspiring actors and screenwriters silently wish that next year they’ll get that break to make it to the Oscars, and we wish we had taken that extra course in computer graphics in college, observing the box-office proceeds from Avatar and Alice in Wonderland.

And while OpTier won’t be releasing a 3-D feature film any time soon, we do believe a multi-dimensional approach is critical to that new genre of enterprise IT service management – managing private clouds. Private clouds are becoming more pervasive – according to Gartner, by 2012 enterprises will spend more than half of their cloud dollars on private cloud services because of improvements in cost and management efficiency.

Cloud management with OpTier

OpTier BTM provides performance management, resource management, and cost-based accounting for private clouds


That’s where the 3-D approach comes in. Some enterprises erroneously assume that since virtualization is the enabling technology for clouds, then virtualization-centric management systems are sufficient for managing cloud-based services. In effect, they are extending the flawed silo-based APM approach to IT management by applying another one-dimensional toolset to manage virtual hosts and guests in the cloud. (It’s no surprise that in these cases, when a performance issue occurs in the cloud – everyone first blames the “VM guy”.)

OpTier takes a multi-dimensional approach to the cloud. In order to provide true end-to-end service management in the cloud, you need to include visibility into both virtual and physical metrics. Only with a business transactional-based approach do you have 3-D visibility to cover the three key dimensions of transactions that flow through the cloud:

  • Time per transaction (i.e. cloud performance management)
  • Resource utilization per transaction (i.e. cloud capacity management)
  • Cost per transaction (i.e. chargeback and activity-based costing for the cloud)

Frost and Sullivan found that two of the top three concerns about cloud are loss of control and availability. OpTier’s business transaction management approach to private clouds is the most efficient manner to address these concerns – enabling organizations to take control and assure 24/7 availability of services in the cloud.

So the OpTier 3-D feature film may be off in the future, but for some time already, OpTier customers have been using OpTier BTM’s 3-dimensional approach to manage services in the cloud on a daily basis. Now that’s worth an Oscar speech.

Add comment March 7, 2010

Virtualized in Vancouver

We’re fascinated by what’s going on in Vancouver this month. Sure, there’s a lot of drama, action and suspense going on over at the Winter Olympics (such as the valiant efforts of the Jamaican Freestyle Skier  to be the first to restore the pride of winter sports to his homeland since the 1988 Jamaican Bobsled team) but we’re even more intrigued by the less mesomorphic young singles cross-town in Vancouver engaging their social skills in a flittering party –  flirting virtually with one another through the twitter platform.

For those of you not previously familiar with flittering, it means sending a flirtatious tweet to someone that interests you in the room. And while having the option of flirting online is generally a good thing as it provides a new way for people to find their match, it presents a management challenge – keeping up with the fast pace of the tweets and achieving the visibility to link the virtual (witty tweets) with the physical (cute guy or gal – hopefully).

We find these issues remarkably similar to the management challenges companies face when deploying virtualization. While virtualization presents huge benefits in efficiency gains, it also creates three application management challenges:

  • Lost Visibility: Applications become more difficult to manage because virtualization masks the underlying infrastructure layers. It becomes difficult to isolate the problematic tier when a problem occurs, or even understand that a problem is starting to occur before users are impacted. Likewise, it is difficult to determine the impact of VM changes on performance.
  • Dynamic Environment: If becomes difficult to keep up with speed of changes in virtual infrastructure. As the folks at EMC call it – “VMotion Sickness”. Then when application performance begins to degrade, people tend to first blame the VM administrator, even if the problem lies elsewhere.
  • Overprovisioning: Due to lack of visibility, enterprises often overprovision infrastructure in order to assure performance. Overprovisioning physical hosts (e.g. extra CPU) reduces the cost savings of virtualization.

Virtualization-aware Business Transaction Management addresses these challenges. With OpTier BTM you can regain the visibility lost from virtualization, keep up with changing VMs, and rightsize to maximize cost efficiencies.  And while that last sentence would fit into a 140-character tweet, we’re not sure it would get us any dates at the next flittering party.

Go Jamaica!

Add comment February 22, 2010

Another “Less is More” Blog for ITSM and BSM Solutions

I’m jealous and in denial with several of my colleagues at work. It may have the “compare the meerkat” ring tone but my mobile phone was replaced last week with a new model of berry and I have to report I still feel inferior. It’s like I just traded a Porsche Boxster for a Boxster S, sure it’s a nice upgrade but everything is relevant and unfortunately everyone around me is driving a 911 Turbo at the moment in the  form of an iPhone.
Still, I’m not bitter. I think the introduction and innovation of the iPhone was exactly the kick up the ass that the mobile phone market needed. Think different is what Apple did and I think many IT vendors today should be following the same type of attitude for IT service management solutions. If I rewind the clock back just 5 years I owned a Sony Ericsson phone to make calls, a canon 2MegaPixel camera to take photos, an iPod “brick edition” to listen to music and a Dell laptop (also Brick Edition) to surf the web and do email. Today, I can get all that from an iPhone. The good news according to all my smug friends is that this iPhone thing actually works and is also quite sexy or something. The fact the camera, ipod, phone and browser is all integrated into the handset with an intuitive user interface is what is most impressive. If I owned an iPhone I wouldn’t need to buy 4 products from 4 different vendors.
Now try comparing with what I just said against the IT service management landscape today. Customers are buying ten to twenty point products to manage the different functions and components of IT. Most of which were never intended to work with each other from day one and have so many customisations that migrating to new versions is like moving house rather than redecorating the one you already own. Customers buy separate tools to manage end users, networks, servers, JVM’s, CLR’s, databases, storage and that is just a short list. That’s a lot of GUI, in fact that’s a lot of user logins and products to physically deploy, train and support across your IT organisation. And yet so often we hear the words “Less is More” used in conversation and sales pitches despite many vendors being responsible for most of this huge complexity in the first place. The key issue isn’t so much the number of products, it’s the way in which real users can navigate and perform real use cases to exploit the information across multiple products so they can manage IT more effectively. Dashboards in my opinion do not solve this issue, they provide a quick fix and band aid which is often used by a sales  team to try and promote “single pane of glass” views and “OOTB integration” yet in reality dashboards often limit navigation and task orientated use cases where you need to go from high level to low level data using a common context.
We recently announced a new product at OpTier last week which helps customers understand and manage their end user experience. Rather than create a new standalone product we listened to customers right from the start and did what they asked. We built the new product using the same framework we used to build our first product CoreFirst. Customers get all the benefits and features of a new product but they get it without all the drawbacks of buying yet another product to manage their IT services and components. They have a single GUI, a single data repository and a single user login to access both our products. Customers now get visibility of their end user experience with a complete profile of the business transactions that constructed those experiences all in a single click. We hid the technical complexity just like Apple did with the iPhone and on top of the integration we also decided to make the GUI more sexy in the process.
I may not own an iPhone but that doesn’t stop me appreciating what can be learnt from such innovation.

I’m jealous and in denial with several of my colleagues at work. It may have the “compare the meerkat” ring tone but my mobile phone was replaced last week with a new model of berry and I have to report I still feel inferior. It’s like I just traded a Porsche Boxster for a Boxster S, sure it’s a nice upgrade but everything is relative and unfortunately everyone around me is driving a 911 Turbo at the moment in the  form of an iPhone.

Still, I’m not bitter. I think the introduction and innovation of the iPhone was exactly the kick up the ass that the mobile phone market needed. Think different is what Apple did and I think many IT vendors today should be following the same type of attitude for IT service management solutions. If I rewind the clock back just 5 years I owned a Sony Ericsson phone to make calls, a canon 2MegaPixel camera to take photos, an iPod “brick edition” to listen to music and a Dell laptop (also Brick Edition) to surf the web and do email. Today, I can get all that from an iPhone. The good news according to all my smug friends is that this iPhone thing actually works and is also quite sexy or something. The fact the camera, ipod, phone and browser are all integrated into the handset with an intuitive user interface is what is most impressive. If I owned an iPhone I wouldn’t need to buy 4 products from 4 different vendors.

ITSM & BSM - Lots of pieces integrated but not the picture you expected.

ITSM & BSM - Lots of pieces integrated but not the picture you expected.

Now try comparing with what I just said against the IT service management landscape today. Customers are buying ten to twenty point products to manage the different functions and components of IT. Most of which were never intended to work with each other from day one and have so many customisations that migrating to new versions is like moving house rather than redecorating the one you already own. Customers buy separate tools to manage end users, networks, servers, JVM’s, CLR’s, databases, storage and that is just a short list. That’s a lot of GUI, in fact that’s a lot of user logins and products to physically deploy, train and support across your IT organisation. And yet so often we hear the words “Less is More” used in conversation and sales pitches despite many vendors being responsible for most of this huge complexity in the first place. The key issue isn’t so much the number of products, it’s the way in which real users can navigate and perform real use cases to exploit the information across multiple products so they can manage IT more effectively. Dashboards in my opinion do not solve this issue, they provide a quick fix and band aid which is often used by a sales  team to try and promote “single pane of glass” views and “OOTB integration” yet in reality dashboards often limit navigation and task orientated use cases where you need to go from high level to low level data using a common context.

We announced a new product at OpTier last week which helps customers understand and manage their end user experience. Rather than create a new standalone product we listened to customers right from the start and did what they asked. We built the new product using the same framework we used to build our first product CoreFirst. Customers get all the benefits and features of a new product but they get it without all the drawbacks of buying yet another product to manage their IT services and components. They have a single GUI, a single data repository and a single user login to access both our products. Customers now get visibility of their end user experience with a complete profile of the business transactions that constructed those experiences all in a single click. We hid the technical complexity just like Apple did with the iPhone and on top of the integration we also decided to make the GUI more sexy in the process.

I may not own an iPhone but that doesn’t stop me appreciating what can be learnt from such innovation.

Follow me on Twitter

Add comment October 5, 2009


Monthly Archives

Meet the Bloggers

Tags

Apdex APM Application Management Application Performance Application Performance Management BSM BTM BTM "Business Transaction Management" "Transacton Management" Business Business IT Alignment Business Model Business Service Management Business Transaction Management Business Transactions Change Management Clear cloud computing CMDB Cost End User Experience End User Monitoring Enterprise Monitoring Experience management Incident Management iPhone IT ITIL IT Outsourcing ITSM Marie-Pierre Belanger Marketing Monitoring MTTR Net Neutrality OpTier People and process ROI Russell Rothstein Stephen Burton Transaction Flow Transaction Management Transaction Performance Management Value virtualization virtualization management

Blogroll