Monthly Archives: March 2010

Avoid the Five Traps of Performance Measurement

Performance measurement, the foundation of supplier performance management, scorecards, and outsourcing deals, is a key to supply chain success but, like everything else, it has to be done right. That’s why I enjoyed the article on “the five traps of performance measurement” (subscription required) that the Harvard Business Review published late last year. If you avoid your traps, you greatly improve your chances of success.

  • Measuring Against Yourself
    While you should measure against past performance and goals to insure that you’re improving, what ultimately matters is how well you’re doing against the competition. And besides, the historical numbers or estimates could be inaccurate (due to poor data collection or manipulation).
  • Looking Backward
    While you should look at year-over-year performance comparisons, beating last year’s numbers is not the point. The goal of performance management is to insure that you’re making the right decisions and following the right processes now, and not following the decisions and processes that were right for last year (and not now). Thus, you should focus on measures that lead, rather than lag, revenue and profit. For example, a smart healthcare insurer, who realized that the sickest 10% of its members accounted for 80% of its costs, offered customers incentives for early screening because preemptive treatments could save it a bundle and increase overall profits.
  • Putting Your Faith in Numbers
    The numbers are meaningless if they’re not accurate (and include good surveys as well as bad), not anonymous and independent, and, most importantly, not relevant to the goal you want to achieve. For example, the NPS (Net Promoter Score), is only relevant if recommendations play a dominant role in a purchase decision. So while it may be quite relevant to a baby-food manufacturer, it may not mean anything to an electricity supplier. An even better example is the application of financial metrics to nonfinancial activities. For example, to avoid outsourcing, IT, HR, and Legal cost centres often create meaningless ROI numbers.
  • Gaming Your Metrics
    Misguided pressures (billable hours for law firms, reserves for oil companies, security valuations for investment companies) and poorly thought out compensation packages can cause many executives and employees to try and “pad” their numbers to get results which are optimal for them but not for the business, which results in skewed metrics. Also, someone who has learned how to optimize a metric without actually having to perform will often do just that. You have to do your best to insure pressures and incentives align with the goals your metrics are trying to capture and then work with the fact that there will always be a select view who will still try to game the metric anyway. One way to do this is to diversify your metrics (so that they capture different aspects of your goal) as it is a lot harder to gain multiple metrics at once.
  • Sticking to Your Numbers too Long
    As your business evolves, your metrics have to evolve with the business. Before defining your metrics, be very precise about what you want to access and what the success criteria is so that you can not only re-evaluate your metrics in light of the goal on a regular basis, but also instantly recognize if the metrics need to change because the definition of the goal you are trying to measure has changed.

Finally, a really good assessment system must bring finance and line managers into some kind of meaningful dialogue that allows the company to benefit from both the relative independence of the former and the expertise of the latter. And if you avoid these traps, the chances of your performance measurement system meeting this requirement are greatly increased.

But of course, measurement is only the first step. The next step is to use those measurements and transform your way to value. And as I pointed out in my last post, you can start with The Hackett Group‘s current study.

Share This on Linked In

What Level of Procurement Performance Are You At?

Last week, Pierre Mitchell of The Hackett Group asked you if you knew the difference between procurement value and procurement performance (part I and part II) over on Spend Matters and invited you to participate in a study that would help you identify where you were on your procurement journey by way of 18 value streams that range from “naive apprentice”, where you’re measuring performance at an elementary level, to “expert sorcerer”, where you’re extracting procurement value at a very advanced level. (Pierre also posted a link to a corresponding finance study that will help Hackett compile a full view on the problem, which Pierre has promised to provide free insights into on Spend Matters in the weeks to come.)

If you haven’t taken the survey, as a serious supply management professional, I highly recommend that you do. I know that 30 to 45 minutes is a lot of time given how busy most of you are, but the 14 page survey is overflowing with more good information on what you might do to become “best in class” and much more informative than the last dozen tragic quadrants, graves, and research griefs that I’ve read from the “major” analyst firms. Organized around the 18 value streams that are designed to take a Procurement organization from “naive apprentice” to “strategic sourcerer”, it forces you to think about the core issues and will help you understand where you are in your Procurement journey and just how far there is to go. This, in turn, will prepare you for the forthcoming posts where I give you the value streams and explain why they are important. These posts will then be followed by more posts from Pierre that will summarize the major results, on Spend Matters, and, at a later date, provide his views on the results and a few of the best practices that might help get you started on your journey, here on Sourcing Innovation.

(For those of you thinking you can skip the survey and wait, I have two things to tell you. First, Hackett, which is the premiere benchmarking and strategic advisory firm in the space, doesn’t give away everything for free — at the very least you have to complete the survey if you want deep insights. Second, if you don’t take the survey and think about the questions with respect to the given alternatives, you’re not likely to fully understand the value propositions Pierre and I will be giving you. Just like you have to prepare your body for a marathon, you have to prepare your mind for knowledge.)

Stay tuned! Much more to come in the weeks ahead.

Share This on Linked In

The Gartner Magic Quadrant for Strategic Sourcing Application Suites, Part II

As I noted in yesterday’s post, while the Quadrant wasn’t all bad, when you added up all the issues, it was more tragic than magic. And, despite the fact that one of my commenters may be right in the observation that it’s not worth the column-inches I’m going to use discussing it, I can’t let it go. Given the importance assigned to this report by the market space, which is equalled only by the Forrester Grave, I need to make sure you don’t misread any of the statements and base a bad decision on them. So, in this post, I’m going to continue taking the most important issues point by point.

Just Plain Wrong: The unique functionality needed to run reverse auctions is a differentiator between simplistic and enterprise-class strategic sourcing applications.
Correction: in 2001. Not in 2010. I can list over 30 providers of reverse auction solutions off the top of my head (and you can find many of them on the resource site). If it doesn’t have reverse auctions, it’s not a sourcing suite. Period. The real differentiator between simplistic and enterprise is true strategic sourcing decision optimization or an advanced analytics platform.

Crazy Talk: The market is far from mature enough to expect competing solutions to be technically comparable.
Correction: The strategic sourcing process has been well understood, and well documented, by the big consultancies since the early 90s. The core technology has been well documented and well understood since the early 00s. From a technology perspective, every sourcing cycle starts with spend analysis; moves to e-negotiation, which includes RFX, e-Auction, and Optimization (which is used to qualify suppliers, gather bids, and analyze them); and ends with contract (creation and) management. Execution generally includes SRM and Compliance, which tracks data used for supplier selection and evaluation in the next sourcing cycle. The basic requirements have been well documented for years. I even co-authored and edited a book that’s been available on Amazon.com, for two years, that anyone who wants to understand the baseline requirements of these solutions can get their hands on. (They can even get an e-version free through Iasta.) So while some of the newer/advanced features may not be directly comparable, most of the standard features are. (And if they weren’t, how could Gartner even author this paper?)

Out of Left Field: Most of the vendors in this report are privately held, and so we considered management turnover, job openings, press and financial filings in our rating of overall viability.
Correction: Viability is financial stability. That’s primarily average annual growth rate, size of customer base and (recurring) revenue, and customer turnover. It has nothing to do with press. And it’s not job openings, it’s employee turnover. If the company is growing, of course it’s going to have job openings!

Positive, not Negative: Company X does not run full-service, reverse auction events on behalf of customers.
Correction: This means that they understand that (a) auctions generally aren’t strategic and that (b) even if the market conditions are optimal for an auction, you’ll get the best result if you engage a category expert and not an auction technology expert. Thus, unless you have those category experts, when you consider that (c) an auction tool should be easy to use, you probably shouldn’t be offering full service events.

Irrelvancy: Sourcing solution lacks optimization functionality (in the description of multiple vendors)
Fact: Of the 14 vendors that made the report, only two have true strategic sourcing decision optimization that meet all of the criteria I outlined years ago in the wiki-paper. Most of the vendors don’t have any optimization functionality at all!

Irrelevancy: Spending analysis: This is a very new product with minimal automated classification capabilities. Most of the cleansing and matching are done manually.
Correction: How many times do I have to say it? It’s the Analysis, Stupid. Classification is not analysis. Cleansing is not Analysis. Matching is not Analysis. (And the right way to do it is to manually define the classification rules so that future refreshes don’t corrupt any data elements that you’ve already cleansed. If you’re using an automated system that uses another organization’s rule set, you’re just asking for trouble!)

Scary: Spending analysis scalability with references reporting analysis of millions of transactions (in the description of a vendor)
Correction: Most big companies have millions upon millions of transactions in their systems. Many have tens of millions, if not hundreds of millions or billions. How could you possibly claim to have an enterprise spend analysis system if you can’t analyze millions of transactions? Considering that BIQ can analyze up to 50M transactions in real time on your laptop with its desktop solution, shouldn’t a true enterprise spend analysis solution be able to handle a few hundred million transactions? (And, before I finish, the report is wrong in dismissing BIQ as a desktop only solution. BIQ also offers a client-server version, which can take advantage of as much server power as you have — and handle hundreds of millions of transactions in real-time if you have the computing power, a thin-client externally hosted web-application through WTS or Citrix, and one of it’s distributing partners is currently beta-testing a new front end creator for the viewer that is built on BIQs XML interface and runs through your browser).

Share This on Linked In

New and Upcoming Events from the #1 Supply Chain Resource Site

The Sourcing Innovation Resource Site, always immediately accessible from the link under the “Free Resources” section of the sidebar, continues to add new content on a weekly, and often daily, basis — and it will continue to do so.

The following is a short selection of upcoming webinars and events that you might want to check out in the coming weeks:

Date & Time Webcast
2010-Mar-10
8:00 GMT-08:00/AKDT/PST
Outsourcing in CEE. Country Overview. Poland
Sponsor: Association of IT & Business Process Services Companies – ASPIRE
2010-Mar-10
14:00 GMT-05:00/CDT/EST
What Does Trade Promotion Optimization Really Mean?
Sponsor: TPMA
2010-Mar-10
10:00 GMT-06:00/CST/MDT
A Practical Guide to Surviving a Software Audit
Sponsor: Scalable
2010-Mar-10
9:00 GMT-06:00/CST/MDT
Q2 Aluminum and Stainless Steel Market Update
Sponsor: Metal Miner
2010-Mar-10
13:00 GMT-05:00/CDT/EST
The Green Product Challenge: How Motorola complies with REACH, RoHS, and more
Sponsor: PTC
2010-Mar-11
11:00 GMT-05:00/CDT/EST
Supply Chain Sustainability
Sponsor: IHS
2010-Mar-11
00:00 GMT-05:00/CDT/EST
Saving Money and Creating Value in a Tough Economy Through Real Estate and Facilities Management
Sponsor: USM

Dates Conference Sponsor
2010-Apr-11 to
2010-Apr-13
SCOPE East
Orlando, Florida, USA (North-America)
Quartz Events
2010-Apr-11 to
2010-Apr-14
SAS Global Forum
Seattle, Washington, USA (North-America)
SAS
2010-Apr-12 to
2010-Apr-14
Sterling Commerce Customer Connection 2010
Dallas, Texas, USA (North-America)
Sterling Commerce
2010-Apr-12 to
2010-Apr-14
Enterprise Risk Management Symposium
Chicago, Illinois, USA (North-America)
Society of Actuaries
2010-Apr-13 to
2010-Apr-14
6th Annual Conference & Exhibitor Showcase
Toronto, Ontario, Canada (North-America)
NBTA
2010-Apr-13 to
2010-Apr-15
RLA Brazil 2010
Sao Paulo, Brazil, USA (North-America)
RLA

They are all readily searchable from the comprehensive Site-Search page. So don’t forget to review the resource site on a weekly basis. You just might find what you didn’t even know you were looking for!

And continue to keep a sharp eye out for new additions!

The Gartner Magic Quadrant for Strategic Sourcing Application Suites, Part I

On Friday I asked if Gartner’s new Quadrant for Strategic Sourcing Application Suites was Magic or Tragic?. Even though it was better than some of the previous quadrants, the fact that it only covered 14 vendors, that 4 of them seemed to slip in under the wire, that the lack of response time probably excluded a number of vendors that should have been there, and that there were a number of statements that just make you go “huh?” (and lead you to believe the report was as rushed as the surveys), I’ve decided that it was more tragic than magic.

And although it wasn’t all bad, as the market overview and definition was pretty good, and the vendor descriptions were mostly accurate, there are a dozen statements that just aren’t right. And even though, as a commenter pointed out, it’s probably not worth the column-inches I’m going to use, given the importance assigned to this report by the market space (which is equalled only by the Forrester Grave), I can’t let it go. I need to make sure you don’t misread the statements and make a bad decision. So I’m going to take the most important issues point by point.

Misleading Statement: Moreover, we are now seeing suite-level functionality that leverages the common database and data model of an integrated collection of solutions, such as the ability to pull suppliers identified in a spending analysis exercise into a request for proposal, and the automatic population of a contract template with supplier information and pricing data from a winning bid.
Correction: Now? NOW!?! Get real. This functionality has been around for at least 7 years. Ariba has had it for a while. Procuri, now Ariba, always had it. Iasta always had it. Heck, even Mindflow had it between the core modules back in 2002/2003 when I was there. Maybe the big ERP vendors didn’t have it until recently, and maybe the players that acquired most of their solutions didn’t have it, but it’s not new. And it’s not hard. And yes, you should expect it if you’re buying a suite.

Missing the Point: Since the trend toward suites is likely to continue indefinitely, consider point solution providers of supply base management, spending analysis, strategic sourcing and enterprise contract management only if the arrangement is short term to medium term (three to five years), or if the niche vendor’s solution can provide a competitive advantage.
Correction: Term is irrelevant. It’s about value. As long as a point provider can give you more value, you go with the point provider. If that’s a year, it’s a year. If that’s five years, it’s five years. If it’s until you retire, it’s until you retire.

Lack of Clarity: Go without business consulting services only if you have five or more years experience with a suite, and if you have an established, internal center of excellence to help users.
Correction: While you should definitely consider using category and process experts if you are not experienced and / or do not have a centre of excellence, if it takes you five years to learn a tool, you have a problem. A big problem. It shouldn’t take you five years. It shouldn’t take you five months. It shouldn’t even take five days. Not only is RFX, Auction, Project Management, Contract Management, and Spend Analysis, etc. well understood, but there are dozens of solutions out there that are easier to use than Microsoft Office. Your average sourcing professional should be able to pick up the basics on their own in a few minutes. If they can’t, the tool is too complex or poorly designed and you should find a better tool.

True, but Bad Advice: Most organizations that utilize spending analysis refresh on a quarterly basis.
Correction: While that may still be true, it’s the wrong approach to spend analysis. The right approach is to refresh at least weekly, if not daily, and there are at least a dozen providers who can integrate with your existing systems and do that. A good spend analysis system should allow you to track your spending. It’s not very useful if all it tells you is what you spent three months ago.

DANGEROUSLY WRONG: The reverse auction is the most powerful way to drive down costs …
Correction: WTF? When not expertly applied (and even sometimes when it is expertly applied), a reverse auction is the most powerful way to damage relationships, drive quality through the floor, and drive up spend in times of greatest needs. It’s as I wrote in my guest post on “a brief history of optimization” for By the Buy:

 

In the beginning, there was the reverse auction. Industry visionaries applied reverse auctions to their sourcing events for commodity and competitive categories (in the mid nineties) and saved a small fortune (which sometimes exceeded 30%, 50%, and even 70% of previous category costs). They were heroes and the world was good.

Then, a couple of years later when they circled back to the first categories and held another auction, something unexpected (to them) happened. The total savings shrunk considerably. The average savings, expressed in terms of percentages, dropped from the mid double digits to the (low) single digits. The savings often equalled what they would have expected from a traditional RFX / negotiation process. But the market was a seller’s market and the total event time, and thus the total event cost, was low, so with the right spin, they still looked quite successful. The world was still good.

 

Another couple of years passed, and they circled back to the first categories again. But this time, the market was a buyer’s market again and savings were bound to equal those seen in the initial category reverse auctions, right? Wrong! Instead, something really surprising (to them) happened — instead of saving money, total costs increased — sometimes in the double digits! The world was a dark and scary place. What happened? Could it have been avoided?

In short, reverse auctions are NOT strategic!

Share This on Linked In