Category Archives: Technology

Are Your IT Vendors Performing Up To Snuff? Probably Not. Maybe you should VendorScoreIT and find out!

Let’s face it, it’s a well known fact that there is serious overspend in IT. Given that global IT spend is surpassing 5 Trillion, and that overspend is generally at least 30% on average, this is a category with over one Trillion in annual, unnecessary, losses, and, let’s be honest, your organization is contributing to this loss as much as your peers unless you are taking multiple initiatives to minimize it. (See: Roughly Half a Trillion Dollars Will Be Wasted on SaaS Spend This Year and up to One Trillion Dollars on IT Services. How Much Will You Waste?)

Moreover, just because you engaged / acquired one of the SaaS spend analyzers and optimizers (that we chronicled in our piece on the Sacred Cows) to optimize your SaaS spend, that doesn’t mean you’ve optimized it. Amalgamating your licences to less platforms, amalgamating the spend to one invoice, and then ensuring all of the licenses are assigned to active employees is a good start, but that still doesn’t mean you are getting your money’s worth. First of all, this only works for commodity software — it doesn’t work for big back-office systems like your ERP or finance platform where you have to negotiate direct with the vendor. Secondly, it doesn’t work for cloud costs. Thirdly, it’s just software costs, not service/support costs. Finally, if the platform isn’t doing what it is supposed to do and the vendor is not supporting you, every dollar you are spending could be wasted. That’s why Vendor performance management in IT Software (Platform) and Service categories is critically important.

That is precisely what VendorScoreIT was founded to do. Allow a SME (or larger) organization to monitor and manage it’s IT vendors on a regular basis through scorecarding-based performance management at a price any organization can afford (with pricing that starts at an amount that can be paid on a P-Card) while also providing that SME (or larger) organization the support to do it right.

Now, you might think that such a solution wouldn’t be needed as there are SXM solutions with scorecarding and good performance management modules, and that’s true, but most of these were designed for large organizations with a six figure price tag to match — which puts these solutions out of reach of SMEs, and especially those that just need to get their IT and strategic suppliers under control. (In other words, while VendorScoreIT was initially designed to help an organization manage its IT vendors, which are typically the most significant unmanaged vendors in many organizations, it is generic enough that it can be used to score any supplier.)

The solution is a scorecard driven solution, where you can define scorecard models by vendor type, primary service, and/or platform offering; break scorecards up into core areas (operations, partnership, innovation, and procurement) and measures by area; associate multiple scorecards with a vendor (based on services and/or platforms you want to score and monitor individually); define scoring intervals (and the solution will automatically initiate scorecard rounds on the interval you define and invite all of the individuals you want to score it); and define who you want to score each individual scorecard (and average the scores across all respondents).

The platform, which allows an organization to define its areas and measures of interest, also allows them to define default service model and platform scorecard templates, and then associate these with the vendors it wants to scores. Vendors can be grouped by type and tier for easier management, and the platform comes with predefined models for SaaS vendors and system integrators to jump start an organization’s vendor management initiatives. (Supporting non-IT vendors is just a matter of defining any additional areas of relevance, and the measures for those areas, in the metadata for the products (which would fall under platforms) and services the vendors offers, defining default scorecards, defining a new vendor type, and associating the relevant product and service scorecard with that vendor.)

The platform makes it super easy to see overall performance by vendor type, vendor, vendor service or platform, for a time-period of your choice (and to output those scorecards to Excel) — offering simple drill down / drill up functionality scorecards to allow a user to quickly identify where a supplier is doing well, where it’s not doing well, and how it’s doing with respect to its peers. It’s also super easy to pull up the comments associated with a measure that you drill in on, which can give you insight into why a score is high or low.

Right now, it doesn’t have any integrations with third party data sources (for risk, environmental, financial stability, up-time metrics, etc.), but an Open API is coming that will allow you to integrate some metrics with ease, or initiative management (when you decide you need to take action on a supplier who is underperforming in a critical area), but that is currently being designed and will materialize at some point (and most organizations already have a project management platform they prefer to use).

But the platform does come with a considerable amount of expert advice and support to jump-start your initiative, from experts with almost two decades of vendor management experience (especially in IT), depending on what service level you buy. With the

  • Professional Plan: in addition to customized scorecards, you get guided performance reviews and quarterly strategic sessions
  • Premium Plan: in addition to everything in the professional plan, you get a customized vendor management framework, monthly strategy sessions and targetted strategic vendor consulting

However, it has the collaborative scorecarding many SMEs are missing in their platforms and, more importantly, has it at a very affordable price-point, with premium service options available where one of their experts will help you with initial scorecard creation, vendor assignment, performance review training, and even regular strategy sessions and supplier performance management training. VendorScoreIT is all about making vendor performance management accessible and affordable for all organizations in a package that anyone can use, and get going with quickly. If this sounds like something you could use, you should check it out.

The Pundits Agree. Winter is Coming!

In a recent LinkedIn Post, THE PROPHET, a year late to the party (see the SI and Procurement Insights archives, and our Marketplace Madness post in particular), finally announced that Winter is Coming: The Great Procurement (and Broader) Legacy SaaS Rationalization and that it is going to be a very cold winter that will be Swift. Brutal. And very, very final.

There’s too many companies that took too much funding at too high a valuation with nothing to show. PE firms will be dropping these companies faster than a hot potato into boiling lava pits to focus on the companies in their portfolio with current year-over-year growth in hopes of making some of their losses back. Too many companies started without doing any research and literally built the 10th AP clone, SXM clone, RFX clone etc. of a dozen already existing solutions. (Just check the mega map if you don’t believe me.) In a race to the bottom (which helps no one), they’ll lose due to their lack of a bank account as they slash prices too deep in hopes of getting customers. Too many applications took a silo focus, didn’t build Open API centric, and the hurdles of plugging them in will be too much or too costly, and no matter how good the tech is, they won’t get bought.

And then Agentric AI will thin what remains (but not lead the cull as THE PROPHET predicts, because these AI solutions still cost money, and sometimes a lot of it, and for what they cost you can hire a real expert and not a fake one, license a few augmented intelligence tools for a quarter of what these over hyped Agentric AI platforms are charging (because they raised, and wasted, too much cash and have to recoup that before they become the next hot potato dropped into the lava pit by their PE investors), and have a super-human employee who does the work of an entire team, error free (with little to no risk of that skilled employee getting you sued as a result of a conversation, installing a back door for hackers on your systems, shutting down your systems for days, costing you 10X on a purchase due to a dot transcription error, or increasing your internal fraud [link]).

And for some of these companies, it’s already too late to pivot. For others, there are actions they can do. THE PROPHET offered some:

  • risk over-cutting
    (if done smartly)
  • consumption-based models
    (which will be more attractive to some potential customers)
  • challenge the team to earn their existence
    (but that doesn’t necessarily mean prompting GPT like a pro: you don’t want junkies)
  • redefine the sales org
    (a better playbook is key, and it needs to be differentiated)
  • Skip the Fairy Dust and Buzzwords
    (Hear! Hear! I’ve been shouting that for years! Unfortunately, not sure most of the companies out there know how to do that though! I know for a fact only the squirrels have been listening to me, and they are getting very tired of that rant. They like variety. Basically, it’s been a long, long time since marketing focussed on education and value and startups priced based on that.)

And that’s just the tip of the iceberg. SI has posted entire series on:

Failures from those who raised too much and offer too little will be coming fast and furious. This needs to be repeated. You need to be very careful which vendor you buy from and what protections you have in place if they don’t make it. (In particular, there must be a “we own our data” clause which gives you the right to all of your data and the right to export all of it into a standard file format at any time, and that specifies your data includes rules and workflow configurations and the right to export those too — for example, in spend analysis, it’s not just the data, it’s the rules that create the cubes; in invoice processing, it’s the workflow and approval rules … you won’t be able to migrate to another system quickly if all you have is the transaction data, the data that defines the processes and rules is just as important. And if you can’t export all of your data, rules, templates, etc., at any time, then don’t buy the system!)

However, while the app consolidation will be brutal, as will the renegotiations if you want to be one of the apps that make it (now that organizations are realizing they don’t need 17 apps for S&M and probably shouldn’t have 17 apps in any function, including Procurement), Agentric AI (especially at 20K a month when you can hire a REAL person for 1/4 of that) will not replace people en masse (but AI-enabled technology will). Teams will be cut and replaced by two individuals who can use next generation augmented intelligence solutions that can truncate months of research and analysis to a few days and allow strategic decisions to be made in hours, not weeks, and shifts to be made seemingly overnight while eventually allowing 99% of all tactical data processing to be automated through evolving rules and workflows under expert guidance.

Moreover, at the end of the day, relationships are not built on 1s and 0s, and they are needed now more than ever. So not only will we have skilled technologists, but skilled relationship managers. (While everyone else who does nothing but push e-paper 90% of the time or code spreadsheets will slowly be eliminated.) Of course, this means if you don’t understand optimization, analytics, statistics, game theory, economics, and logic, or you’re not an expert in relationship management, you’re screwed, but everyone had a chance to study STEM in University (and skip the woke liberal arts) and learn the technical skills for the first set of jobs.

So this also means if the platform is not enabling this next generation of employees to become more and more productive over time, its lifespan is probably short.

So get focussed in your diligence efforts on solution acquisition if you don’t want your platforms disappearing out from under your virtual feet, and if you need help, call an expert!

It’s Not Just Public Procurement Offices That Should Avoid Tech Fads

A recent article over on State Tech Magazine boldly stated that State Procurement Offices Should Carefully Avoid Tech Fads. And the headline, and author, was right. But it’s not just the public procurement offices that should be avoiding tech fads, the private sector offices should be avoiding them too. But more on this later.

The author noted that Artificial Intelligence is everywhere these days, and that news, advertising [and marketing] may leave you feeling [more than a bit] pressured to join the crowd and be an early adopter. But, as the article points out, and as THE REVELATOR would also be quick to point out, successful IT procurement inolves engaging with a comprehensive list of stakeholders, conducting thorough research and careful implementation planning, and, as THE REVELATOR reminds us on a regular basis, understanding what you need in the first place.

As the author notes, emerging technologies often present unforeseen challenges and novel issues that procurement offices must be aware of and prepared for. Failure to do due diligence can lead to embarassing or costly results. Not only do you have the extremely high failure rates with advanced tech projects, exceeding 85% according to Gartner, but, as the author points out, in the public sector technology breakdowns can have much more consequential impacts. The Air Canada lawsuit is just the first example of what is to come from the inevitable failures of AI not ready for prime time.

It’s not about the hype, it’s about the value the solution will provide, which includes, as the author notes, the total cost of ownership and longevity. The solution must fulfill the organizational need, not the hype. Otherwise, the total cost of ownership is high as no value is delivered while the longevity will be very limited.

But this should be just as true in the private sector. After all, a solution that could get you sued if it fails, that doesn’t solve the problem, that is worthless from the minute it is implemented, and that will paralyze you until a replacement is found and implemented is not something you should ever, ever want in private industry either. So don’t fall for the hype, and stay on the course that’s right — real solutions that solve real problems.

To Manage Innovation, Governments Must Fix Procurement … And Take Care Where AI is Concerned!

A recent article on Civil Service World noted two things that attracted my attention:

  1. To manage innovation, governments must fix procurement
  2. Too often, contracts in AI do not give governments powers to investigate algorithms or the data they are trained on. As a result, they risk taking the blame when things go wrong without the means to find out why.

Public Procurement is expensive. Very expensive. Given that it represents 12% of the annual GDP of an average developed economy, that is a huge amount of spend. Given that the overspend in most departments of most jurisdictions is likely as bad as in the private sector, which means, depending on the category, is likely in the 4% to 6% range at a minimum (based on the results high performing organizations see when implementing best-in-class processes and technology), that means a minimum of 1/2% of GDP is being wasted annually, but based on the fact that most public sector projects exceed initial budgets and timelines, we’d bet that the overspend is double that and at least 1% of the annual GDP. That’s a lot of waste — 770 Billion on the top 10 economies. Furthermore, that assumes that all of the spend is necessary and well planned. (There is likely considerably more savings with better demand planning, more operational efficiency, better project planning, etc. We’re just stating that the savings on committed spend alone is likely 10%.)

The article notes that despite the strategic importance of Procurement, it’s rarely seen as a priority and is more often treated as a standardized compliance function, rather than a tool for strategic investment and, in some cases, has become synonaomous with absurdity, due to an accumulation of rules so complex that even those administering them cannot interpret them creates the perverse incentive of doing the least risky thing to avoid individual liability. As a result, governments end up buying obsolete technologies that make them vulnerable, because innovation evolves so rapidly, and forces them to buy more. The cycle repeats, budgets balloon, and public capabilities diminish.

And, unfortunately, public procurement is a brick-and-mortar process, still more suited to bulk-buying precisely describable goods, accounting for them, and moving onto the next purchase. Innovation is different: you do not know today what is going to be possible tomorrow, even when you are the one inventing the tech. While governments work in one-off projects, innovation is made of ever-changing, always-fleeting products.

Furthermore, those in charge of procuring these technologies are not technologists. Public procurement is professionalized in only 38% of OECD countries, so even if officials had the incentive to experiment, they would not have the expertise.

To combat this, the authors of the article propose that Procurement systems should be like good software, fluid, flexible, and constantly evolving. However, as they note, this will take more than changing rules. As they note, it will take talent that are experts in what they are buying. It will take the treatment of Procurement as a strategic function, with clear lines for advancement for all personnel (as studies have shown that even a marginal improvement in skill can yield significant reductions in costs, times, and contracting complexity). Thirdly, they will need a federated data environment to make use of modern technology. (Especially if they want to use AI.)

This is just the start of what is necessary. There needs to be regular training. There needs to be specialization to different types of functions and purposes. There needs to be a rewrite of rules to focus on the right outcomes, not just a plethora of rules designed to prevent previously undesirable outcomes. There needs to be clear paths from buyer to public organization CPO to department head, not just paths of advancement within the Procurement function. There needs to be a focus on what’s best for the public being served, not best to minimize the risk to the buyer. And a willingness to accept that their may be a few mistakes made here and there as new buyers learn the ropes, while a willingness to weed out anyone that “makes a mistake” in order to give a contract to a supplier who is not the best fit (and do so in exchange for a kickback).

But most importantly, if they acquire AI technology, they also need to acquire the right to investigate the algorithms being used, the data it is trained on, the results of prior training, and the right to inspect any changes to the algorithms, data, and training. Otherwise, you can never trust any AI technology you might want to acquire.

Because governments need to apply the most appropriate AI-enhanced technology more than the private sector, but are the least likely to be able to use them properly.

Data Governance is Essential to Good Data Management …

… so why is there still so little of it in most organizations?

Good data is becoming ever more successful to business and Procurement success, especially if you want to use any any sort of predictive analytics or AI, but so few organizations have so little data governance, if they have any at all. With good data, you can get great insight into current operations, opportunities, and ordeals. Without good data, you have no clue what you’re buying or selling, what processes are going on at any point of time, or what problems are festering about to explode and cause major issues.

But good data is a rarity in most organizations, getting rarer by the day due to rapidly increasing data volumes (in excess of 400 million terabytes of data being generated daily across the globe), lack of controls in legacy systems, poor data processes, and lack of good IT talent with enough history to know what the data is, what it’s used for, and how to qualify it as good, or bad.

Why? Because organizations are putting systems in place before understanding what data those systems will need, where it will live, how it will be validated, how it will be maintained, how it will be archived, and how it will eventually be retired.

In most organizations, when they need data for an analytics-based project, the current answer is to get a “data warehouse”, “data lake”, or “data lakehouse”; dump all the organizational data to that warehouse, lake, or lakehouse; possibly run a simple AI-cleansing/enrichment algorithm, and hope for the best. However, this is not governance, and, in fact, exacerbates the problem more than it solves it. Now there are two copies of bad data, no strategy for pushing back any data that is cleansed, and if the data is changed in the source system before any eventual synch with the data warehouse, which data is correct? Chances are neither record is fully accurate, and any synch has to be done at the field level, if you have enough data to validate which field is correct (as you can’t just use time stamps, because if some data was updated by AI and unvalidated, it may not be right).

Governance is not just maintaining data in systems as you use it, occasionally validating it against third party databases or by manual review, and occasionally enriching it.

Governance is


  • defining what data the organization needs for its various functions
  • defining what data will be collected
  • defining what systems it will be maintained in, and, if the data is in multiple systems, which system is master
  • defining which data fields are critical and how they will be validated
  • defining when and how critical fields will be revalidated
  • defining the process for any data migration from master systems

And doing it


  • collecting the data
  • installing a new system
  • stating an analytics / AI project

NOT AFTER!

But how many organizations do that? Most don’t even do a proper RFP (taken in by the FREE RFP scam), even though the solution to good software (which is critical to maintaining good data) is an Affordable RFP.

Moreover, part of the RFP for any software solution should define the data management strategy as it impacts, and is impacted by, the solution.