Category Archives: Technology

GEN-AI is Failing 95% of the time. What does this mean for you?

We’ve known for a while that

  • Gartner’s first study found 85% of AI projects were failing (and that statistic is still being quoted everywhere, including this recent Medium Study)
  • Bain’s study last year found that 88% of all IT / technology projects fail to some extent (2024 study)

And we now know, thanks to MIT, that

  • 95% of all Gen-AI pilots fail. (Source: Fortune)

So what does this mean for you (and your ProcureTech journey)?

Well, beyond the obvious that you should stop dead in your tracks when a vendor starts pushing their “Gen-AI” enabled solution and dig deep into what that really means, at a foundation it means that:

You should never, ever, ever buy or use any solution that uses third party Gen-AI / LLMs, even if wrapped nicely, in their service or product because your chance of success will be 5% if you go with that provider.

You should only select vendors who only use in-house Gen-AI / LLM solutions that are built with the following rules in mind:

  1. custom trained on an expert culled corpus
  2. for a specific problem domain
  3. and applied in a specific context with guardrails and human checks on the output.

The best AI technologies has always been focussed on a specific problem, and this iteration is no different. Focus minimizes the LLM hallucinations (which cannot be trained out as they are a fundamental function of the technology) and guardrails prevent them from automatically being executed on / slipping through.

While they are far from perfect, with more discoveries being made daily on their many (many) drawbacks (where we summarized a dozen in this post on what not to do if you got a headache, but missed the recent revelation where it can not only lie on purpose but turn into something evil), the reality is that, as we have said before, LLMs, properly trained on vetted corpuses, do have two valid uses:

  • large corpus search and summarization
  • natural language translation

since, when appropriately trained, they can be almost as accurate as last generation semantic technology systems, but provide much more natural interfaces for the average user. (However, you won’t get a failure code from them when they are wrong, you will get a hallucination which will be so well phrased you’ll think it’s true when it’s an outright lie. Hence the need for guardrails and human review.)

So, if the vendor is

  • using their own in-house LLM
  • following the rules above
  • and targeting the LLM at natural language problems LLMs are actually good for

Then you should definitely try what the vendor is selling. (Try, not buy, and definitely don’t make a decision off of the carefully crafted demo!) Put it through its paces in a typical use-case for your company, not the use case selected by their demo master. If it does the task better on average than an average team member or does it about as good but many times faster, that is what you are looking for in a tool. Since there is no real AI, you can’t be replaced. But as your bosses keep increasing the weight of your workload to hit ridiculous revenue and profit targets, you need a tool that multiplies your productivity. One that can do the majority of the tactical data processing grunt work, leaving you free to do the strategic thinking and then add in the intelligence to a process or output that no tool can possess, instead of spending 90% of your time doing data entry, processing, and summarization that computers were built for.

In something like Procurement intake, that’s not trying to mimic in text chat the old school phone conversation that took you fifteen minutes to do the monthly office supplies re-order, that’s asking one question:

What do you want to do today?

processing the first one sentence answer:

Place the monthly office supplies re-order.

to determine that the user needs to be pushed into the e-Procurement system with the monthly office supply cart pre-loaded, so that all he has to do is enter the number of units of each item, and possibly add or remove an item from an easily searched catalog if one or two items need to be changed. Not 20 questions of “what do you need”, “what quantity”, “the same supplier”, “so you want 2 cases of paper from office depot”, “no, office max”, “oh, standard printer not glossy for marketing”, etc.

When Gen-AI mania first swept our space, and every vendor was told they needed a conversational interface for buying (or no customer would consider them in their RFP), and then built one, not a single one wasn’t painful to use. Most customers upon seeing it for the first time (after insisting on it), quickly said “can we turn it off” because they quickly realized that a well designed catalog with blanket/standard orders, quick search, and easy drill down to preferred suppliers was at least 10 times faster than trying to use a dumb chatbot — especially if they could pre-build templates / carts / blanket orders for regular purchases.

It’s the same for almost every other process vendors have been trying to apply this technology to, including conversational analytics. (Which, FYI, even Gartner expects to disappear from the conversation in two years.) There’s no such thing as conversational analytics, only reporting. And while that is really useful in the right context (such as allowing an executive to retrieve some basic information with a plain English question), try building a detailed spend cube, which is the cornerstone of spend analytics, with conversational analytics! (And I mean try because you will fail.)

While this doesn’t mean that LLM technology doesn’t have uses, it does mean that those uses have to be finely tuned. So far, among the hundreds of companies I’ve seen over the past few years, only a few have both implemented LLMs and gotten it right. Let’s hope that number increases in the near future. If, not always remember, while it would be great if a few more companies would get it right, You Don’t Need Gen-AI to Revolutionize Procurement and Supply Chain Management — Classic Analytics, Optimization, and Machine Learning that You Have Been Ignoring for Two Decades Will Do Just Fine. Not to mention the fact that good, adaptive, RPA will take care of most of your automation needs!

Why Is It So Hard to Buy Software?

A recent post on LinkedIn by Robert Goodman asked Why has it gotten really hard to buy software?, which is a really good question, because, while it should be easier in the modern SaaS age, for an enterprise, it’s much, much harder.

Robert started his vent by noting that the companies I want to partner with on average do a bad job selling/explaining/connecting/not making me dislike them or generally making the process frictionless and the companies I have little interest in are incredibly responsive and almost stalkerish. He goes on to state that Most companies are still WAY too much about making their numbers at month or quarter end (a them issue, not a me issue) and this seems to dominate their “strategy.”

And I’m sad to say that he’s right. Not just because I’m hearing this from multiple buyers (on and off LinkedIn), but because, for the past year or so, most of the companies approaching me / having conversations with me are only interested in “how I can help them sell”, as if that’s the role of an analyst/product consultant. (Well, as I noted in Vendors Have Lured Big Analyst Firms Astray Because Buyers Don’t Understand They Get What They Pay For, this is probably what they expect if their only dealings have been with big analyst firms where it’s pay for promotion, and leads, and no real advice on product strategy and direction.) The majority are focussed on sales, and not on understanding what they have, whether or not it actually solves customer problems, and what is missing from their product, process, or marketing that is preventing them from selling.

The reality is that the’ve forgotten that you don’t sell by marketing, or doubling-down on the latest and greatest feature function your dev team just added, stalking your prey when they need time to digest, or threatening them that they made a bad decision when you don’t get selected (and/or trying to bypass the process by skipping the CPO and going direct to the CFO or CEO).

You sell by focussing on the customer. The successful vendors:

  1. take the time to understand the customer’s problem
  2. explain how they will solve it
  3. help the customer build the value case (especially if the customer needs help getting (additional) funding)
  4. work side-by-side with the customer until the solution is fully implemented and the customer is realizing the ROI while
  5. not making you feel like you are walking on hot coals through the entire process.

Moreover, when they reach out to an expert analyst/consultant, they would

  1. focus on understanding the market: who the customers are and what they want
  2. what they have and don’t have to serve that need
  3. how they could better position and market what they have so customers would be more interested

But the reality is that, with so many companies having taken too much money at too high a valuation during the last two M&A frenzies, we have the situation where, at many vendors:

  • their ego is through the roof (because they think they are the only option of their caliber based on the raise) or
  • they have to meet a ridiculous sales target to keep their jobs, and they don’t care about your value or experience, just getting the sale.

And that’s why we have the situation that Robert is complaining about where it’s really hard to buy software these days. We don’t have the space we had 20 years ago in ProcureTech post dot-com crash where every vendor was doing anything it could to prove value because investment (potential) was low and there wasn’t a single vendor with a ridiculous sales target … they were just focussed on survival and real growth.

Now, this isn’t to say all vendors are bad, or that you are guaranteed a bad experience … there are still vendors out there who didn’t get, or didn’t take, too much investment, have greater control over their own destiny, and will do whatever they can to make you successful. However, don’t be surprised if you end up with the experience with your initial shortlist that this is the exception and not the norm. In other words, do your best to track down the best, but don’t expect a chill experience every time.

Cutting Edge Tech Is NOT Defined by the C-Suite, …

… Financiers, or the Marketers pushing hype (from the A.S.S.H.O.L.E.) at you 24/7.

Nor is it defined by the algorithms it uses, the software stacks it runs on, or the hardware stacks it makes use of.

Cutting edge tech is ANY and ALL tech that

  • solves one or more significant problems that not being solved by your tech today and
  • does it by automating at least 90% of the tactical data processes that can be automated

It can be based on the latest AI algorithm or twenty year old RPA. It doesn’t matter if it shines a light using a LAMP stack, if it is an edgy MEAN stack, an Austin Powers inspired Grails stack, or even a .NET stack (though the doctor personally shuddered typing those last three caps out). The entire point of enterprise software is to solve your problems.

The point of software is NOT to provide

  • an excuse for a C-Suite to cut his tech-bro buddy a fat check,
  • a new Tulip Market for greedy financiers who think they can score big and get out before the crash, or
  • marketers a platform to pump out pompous poop on a daily basis.

As Mr. Koray Köse penned in a recent piece on LinkedIn on how you are in need of cutting edge technology, the last thing you want to do is take your direction from the VC-pumped C-Levels who do nothing but repeat the marketing garbage they are fed, sometimes changing the baseline of the garbage mid-sentence!

You have to remember:

  • All the VCs and most of the PEs want to create the next unicorn and get rich quick overnight. So most of these VCs and PE firms are pumping huge amounts into companies with little to no product (to support their grand vision that even SAP and Oracle haven’t managed to achieve after 5 decades and trillions of dollars) and directing the majority of that to be spent on buzz-creating sales and marketing (and not real product development). After all, you don’t actually have to create anything beyond buzz to get rich — market crashes throughout history have proven that since Tulip Mania. (What was created there of value? Nothing. But hype made a few men rich and many men poor.)
  • Even though today’s LLMs are dumber than a doorknob (and demonstrate more than any previous generation of the tech that AI should stand for Artificial Idiocy), with performance degrading every iteration (because there is no more data to steal, and the AI engines are now training each other on regurgitated digital garbage), marketers are still taking storytelling to a whole new level (and we mean storytelling because ALL the claims are fake) with a spin that even the Spin Doctors of old would be envious of. (Little Miss Can’t Be Wrong now, right? They want to Make You A Believer so you hand over all your Money when you should Exit … Stage Left and Run To The Hills!)
  • This copy is being pushed onto the C-Suites of all of the other investments in their portfolio with assurances that it’s all true, and being similarly echoed to all of the CXOs that attend the conferences they speak at, the golf outings they are invited to, and the exclusive social gatherings they arrange.

Not one of these groups knows what you need, and two of these groups have absolutely no interest in giving it to you — their interest is all about getting your money, building the hype, inflating the value, and, hopefully, cashing out big before the next hype cycle and/or the inevitable market crash that’s coming.

The technology you need is the technology that is:

  • built with real world problems in mind,
  • tested on real world problems in real companies and proven to deliver, and
  • scalable and extendable to your operations and needs.

This type of tech is built over years and doesn’t use unreliable probabilistic AI at the core. (It runs on traditional, configurable, RPA that is 100% reliable and auditable. Now, this tech might employe AI to help with the configuration by analyzing your systems and processes and self-assessed gap analysis by recommending configurations for you to approve, and that’s okay, because it’s not randomly making decisions, its recommending options and letting you confirm or deny. It might also use SLMs for specific problems where they work a high percentage of the time to jump-start searches, documents, and processes for you, and as long as you retain full control and can accept, modify, or reject, that’s okay too. But everything is built on a solid core, with 100% dependable automation for all key data intake, processing, and pushes that is done without any manual intervention, appropriately calibrated to your business rules, processes, and goals.)

It’s also built slow, rolled out to a small group of beta customers or development partners, and hardened in the field before being rolled out en masse.

And, most importantly, it’s built by a company that is boot-strapped or frugally running on a shoe-string budget from minority SEED investors to get that first version up-and-running successfully in its first 10 customers before that company goes for any VC funding to scale up. A company that has the time to get it right before being under constant pressure to make demanding, if not impossible, sales targets.

Moreover, to have any chance of getting this software, you need to know three things:

  1. how to identify what you need that will form the heart and soul of the RFX,
  2. how to write a good technology RFX and analyze the responses, and
  3. how to identify the right companies to invite to the RFX.

What You Need

For Supply Chain, as Mr. Koray Köse points out, if you need help identifying your true needs and cutting through the noise, he can help you out with that with the eyes of a hawk, the skill of a surgeon, and the wit of a Williams (a Robin Williams). For Procurement, Joël Collin-Demers can slice through your organizational landscape like a hot knife through butter and let you know exactly what you need in priority order.

The Technology RFP

Every consultancy and their mascot claims they can help you here, but you need to be very, very careful.

  • many of their consultants are not technology experts and tend to prioritize features over functions, as that’s all they know
  • many of these firms have partnerships with the (mega) suite players, and you don’t maintain sycophant, sorry, Gold/Platinum/Diamond, status unless you direct a LOT of business their way each year, so they tend to try to fit everyone into one of these buckets
  • many follow the old consulting model of “give the client exactly what he thinks he wants” and don’t take the time to figure out what you actually need and educate you, leading to an RFP that is no better than what you would have written yourself, as they spend half their time questioning you, and the other half writing down your responses

For true success, you need someone who is simultaneously:

  • an expert in the domain,
  • an expert in technology, and
  • not incentivized to help any vendor whatsoever and, preferably
  • an expert in project assurance (but not always necessary)

If you need help writing that ProcureTech / Direct Sourcing/Supply Chain RFP, feel free to reach out. This is my expertise. And for some tips, feel free to start with our recent series on How Do You Write A Good RFP?

Vendor Selection

Very few analysts and consultants know more than a handful of vendors. The big firms focus on the big vendors who cut big cheques, which are the 20-ish same vendors you see in their maps year after year after year. They don’t know about the other 700. Only a few of us independent analysts go far and wide and actually know what is out there and how it can help you.

For ProcureTech, SI should be your first stop. It’s the site that gave you the mega map to open your eyes as to just how wide the playing field is. Moreover, if you need something really niche where the doctor doesn’t have the expertise, he’ll find the right expert to refer you to.

For SupplyChain, Mr. Köse knows a lot of the players. But don’t overlook Bob Ferrari of The Ferrari Group. As one of the original supply chain analysts, he knows all the players and what their platforms can and can’t do inside and out.

And if you reach out to the right experts and get the right help, maybe you can get true cutting edge tech that actually helps you!

Bells and Whistles Lead to Cells and Thistles! Part IV

In Part I, after noting that I’ve been hearing and seeing the following too often lately:

  • smaller vendors struggling to close/losing deals because the bigger/splashier vendors have more “Bells and Whistles”
  • vendors getting lots of (and possibly too much) funding focusing heavy on bells and whistles

I said that we were going to dive into some of the most common bells and whistles and why, in the best case, they’re a complete waste of money and, in the worst case, the thorn prick will end up being so painful that your team will simply stop using the software. (And often do so before the subscription is half, or even a third, up, which leaves you in an expensive subscription jail you cannot stop paying for even though no one is using it.)

We started by diving into Intake before addressing the general situations of Flashy UX and Adaptive AI-Driven Automation which are permeating the space for little to no value whatsoever. In our last post we continued our discussion of the bells and whistles in Source to Pay that offer little to no value and we still need to address a few useless Procure to Pay whistles before we can complete our discussion, but first we have to address another across the board useless feature.

Actual Animated Bells and Whistles (complete with Bell and Whistle Sounds) …

Along with their equivalents.

First off, let me state that this is something I should NOT have to write. Let me also stat that it angers me that in 2025 some companies still mistake flash for substance or believe that it adds any value whatsoever. Not only does flash NOT add substance, but the annoyance factor soon becomes aggravation and leads to users ACTIVELY boycotting the platform you spent hundreds of thousands, if not millions on, and in particular, the users who should be using it daily.

Let me explain with one of the worst examples of this, which is present in some of the (big) intake/orchestration platforms and upstart P2P platforms. Animated images that signal when a user has received a requisition, PO, and purchase order (sometimes complete with bell sounds). Now, to a manager, this looks cool because the system draws an animated graph from requester to purchaser to supplier back to purchaser and shows an animation on request complete (purchaser processed the request), requisition complete (and supplier received the PO), acknowledgement complete (purchaser received the acknowledgement, and possibly a delivery date), invoice received (purchaser approved and sent to Accounts Payable), etc. To an average user who uses the system once a month to make a requisition for something, it looks like it will be very easy peasy to use.

But for the Procurement Buyer who has to deal with, and verify the routings on, 50 requisitions a day and deal with 50 “where is my payment” requests a week because the supplier rep is literally too technologically stupid to both login to the platform AND do two clicks to get to the right search screen and then enter their PO # flawlessly, IT IS AN ABSOLUTE NIGHTMARE! (And not the Alice Cooper kind!)

Think about it. REALLY THINK ABOUT IT! They have to review 50 requests, deal with them, reassign them, or just verify them. After every request. they have to deal with an animated graph that just slows them down. Plus, because each request has these big animated logos, maybe they can fit 10 on a screen in a table view, vs. being able to see all 50, sort by type, drill down, reassign in bulk, and move on.

But it gets worse when a supplier accounts receivable rep or seller calls and says what’s the status of my invoice (and for some reason, doesn’t have the PO number because the PO # is in the system he can’t figure out how to get into), and you have to do multiple clicks to even bring up the advanced search/filter tab, and even when you manage to filter down to the 3 day window it’s in, because the supplier batches, them, you have 50 on that day and can only see 10 at a time — and no line item details. Vs. No animations at all, a tabular view with key line items, and the ability to quickly scroll and find the invoice, and a single, quickly scanned, word that shows the status. After a few weeks of animation atrocity, you get so angry and fed up you beg to get the green screen ERP back! I’m not joking here. Your back office people are overworked, and any system that slows them down quickly gets their ire and loathing and if they can avoid it, they will.

P2P: Consumer-Style Catalogs

Your requisitions want a one-click, but your Procurement personnel DON’T want an Amazon style catalog. They don’t want “the best deals today” popping up beside the on-contract / preferred vendor catalog items and the budget owner with catalog authority choosing that off-contract “best-deal” thinking she is saving the organization when, in fact, a failure to meet your contractual commitments negates the rebates you were counting on at quarter’s end.

Moreover, when a user wants to requisition a new phone or laptop, she doesn’t want 20 options if only 2 are company approved for her. Nor does she want a lot of fancy graphics and super deep dives on the main screen, with hard to find “add to cart” and “buy now” options because they are buried in too much text/images.

Buyers want a get-in, find it quick, buy/requisition it now, and get out experience. Procurement personnel want a system that not only enforces policy, but makes buying on the contract easier than doing literally anything else, including going to a third party site and ordering something on the P-Card. Remember, as a fellow analyst likes to say, humans are lazy and if doing it right is easier than doing it wrong, they’ll do it right. (As a classic example of this, take music piracy. It was rampant in the mid to late 90s, but as more on-line / streaming options, like Apple Music and Spotify, came online it dropped suddenly because getting what you wanted at the best quality was cheaply and easier to do legally. Make Procurement like that, and policies just get followed.)

There are other examples, but by now you should get the point. Buy a solution because it has the breadth and depth you need, NOT because it has bells and whistles, because as soon as the solution is found lacking, usage will drop. Moreover, if all the solution does is annoy your daily users with useless bells and whistles, they will do their best to stop using it entirely!

To repeat one more, and hopefully final, time, as we said in the last three parts, bells and whistles look and sound cool, until you realize that the ringing can be deafening to the point it gives you such a headache that you can’t get your work done. So don’t get lured in by the bells and whistles, focus on real solutions that will make the majority of your work easy and the remaining minority possible, even if the solution doesn’t look much better than the green screen you have now. You want solutions, not shock-and-awe where only shock remains once you realize the awe was fabricated.