Category Archives: rants

AI: Applied Indirection in Sourcing

As we said yesterday, hopefully we have made it clear by now that most of the time you hear AI you should think “Applied Indirection” and not “Any form of Intelligence” because most solutions claiming to be AI are really just dumb systems with RPA (robotic process automation) and classic statistical models from the 90’s (which were available in SAS in the 90’s as well, you just didn’t have enough memory on your PC to run all the data you wanted to run).

But since we want to make it abundantly clear that most of the “AI”, even in our space, is not “AI” at all, we are going to continue to take the major areas of SPT (Strategic Procurement Technology) and highlight some areas where AI is commonly claimed, but rarely found, continuing with Sourcing.

This doesn’t meant that there aren’t vendors with true AI, especially when you classify it as Assisted Intelligence (and sometimes even Augmented Intelligence), in the space, just that, as the buzz-acronym reaches new heights, there will be many more vendors claiming AI than those that actually have AI and you will need to do your homework to find out which is which.

Example #1 of Applied Indirection in Sourcing: Automated Auctions

Some of the shiny new sourcing platforms are really slick and can run an automated auction and do everything from the time you do a product/service selection all the way to final award recommendation. Now, I’m sure you’re thinking such a platform must be at least on the order of augmented intelligence, approaching cognitive, to do all this, but the reality is that you can do all this with simple RPA and a rules-driven workflow. Supplier selection? Just select the past suppliers and pre-approved suppliers from the last sourcing event. RFIs? Use the template with the standard terms and conditions. Ceiling prices? Use current price or current market price if the price has been relatively flat for the past year or falling. Floor prices? Pull in the should-cost model, marked up by a fair margin, if it is available, or use the lowest of the lowest paid historical price and lowest market advertised minus the typical savings percentage in the category. Minimum Decrement? 1%, rounded to three significant digits. Pre-populated bids? Current prices or last bids or advertised market price. Duration? Standard auction duration for the category. And so on. It’s literally just a set of rules, with tolerances, and RPA.

There’s only AI if the platform can run a sophisticated market and category analysis on internal, external, and automatically identified market data, identify a prime set of products in a category for an automated auction, determine the appropriate contract length (and projected demand) to result, and basically take a bunch of the analysis off of your plate for non-strategic / low-value, regular, purchases.

Example #2 of Applied Indirection in Sourcing: RFX Auto-Fill

One of the most time-consuming parts of the Sourcing process is waiting for the suppliers to fill out the RFIs with not just the bids but all of the other information you require. However, there’s no reason that a lot of this information can’t come from their profile, their catalog, and previous RFI responses (where you asked the same questions).

It doesn’t take AI to encode meta-data mappings between profile fields and standard RFI fields, catalog fields and standard RFI fields, and re-use of the same question across RFIs (and previous responses) to pre-fill the majority of an RFI and simply require the supplier to confirm and enter new, additional, or changed data (and, of course, check the boxes that say they accept the T’s & C’s, verify the data, and confirm their bid).

Unless the platform can seek out additional data on the supplier’s web-site, third party directories, third party audit sites, and process semi-structured and un-structured data using natural language processing and identify and extract new data and new information relevant to the RFI (and the sourcing event), it likely doesn’t have anything close to AI (even in AI’s weakest form).

Example #3 of Applied Indirection in Sourcing: Outlier Identification

Here’s another capability that doesn’t require anything close to AI. Statistical algorithms to identify outliers have existed for decades and decades. Many even pre-date modern computers. Run a simple mean/modal comparison, do a simple clustering maybe even use a regression. Easy-Peasy. Even Kitty can do it!

The trick is to identify outliers that aren’t easily identifiable mathematical outliers. A bid in range that is not sustainable for a supplier because the bids were supposed to be landed cost bids (and included shipping as the buyer wasn’t taking possession until the goods hit the warehouse) and one supplier’s bids clearly didn’t, when you think about it, is the type of outlier we want the system to detect for us.

If four of the suppliers are near-shore, and the cost of shipping for them on a unit basis is typically 10% of unit cost, but a fifth supplier is offshore, and the cost of shipping for that supplier by unit is typically 30% of unit cost, even if the bid looks okay, it might not be. For example, if the bids for all the nearshore suppliers are between $100 and $120, their actual unit prices are about $90 to $110. If the off-shore supplier, with a shipping cost around $30, comes in at $100, a mathematical outlier algorithm won’t detect that it’s underlying unit bid is roughly $20 less than the lowest bid, and if the driving costs are expensive raw materials, and the should cost model for that supplier indicates a production cost of $80 (even though their production and overhead costs are significantly less), then a bid of $100 is unsustainable and an outlier (or will not be honoured as the supplier misunderstood and expected to bill shipping separately). If the platform truly has assisted intelligence, it should detect this, even when a human doesn’t. (While you always want the lowest cost, you want the lowest sustainable cost — it doesn’t do you any good if the supplier goes bankrupt halfway through the contract and you have to scramble to find another.)

Note that SI is not saying that systems with the non-AI abilities discussed above are not valuable, as any system that automates tactical processes and minimizes non-strategic busy work is valuable. We are just saying you shouldn’t pay for what you’re not getting, or overpay for what you are. Buy what you need, and pay accordingly.

AI: Applied Indirection in Supplier Discovery & Management

Hopefully we have made it clear by now that most of the time you hear AI you should think “Applied Indirection” and not “Any form of Intelligence” because most solutions claiming to be AI are really just dumb systems with RPA (robotic process automation) and classic statistical models from the 90’s (which were available in SAS in the 90’s as well, you just didn’t have enough memory on your PC to run all the data you wanted to run).

But we want to make it abundantly clear that most of the “AI”, even in our space, is not “AI” at all. So, to do this, we’re going to take the major areas of SPT (Strategic Procurement Technology) and highlight some areas where AI is commonly claimed, but rarely found, starting with supplier discovery and management.

This doesn’t meant that there aren’t vendors with true AI, especially when you classify it as Assisted Intelligence (and sometimes even Augmented Intelligence), in the space, just that, as the buzz-acronym reaches new heights, there will be many more vendors claiming AI than those that actually have AI and you will need to do your homework to find out which is which.

Example #1 of Applied Indirection: New Supplier Identification

A true assisted intelligence system will scour a database, network, etc. and identify potential suppliers based on common product categories, like production or service capabilities, and community profiles and use some fuzzy logic* and adaptive modelling to make recommendations that you might not even thought about.

In contrast, many systems that claim to be AI will simply use SKU, key word, or strict sub-category meta-data matching to suggest the same suppliers over and over again, most of which you’ll already know as these will be the ones coded in the database or network to meet a particular demand. That’s not AI, that’s just multi-faceted search.

Example #2 of Applied Indirection: Auto-Profile Completion

Many systems that claim to be AI will simply use meta-data to map profiles from one system to another where a mapping between the field names and types exist (in a canned profile) and the data types are compatible. That is just ETL that has existed for over two decades, with good RPA behind it to identify the right mapping file and deal with exceptions appropriately.

In contrast, a true assisted intelligence system will be able to automatically construct mapping profiles from a new supplier record in a new system to the current system based on meta-meta data, automatically identify missing data, and automatically identify that data in semi-structured / un-structured text in a supplier description or overview from the supplier’s page on a directory or their “about-us” site using state-of-the-art NLP (natural language processing) technology, only asking a human to intervene and approve this automatically identified data if the probability of accuracy is not sufficiently high or to manually enter data (or contact the supplier for such data) when such data is not easily found.

Example #3 of Applied Indirection: Auto-Issue Identification

Many modern supplier management systems can automatically identify supplier-related issues, notify you with an alert, and even kick off a corrective action management process with a single click. But in most systems, this is not AI by any stretch of the imagination, not even close. It’s just RPA and classical statistical trend analysis in the best case, and simple rules and workflow in the average case. After all, you can detect an issue if a defect rate in the latest shipment is above a tolerance, if an invoice is for five times the number of units, or the satisfaction survey is less than 80% with a simple arithmetical rule. And in a slightly more advanced system, if the OTD rate is on a downward trend that will drop below a minimally acceptable level within three shipments, and so on, a simple trend analysis will suffice. And kicking off a corrective action management process is just automatically starting a workflow. No AI, by any stretch of the imagination, is needed.

In comparison, if there was true assisted intelligence, the system would go beyond simple rules, trend analysis, and notice early deviations in typical performance by looking across standard metrics and surveys to spot outliers that might indicate a trend, augment this with sentiment analysis on recent buyer feedback, and see if there is any external data that could indicate a potential downward trend is coming (such as a lot of recent negative sentiment directed to the supplier’s twitter feed or an article indicating a natural disaster in the immediate vicinity of the supplier’s plant). A true assisted intelligence system will give you early warning of a potential issue so that an account manager can investigate, and if there is a potential issue, take action before it materializes, or at least mitigate the issue (such as a supply disruption) if it can’t be prevented.

Note that SI is not saying that systems with the non-AI abilities discussed above are not valuable, as any system that automates tactical processes and minimizes non-strategic busy work is valuable. We are just saying you shouldn’t pay for what you’re not getting, or overpay for what you are. Buy what you need, and pay accordingly.

*Fuzzy Logic is a recognized area or discipline of mathematical study. The name of the domain was first proposed by Lotfi Zadeh in 1965, but it is actually an extension of infinite-valued logic that has been studied since the 1920s, by Lukasiewicz and Tarski, among others. And while such systems might not use this particular technique, they will use similar techniques that can use vague, or incomplete, or only partially matching data to derive conclusions and make recommendations with reasonable statistical probability.

AI: Applied Indirection Part III.B

Again, since we are in the situation where most claims of AI are just Applied Indirection to the lack of new technology being offered by the platform which is wrapping up old tech in a new UX with a little bit of RPA and, hopefully, better canned reporting and analytics, we are diving into the different levels of analytics to help you understand where AI might be and, more importantly, where it definitely isn’t. Because you don’t want to shell out six or seven figures (or more) for a “modern” solution that is actually only “modern” in the literary sense of the word (which defines the modernist period that started around 1900 and ended around 1965). And we’re not exaggerating here … some of the core statistical algorithms that form the foundation for a few of the bigger name analytic systems on the market date back to the 60s (and even 50s). (In other words, even the old grey beards who remember working on the last of the mainframes forty years ago wouldn’t have thought these techniques new back then.)

Yesterday we covered the first two levels of analytics. The next three are:

Level 3: Predictive

This is what most of the “advanced” analytic solutions on the market offer, predictive analytics, which, when you unwrap the messaging and peel off the fancy packaging, are simply statistical trend fitting and classic trend analysis algorithms that have existed in ERP for 20+ years and MRP for 30+ years. If the price is more-or-less going up according to a slight nonlinear curve, then the price is going to be predicted against the best non-linear curve the box-of-statistical-tricks can fit the data too. And so on. Again, not even a hint of AI here.

Level 4: Prescriptive

This is where AI in its weakest form MIGHT creep into the picture. The keyword here is MIGHT. You see, a prescriptive software application takes the results of a predictive analysis and makes recommendations on what you should do to improve the situation. However, there are two categories of recommendations here. The first category, which most of the applications are based on, is canned recommendations. For example, if the organization is currently spending over market price, prices are projected to go up, but demand still exceeds supply, the canned response will be an auction that invites the suppliers used in the past and highly rated alternative suppliers on the supplier network, as identified by community peers. No real intelligence, or even computation, there. The second category is dynamically computed recommendations, which may be based on a large set of rules or may actually use machine learning and dynamic computation and fall into assisted intelligence and actually make atypical recommendations when situations outside of the norm are detected due to unusual trend patterns or externally identified data (as per our example of web scraping in Part II).

Level 5: Permissive

A permissive system is a system that automatically executes a recommendation on your behalf but, contrary to manic marketing, is not autonomously intelligent. These systems are really just slick RPA (robotic process automation) systems that use a large rule base to drive workflows based upon whether or not recommendations are above a certain confidence interval, costs are within a certain bound, timelines are within reason, and so on (as configured by the vendor and the client on system implementation). More advanced systems will use analysis designed by experts to determine whether or not a certain recommendation can be automated, and then automate it with RPA if it can, and the most advanced — and these are extremely few and far between — will use Machine Learning that will record what a user does and then learn when a user is more than likely to take a certain response (based on past behavior) and when it can just begin to automate an action based on past behavior (and, in effect, define and modify it’s own automation rules). But the vast majority of systems still have no AI here whatsoever.

So, at the end of the day, while many vendors have sold their auto-classification, visibility, and prediction systems as AI — there was actually no AI under the hood and all the AI was applied indirection in the marketing organization. So, again, before buying such a system, be sure to apply a bit of logic and a sniff test. And if all you can smell is parfum de mouffette, you can be pretty sure there’s nothing there.

AI: Applied Indirection Part III

By now you probably get the point that most claims of AI are just Applied Indirection to the lack of new technology being offered by the platform which is wrapping up old tech in a new UX with a little bit of RPA and, hopefully, better canned reporting and analytics — but certainly not intelligence by any stretch of the imagination. (When you get right down to it, the bean dealer who sold the beans to Jack Spriggins was more honest when he said they were magic because the fact that seeds can sprout and grow into monstrously sized plants and trees over time that seemingly reach the clouds [and do if they grow on mountain tops] is pretty magical when you think about it.)

We also gave you a bit of a sniff test yesterday when we told you to think about it because common sense tells us there is no true artificial intelligence (autonomous or otherwise), that true cases of augmented intelligence technology (that can come up with what human experts can’t) is rare, but that assisted technology is more likely (but, again, it has to come up with what we would, not just automate dumb tasks — that’s just RPA [robotic process automation] driven by a rules-based workflow).

Since most of the “AI” that is being sold today revolves around analytics, in order to help you conduct better sniff tests (since if you can’t smell what The Rock is cooking, you know there’s nothing there), we’re going to discuss the five levels of analytics (and tell you right now there is no hint of AI even in it’s weakest form unless the analytics offered is at least level 4).

The first two levels are:

Level 1: Descriptive

This is classical reporting and the level of analytics that the majority of (leading) solutions offer. Even it contains a bundled report builder, if all that report builder does is let you produce custom reports on base and derived fields, that’s just same-old same-old descriptive reporting in a new packaging.

Level 2: Classificative

This is what most modern spend analysis systems offer you — the ability to (auto) classify transactions to a taxonomy for reporting purposes in the bundled descriptive report builder. And while most will tell you this is AI, in most cases, it’s anything but. Most of these systems are just using classic clustering, classic neural networks that are trained in (semi) supervised mode, and, if they are slightly more advanced, fingerprint techniques that extract the seemingly most differentiated details (which are usually identified by a human during training) and use those details for classification purposes in a neural network or n-dimensional kernal machine. But, at the end of the day, the classification is done using 90’s statistical techniques. Humans have to select the algorithms, the data elements in the transactions the algorithms will focus on, train the algorithms, and then implement the algorithms to work on a subset of the data.

Come back tomorrow for a description of the next three levels (and whether or not there is even a hint of AI under the hood).

AI: Applied Indirection Part II

In yesterday’s post we told you that many companies that were touting AI were not actually selling Artificial Intelligence or even anything remotely similar (including, but not limited to, Autonomous Intelligence, Augmented Intelligence, Assisted Intelligence, and/or Amplified Intuition) and were, in fact, using the buzz-acronym to accomplish applied indirection and sell you 90s tech in a shiny new wrapper, proffering yesterday’s miracle cure for all of your current woes.

The only difference between the 90s solutions and todays is that today’s look nicer, run faster (but that’s mainly due to the exponential increase in computing power), and have more automation built in. But RPA — Robotic Process Automation — is NOT AI. It’s just using a rules engine and workflow to automate common tasks under typical conditions.

So how do you tell the difference between Applied Indirection and real (WEAK) AI? Well, first you think about what AI means, apply a little common sense, and ask some good questions.

Let’s start with thinking about what AI really means. AI typically stands for Artificial Intelligence, and the definition of AI in its strongest form is machine intelligence, where the machine can acquire knowledge, learn, apply it, and adapt to new, previously un-encountered real world situations in a general manner just as a human would do. If you think about it, no machine can do that, and no machine is even close. So there’s really no such thing as AI (and won’t be for decades).

At the same level of complexity is Autonomous Intelligence, which is Artificial Intelligence that is capable of acting on its own without any human interaction. Since true Artificial Intelligence doesn’t exist, it should be obvious that Autonomous Intelligence (outside of living beings on our planet), which is an AI agent that can work in complete isolation from human interaction, doesn’t exist either.

At the next level down we have Augmented Intelligence, where we don’t define a platform as being intelligent but as capable of providing knowledge and insight that we can use to complement and enhance our intelligence and make as faster and better at the tasks we are performing. At this level, there are tools that exist for well defined tasks, but they are few and far between. While there are a lot of systems that can allow us to do our jobs faster and better, they don’t augment our intelligence. For a system to truly be an augmented intelligence system, it must augment our intelligence, propose actions that we were not aware of (and would not think of in a little bit of time), and make us smarter over time. Very few systems do that, even when limited to very specific tasks.

Going down a level, we have Assisted Intelligence, where we don’t define a platform as intelligent, but capable of using knowledge and insight that it has to complement and enhance our daily performance of tasks by helping us to do them faster, better, or both. Like augmented intelligence platforms, they should be able to prescriptively suggest actions or workflows, but we don’t require that they be capable of identifying anything we wouldn’t in our jobs.

The big difference between augmented and assisted is that a platform that analyzes market data and dynamics and comes up with one of a pre-set of sourcing strategies as a recommendation is generally just assisted intelligence. In comparison, a platform that not only pulls in market feeds but scours the web for public pricing, articles on supply / demand (im)balance, third party audits, and reports on recent events and other data not pushed through integrated feeds; creates multiple pricing and availability projections; runs those projections through multiple models; and then recommends you extend the current agreement and buffer stock three months of supply (because an earthquake in China just closed down the mines that supply a significant amount of the rare earth metals used in your product and supply is likely to become scarce and pricing rise in six weeks) would be considered to be an augmented intelligence platform because even though you could do web searches to find updated public pricing, supply projections, third party audits, and natural disaster reports, there’s no guarantee you’re going to find the report on the local Chinese news feed (that won’t get picked up by an English news feed for two weeks because China downplayed the effect of the earthquake) when you only read English.

In other words, there are some assisted intelligent tools out there (that help you do your job better and faster, but aren’t going to do anything you can’t or come up with anything you wouldn’t if you just spent five minutes thinking about it), a few augmented intelligence platforms for specific tasks, but no autonomously intelligent, artificially intelligent, and definitely no cognitive platforms on the market — and if someone is trying to sell you that, they are using the marketing technique of applied indirection to sell you modern silicon snake oil.

You have been warned!