Not 11!

Backing up, earlier this year Jason Busch published his 11-Question Bullshit Filter for Enterprise AI startups. This was, and is, needed because the vast majority of Enterprise AI startups are bullshit (especially in FinTech and Procurement) and the sooner you figure that out, the better.

I was hoping that, by now, the AI startup scene would start crashing due to over investment, lack of returns (only 6% of AI implementations have generated an ROI), and, generally, lack of usefulness. (AI can serve up your data, show you complexity and even help with automating some tasks, but it can’t make decisions and, due to lack of anything close to intelligence, can’t even do basic tasks without your oversight.) But, even worse, these solutions are still multiplying like Fibonacci’s rabbits and their claims are getting more outlandish by the day. (How many times do we have to tell you AI Employees Aren’t Real, you should NOT engage any vendor selling “AI Employees”, because you definitely do NOT want AI Employees.)

So, since they are flooding our space with BS marketing and making ridiculous claims about what their useless apps can do, it’s more critical than ever that you be able to suss out the BS claims from the non-BS claims. (Hint: 95% are BS claims, so it wont’ be easy!)

We’ll start with Jason’s 11 filters, which we’ll number 12 down to 2, because he left out the most important filter, and the one that, if it fails, allows you to skip the next 11.

Filter 12: Founder DNA
Can they build and sell? Likely not. Chances are, if they’ve cut through the noise and reached you, they can only sell. And if you did find a builder, they won’t survive long enough to support you if they can’t sell.

Filter 11: Motivation
Is failure unacceptable? (Every startup team will say it is, but unless every founder has a reason they simply cannot accept failure, when the going gets tough … the tough get going … and quit.)

Filter 10: Interface
Is it designed for those who will ACTUALLY be using it?

Filter 09: Categorization
Does the product actually do something new? Is there a strong reason for the market to adopt it?

Filter 08: “Found Money”
Are there instant benefits that sell themselves on the first demo.

Filter 07: Displacement
Does the product workaround or replace a solution that buyers hate?

Filter 06: Functional Bonds
Does the solution cross boundaries that increase value beyond peers?

Filter 05: Data Delta
Is there a “data” strategy to exploit the delta between what humans can easily consume and what AI can leverage (and summarize into something useful for human data ingestion)?

Filter 04: “Messy Middle”
Can the solution ingest external “dark data” and turn it into actionable insights without requiring a(n extensive) manual data-cleansing project? (Quick review and correction is okay.)

Filter 03: Connect the Dots
Does the app bridge the gap between “Watercooler Data” and “System of Record Data” (ERP/PO) to explain the why behind an analysis or recommendation?

Filter 02: “Show Your Work” Audit
Can the user drill into any output, see each and every step the AI took, drill down to the source data, and verify that everything is correct, accurate, and no data was changed?

These are all great filters, but there’s no point going through them if you don’t check the most important filter first:

Filter 01: Is it LLM-based?
If yes, move along. Don’t waste any time.

Most of the failures in the age of AI come from Gen-AI LLMs that promise the world and don’t even deliver a pile of dirt. That hallucinate on every other query. That burn up thousands of dollars of tokens to deliver less than fresh MBA interns with no real world experience and no clue to share on their first day no less.

Even worse, the majority of these players are simply wrapping third party LLMS in the creation of their “solution”. That’s not a solution at all. That’s an unmitigated disaster waiting to happen!

In the rare case an LLM actually offers a partial solution, it is best to go straight to one of the major providers. That way, you know who’s responsible when something goes wrong and don’t have to worry about providers playing the blame game and pointing fingers at each other.