Then maybe you should do the math.
It’s very expensive for what it doesn’t do. You can pay 10K a month or more just for a conversational interface to search your data or push data into your applications. For 10K a month, you can get a decent core P2P application or source-to-contract application that, well, actually does something.
It’s even more expensive to train these systems on your policies, connect them to your applications, test that basic requests generate reasonable responses, train it to guide your users to get to an eventual answer, and so on. This could easily be more than a year or three of license fees.
But the true costs are in the utilization. Every time a user asks a question, or responds to a question posed by the Gen-AI to try and elicit the users intent, it takes compute time. LOTS of compute time. At least 10X the compute time of a standard search engine or keyword based retrieval system. In some cases, 30X. (The wattage required is easily 10 to 30 times traditional Google search.) So if you’re a mid-sized organization with more than 1,000 employees, a portion of your cloud computing costs, which average between 2.4 Million and 6 Million a year (according to CloudZero), is going to increase 10X to 30X. Let’s say 5% of that was basic search and inquiry, 120K to 300K. Almost inconsequential. But multiply it by 10 to 30, and you’ve just added another 1 Million to 9 Million to your bill. Think about that.
That “low-cost” Gen-AI “chatbot” that makes enterprise search and application interface “easy” (but not as easy as a well designed workflow, FYI), that you think costs 10K a month after implementation, training, and most importantly, cloud computing costs could actually be costing you 100K a month (or even 500K). For what? A fancier Google?
As Procurement professionals, you can, and should, do the math. So even if you don’t believe the doctor when he says Gen-AI is a fallacy, then believe the math.
The math says Gen-AI is just NOT worth it.