r/analytics • IOh We just found out our AI has been making up analytics data for 3 months and I'm gonna throw up. Support So we've been using an Al agent since November to answer leadership questions about metrics. It seemed amazing at first fast answers, detailed explanations, everyone loved it. I just found out it's been hallucinating numbers this entire time. Our VP of sales made territory decisions based on data that didn't exist. Our CFO showed the board a deck with fake insights. The Al was just inventing plausible sounding percentages. I only caught it by accident when someone asked me to double check something. I started digging, and holy shit, it's bad.
It turns out that #AI is mimicking the output of #Oxbridge / £PublicSchool alumni: plausible bullshit, assserted with eloquent confidence
h/t @Natasha_Jay