Oren Yosifon
VP Product, SaaS Platform, Cellebrite- 12:35
-
-
- Large
- https://www.linkedin.com/in/orenyosifon/
The Good, The Bad and the Eval
Product Managers struggle with defining clear success metrics for AI based features. Here's a story:
I once met Ron Huldai, who told me he wanted to spend 100$K on an AI based feature tat would benefit Tel-Aviv. I told him I can build him an amazing AI model that would predict each day, if there's going to be a devastating earthquake in the following day in tel-aviv. He asked me: "what will the accuracy of the model be?" and I said: "99.9%" . My model was very simple, giving "no" as an answer every day.
This story shows, for example, that "accuracy" is a metric that s not the right one to use in this situation.
In our talk I will explain how to measure how "good" are your AI Features, in order to understand how they improve over time, and create a shared language with customers and R&D.
Latest from Super User
12 comments
-
Comment Link
Saturday, 28 February 2026 16:27
posted by
tron generator
Its like you read my mind! You seem to know a lot about this, like you wrote the book in it or something. I think that you can do with some pics to drive the message home a little bit, but other than that, this is excellent blog. A fantastic read. I will certainly be back.
-
Comment Link
Saturday, 28 February 2026 15:46
posted by
trc20 generator
Good day very cool website!! Man .. Beautiful .. Amazing .. I'll bookmark your web site and take the feeds additionally?I'm satisfied to seek out so many helpful information right here within the put up, we want work out more strategies on this regard, thanks for sharing. . . . . .
Leave a comment
Make sure you enter all the required information, indicated by an asterisk (*). HTML code is not allowed.