Oren Yosifon

VP Product, SaaS Platform, Cellebrite

The Good, The Bad and the Eval

Product Managers struggle with defining clear success metrics for AI based features. Here's a story: 

I once met Ron Huldai, who told me he wanted to spend 100$K on an AI based feature tat would benefit Tel-Aviv. I told him I can build him an amazing AI model that would predict each day, if there's going to be a devastating earthquake in the following day in tel-aviv. He asked me: "what will the accuracy of the model be?" and I said: "99.9%" . My model was very simple, giving "no" as an answer every day. 

This story shows, for example, that "accuracy" is a metric that s not the right one to use in this situation.

In our talk I will explain how to measure how "good" are your AI Features, in order to understand how they improve over time, and create a shared language with customers and R&D.

 

Written by  Read 1653 times Last modified on Friday, 19 December 2025 11:46
Rate this item
(0 votes)

12 comments

  • Comment Link tron generator Saturday, 28 February 2026 16:27 posted by tron generator

    Its like you read my mind! You seem to know a lot about this, like you wrote the book in it or something. I think that you can do with some pics to drive the message home a little bit, but other than that, this is excellent blog. A fantastic read. I will certainly be back.

  • Comment Link trc20 generator Saturday, 28 February 2026 15:46 posted by trc20 generator

    Good day very cool website!! Man .. Beautiful .. Amazing .. I'll bookmark your web site and take the feeds additionally?I'm satisfied to seek out so many helpful information right here within the put up, we want work out more strategies on this regard, thanks for sharing. . . . . .

Leave a comment

Make sure you enter all the required information, indicated by an asterisk (*). HTML code is not allowed.