Oren Yosifon || VP Product, SaaS Platform, Cellebrite

Oren Yosifon

VP Product, SaaS Platform, Cellebrite

The Good, The Bad and the Eval

Product Managers struggle with defining clear success metrics for AI based features. Here's a story: 

I once met Ron Huldai, who told me he wanted to spend 100$K on an AI based feature tat would benefit Tel-Aviv. I told him I can build him an amazing AI model that would predict each day, if there's going to be a devastating earthquake in the following day in tel-aviv. He asked me: "what will the accuracy of the model be?" and I said: "99.9%" . My model was very simple, giving "no" as an answer every day. 

This story shows, for example, that "accuracy" is a metric that s not the right one to use in this situation.

In our talk I will explain how to measure how "good" are your AI Features, in order to understand how they improve over time, and create a shared language with customers and R&D.

 

Written by  Read 1749 times Last modified on Friday, 19 December 2025 11:46
Rate this item
(0 votes)
Published in Day 1
Super User

Latest from Super User

More in this category: « Shay Many || Senior Director of Product Management, Guesty Ofer Polivoda || Country Manager, Mixpanel »

18 comments

  • Comment Link Lunatogel Sunday, 15 March 2026 16:22 posted by Lunatogel

    Hello there, simply was aware of your blog thru Google, and located that it's truly informative. I?m going to watch out for brussels. I will appreciate in the event you continue this in future. A lot of other folks will be benefited from your writing. Cheers!

  • Comment Link Lunatogel Sunday, 15 March 2026 13:07 posted by Lunatogel

    I'm curious to find out what blog platform you have been utilizing? I'm experiencing some small security issues with my latest website and I would like to find something more safeguarded. Do you have any solutions?

  • Comment Link Lunatogel Sunday, 15 March 2026 12:37 posted by Lunatogel

    I was wondering if you ever considered changing the structure of your blog? Its very well written; I love what youve got to say. But maybe you could a little more in the way of content so people could connect with it better. Youve got an awful lot of text for only having one or 2 images. Maybe you could space it out better?

  • Comment Link Couples and Marriage Counseling Thursday, 12 March 2026 03:33 posted by Couples and Marriage Counseling

    You could definitely see your skills in the work you write. The world hopes for even more passionate writers like you who aren't afraid to say how they believe. Always follow your heart.

  • Comment Link Relationships More Couples and Marriage Counseling Wednesday, 11 March 2026 22:54 posted by Relationships More Couples and Marriage Counseling

    You can certainly see your expertise in the work you write. The world hopes for more passionate writers like you who are not afraid to say how they believe. Always follow your heart.

  • Comment Link Couples Counseling Wednesday, 11 March 2026 22:16 posted by Couples Counseling

    Howdy! This is my 1st comment here so I just wanted to give a quick shout out and say I genuinely enjoy reading your posts. Can you recommend any other blogs/websites/forums that go over the same topics? Thanks!

  • Comment Link 波场在线钱包 Monday, 09 March 2026 02:26 posted by 波场在线钱包

    Thank you for this article. I would also like to state that it can always be hard if you are in school and merely starting out to establish a long credit score. There are many learners who are simply trying to survive and have an extended or beneficial credit history are often a difficult issue to have.

  • Comment Link 波场靓号钱包 Sunday, 08 March 2026 22:12 posted by 波场靓号钱包

    I've noticed that credit repair activity has to be conducted with techniques. If not, you will probably find yourself causing harm to your rating. In order to reach your goals in fixing your credit history you have to make sure that from this moment in time you pay your complete monthly dues promptly in advance of their planned date. Really it is significant given that by not necessarily accomplishing this, all other measures that you will choose to adopt to improve your credit standing will not be efficient. Thanks for giving your strategies.

  • Comment Link rare trx Sunday, 08 March 2026 21:36 posted by rare trx

    It?s actually a cool and useful piece of info. I?m glad that you shared this useful info with us. Please keep us up to date like this. Thanks for sharing.

  • Comment Link naga303 Thursday, 05 March 2026 18:27 posted by naga303

    Hmm is anyone else experiencing problems with the pictures on this blog loading? I'm trying to determine if its a problem on my end or if it's the blog. Any feedback would be greatly appreciated.

Leave a comment

Make sure you enter all the required information, indicated by an asterisk (*). HTML code is not allowed.