Oren Yosifon || VP Product, SaaS Platform, Cellebrite

Oren Yosifon

VP Product, SaaS Platform, Cellebrite

The Good, The Bad and the Eval

Product Managers struggle with defining clear success metrics for AI based features. Here's a story: 

I once met Ron Huldai, who told me he wanted to spend 100$K on an AI based feature tat would benefit Tel-Aviv. I told him I can build him an amazing AI model that would predict each day, if there's going to be a devastating earthquake in the following day in tel-aviv. He asked me: "what will the accuracy of the model be?" and I said: "99.9%" . My model was very simple, giving "no" as an answer every day. 

This story shows, for example, that "accuracy" is a metric that s not the right one to use in this situation.

In our talk I will explain how to measure how "good" are your AI Features, in order to understand how they improve over time, and create a shared language with customers and R&D.

 

Written by  Read 2196 times Last modified on Friday, 19 December 2025 11:46
Rate this item
(0 votes)
Published in Day 1
Super User

Latest from Super User

More in this category: « Shay Many || Senior Director of Product Management, Guesty Ofer Polivoda || Country Manager, Mixpanel »

41 comments

  • Comment Link 스포츠중계 Monday, 23 March 2026 09:34 posted by 스포츠중계

    This design is wicked! You definitely know how to keep a reader amused. Between your wit and your videos, I was almost moved to start my own blog (well, almost...HaHa!) Great job. I really loved what you had to say, and more than that, how you presented it. Too cool!

  • Comment Link rare trx Friday, 20 March 2026 14:27 posted by rare trx

    F*ckin? remarkable things here. I?m very glad to see your post. Thanks a lot and i'm looking forward to contact you. Will you please drop me a mail?

  • Comment Link vanity wallet generator Friday, 20 March 2026 11:14 posted by vanity wallet generator

    Fantastic site. Lots of useful information here. I am sending it to several friends ans also sharing in delicious. And of course, thanks for your effort!

  • Comment Link tron wallet generator Friday, 20 March 2026 10:49 posted by tron wallet generator

    I'm not sure why but this weblog is loading very slow for me. Is anyone else having this problem or is it a issue on my end? I'll check back later on and see if the problem still exists.

  • Comment Link big baller Thursday, 19 March 2026 16:16 posted by big baller

    I really appreciate this post. I have been looking all over for this! Thank goodness I found it on Bing. You have made my day! Thx again

  • Comment Link big baller club casino philippines Thursday, 19 March 2026 12:20 posted by big baller club casino philippines

    Hello there, I found your web site via Google while looking for a related topic, your website came up, it looks great. I have bookmarked it in my google bookmarks.

  • Comment Link big baller Thursday, 19 March 2026 11:47 posted by big baller

    You actually make it seem so easy with your presentation but I find this topic to be actually something which I think I would never understand. It seems too complex and very broad for me. I'm looking forward for your next post, I?ll try to get the hang of it!

  • Comment Link คลิปหลุดสาวใหญ่ Wednesday, 18 March 2026 13:19 posted by คลิปหลุดสาวใหญ่

    Hello! This is my first visit to your blog! We are a collection of volunteers and starting a new initiative in a community in the same niche. Your blog provided us valuable information to work on. You have done a outstanding job!

  • Comment Link คลิปหลุดสาวใหญ่ Wednesday, 18 March 2026 09:38 posted by คลิปหลุดสาวใหญ่

    Thanks for your publication on the vacation industry. We would also like to add that if you are a senior taking into account traveling, it really is absolutely vital that you buy travel insurance for senior citizens. When traveling, retirees are at biggest risk of getting a health emergency. Buying the right insurance coverage package for your age group can look after your health and provide you with peace of mind.

  • Comment Link คลิปหลุดสาวใหญ่ Wednesday, 18 March 2026 09:07 posted by คลิปหลุดสาวใหญ่

    Simply wish to say your article is as astonishing. The clearness in your put up is just nice and i could suppose you are a professional in this subject. Fine with your permission let me to seize your RSS feed to keep up to date with approaching post. Thanks 1,000,000 and please continue the gratifying work.

Leave a comment

Make sure you enter all the required information, indicated by an asterisk (*). HTML code is not allowed.

to-be published