Oren Yosifon

VP Product, SaaS Platform, Cellebrite

The Good, The Bad and the Eval

Product Managers struggle with defining clear success metrics for AI based features. Here's a story: 

I once met Ron Huldai, who told me he wanted to spend 100$K on an AI based feature tat would benefit Tel-Aviv. I told him I can build him an amazing AI model that would predict each day, if there's going to be a devastating earthquake in the following day in tel-aviv. He asked me: "what will the accuracy of the model be?" and I said: "99.9%" . My model was very simple, giving "no" as an answer every day. 

This story shows, for example, that "accuracy" is a metric that s not the right one to use in this situation.

In our talk I will explain how to measure how "good" are your AI Features, in order to understand how they improve over time, and create a shared language with customers and R&D.

 

Written by  Read 2408 times Last modified on Friday, 19 December 2025 11:46
Rate this item
(0 votes)

69 comments

  • Comment Link pineal xt Friday, 10 April 2026 11:10 posted by pineal xt

    Have you ever thought about adding a little bit more than just your articles? I mean, what you say is important and everything. Nevertheless just imagine if you added some great pictures or videos to give your posts more, "pop"! Your content is excellent but with pics and video clips, this website could undeniably be one of the best in its niche. Terrific blog!

  • Comment Link multivitamin for women Friday, 10 April 2026 07:41 posted by multivitamin for women

    I love your wp design, where would you obtain it from?

  • Comment Link mediterranean herb supplement Friday, 10 April 2026 04:14 posted by mediterranean herb supplement

    I'm often to blogging and i really respect your content. The article has really peaks my interest. I'm going to bookmark your site and hold checking for brand new information.

  • Comment Link online guide Thursday, 09 April 2026 21:51 posted by online guide

    I'm not sure exactly why but this site is loading very slow for me. Is anyone else having this issue or is it a issue on my end? I'll check back later on and see if the problem still exists.

  • Comment Link resource page Thursday, 09 April 2026 16:46 posted by resource page

    I have realized that of all sorts of insurance, health care insurance is the most controversial because of the conflict between the insurance company's duty to remain making money and the user's need to have insurance cover. Insurance companies' revenue on wellbeing plans are incredibly low, as a result some providers struggle to earn profits. Thanks for the suggestions you talk about through this blog.

  • Comment Link Lunatogel\ Thursday, 09 April 2026 10:22 posted by Lunatogel\

    F*ckin? awesome things here. I?m very glad to peer your post. Thank you so much and i'm looking forward to touch you. Will you kindly drop me a e-mail?

  • Comment Link Dewalive Thursday, 09 April 2026 07:02 posted by Dewalive

    I just couldn't depart your website prior to suggesting that I actually enjoyed the standard info a person provide for your visitors? Is gonna be back often in order to check up on new posts

  • Comment Link Lunatogel\ Thursday, 09 April 2026 03:38 posted by Lunatogel\

    I have observed that car insurance organizations know the motors which are prone to accidents along with risks. Additionally they know what type of cars are given to higher risk along with the higher risk they've already the higher the actual premium amount. Understanding the uncomplicated basics connected with car insurance just might help you choose the right form of insurance policy which will take care of the needs you have in case you happen to be involved in an accident. Appreciate your sharing the ideas in your blog.

  • Comment Link casinobestuitbetalende.com Wednesday, 08 April 2026 08:56 posted by casinobestuitbetalende.com

    My brother suggested I might like this website. He was totally right. This post truly made my day. You can not imagine simply how much time I had spent for this information! Thanks!

  • Comment Link CasinoBestUitbetalende Wednesday, 08 April 2026 08:54 posted by CasinoBestUitbetalende

    Thanks for your write-up on the traveling industry. I might also like to add that if you are a senior considering traveling, it truly is absolutely crucial that you buy travel cover for senior citizens. When traveling, retirees are at biggest risk of getting a health-related emergency. Obtaining the right insurance policies package to your age group can safeguard your health and give you peace of mind.

Leave a comment

Make sure you enter all the required information, indicated by an asterisk (*). HTML code is not allowed.