Oren Yosifon

VP Product, SaaS Platform, Cellebrite

The Good, The Bad and the Eval

Product Managers struggle with defining clear success metrics for AI based features. Here's a story: 

I once met Ron Huldai, who told me he wanted to spend 100$K on an AI based feature tat would benefit Tel-Aviv. I told him I can build him an amazing AI model that would predict each day, if there's going to be a devastating earthquake in the following day in tel-aviv. He asked me: "what will the accuracy of the model be?" and I said: "99.9%" . My model was very simple, giving "no" as an answer every day. 

This story shows, for example, that "accuracy" is a metric that s not the right one to use in this situation.

In our talk I will explain how to measure how "good" are your AI Features, in order to understand how they improve over time, and create a shared language with customers and R&D.

 

Written by  Read 2414 times Last modified on Friday, 19 December 2025 11:46
Rate this item
(0 votes)

69 comments

  • Comment Link custom mylar bags Sunday, 12 April 2026 08:03 posted by custom mylar bags

    Heya i am for the first time here. I found this board and I find It really useful & it helped me out much. I hope to give something back and help others like you aided me.

  • Comment Link Lost Mary BM6000 pods Sunday, 12 April 2026 03:14 posted by Lost Mary BM6000 pods

    Hi are using Wordpress for your blog platform? I'm new to the blog world but I'm trying to get started and set up my own. Do you require any coding knowledge to make your own blog? Any help would be really appreciated!

  • Comment Link Lost Mary BM6000 pods Saturday, 11 April 2026 23:09 posted by Lost Mary BM6000 pods

    There may be noticeably a bundle to know about this. I assume you made sure nice points in features also.

  • Comment Link Lost Mary BM6000 pods Saturday, 11 April 2026 19:05 posted by Lost Mary BM6000 pods

    I have learn several just right stuff here. Definitely value bookmarking for revisiting. I surprise how a lot attempt you place to make this type of wonderful informative web site.

  • Comment Link custom mylar bags Saturday, 11 April 2026 15:07 posted by custom mylar bags

    I do consider all the ideas you've presented on your post. They're really convincing and can certainly work. Still, the posts are very brief for starters. Could you please lengthen them a bit from next time? Thanks for the post.

  • Comment Link custom mylar bags Saturday, 11 April 2026 11:34 posted by custom mylar bags

    Thanks for your posting on the travel industry. I will also like contribute that if you're a senior thinking of traveling, it really is absolutely vital that you buy travel insurance for elderly people. When traveling, elderly people are at greatest risk of experiencing a health care emergency. Buying the right insurance plan package for your age group can look after your health and give you peace of mind.

  • Comment Link custom mylar bags Saturday, 11 April 2026 08:16 posted by custom mylar bags

    Thanks for the strategies you are discussing on this site. Another thing I want to say is the fact that getting hold of some copies of your credit profile in order to check accuracy of each and every detail could be the first action you have to carry out in fixing credit. You are looking to thoroughly clean your credit profile from detrimental details mistakes that wreck your credit score.

  • Comment Link Depobos Friday, 10 April 2026 23:46 posted by Depobos

    I have really learned new things through your blog post. One other thing to I have seen is that in many instances, FSBO sellers will probably reject you. Remember, they'd prefer not to ever use your companies. But if you maintain a steady, professional partnership, offering help and keeping contact for around four to five weeks, you will usually have the ability to win a conversation. From there, a house listing follows. Many thanks

  • Comment Link Depobos Friday, 10 April 2026 19:02 posted by Depobos

    Thanks for the tips shared in your blog. Something else I would like to say is that losing weight is not all about going on a celebrity diet and trying to lose as much weight as possible in a couple of days. The most effective way in losing weight is by taking it slowly and gradually and right after some basic tips which can help you to make the most out of your attempt to lose fat. You may recognize and already be following a few of these tips, yet reinforcing understanding never does any damage.

  • Comment Link Depobos Friday, 10 April 2026 14:59 posted by Depobos

    It?s really a nice and helpful piece of information. I am glad that you shared this useful info with us. Please keep us up to date like this. Thanks for sharing.

Leave a comment

Make sure you enter all the required information, indicated by an asterisk (*). HTML code is not allowed.