1 episodes taggedApproximate match across all podcasts
Home/Tags/PRIORITIZE VERIFIABLE EVALS

PRIORITIZE VERIFIABLE EVALS

All podcast episode summaries matching PRIORITIZE VERIFIABLE EVALS — aggregated across every podcast we track.

1 episodes · Page 1/1

Quotes & Clips tagged PRIORITIZE VERIFIABLE EVALS

8 on this page

AI adoption lags behind rapid technological innovation

And we believe that still will continue, right? Because this is exactly what we're also seeing right now with, of course, there's still, of course, there's tremendous progress, but we also see that the AI adoption in the enterprise is still not where we want to see it, right? Like there's this Gardner curve, right? Where say like there's this AI innovation race, and then there's this AI outcome race, right? Then the gap almost increases, right? Versus getting narrow.

Philipp Herzig

Quantum computing solves complex enterprise optimization problems

What we are focusing on is the optimization domains, obviously, and then if you go into things like logistics, traveling salesman problems, knapsack problems, like all these kind of usual hard problems in computer science, these are interesting problems where we believe that could be interesting for the future, for maybe a different kind of computing paradigm to solve for.

Philipp Herzig

Agent mining captures tribal knowledge from decision traces

Now we call it agent mining because we record all these decision traces, these contexts, what the users are entering into the system. And then you can either use it to say like, hey, wait a minute, this is actually an anomaly. The folks in, I don't know, in UK from our company or the folks in Australia shouldn't do this because the standard operating procedure is this. Or you say like, oh, that's actually a very good improvement.

Philipp Herzig

AI re-engineers software through UI, processes, and data

With AI, the same is happening. It is happening on three levels. It happens, of course, on the UI side. ... Then the second one is, of course, the business processes like an order to cash in the past. ... And then, of course, below that, you have the whole data layer, right? The whole data layer of bringing, of course, SAP has a lot of super valuable data for a company.

Philipp Herzig

Outcome focus drives SAP's long-term enterprise durability

What hasn't changed is what customers are seeking for, which is outcomes, right? Outcomes and return on their investment in order to get the things done, right? And of course, now AI is an amazing technology that again helps to get more things done in the enterprise, right? And then that is actually what SAP is standing for, right?

Philipp Herzig

Scale is the primary hurdle for enterprise AI

But SAP and these large customers, right? They always have a problem of scale. Okay, what do you know with 100 documents? Well, it becomes a little harder. A thousand documents becomes a deeper engineering challenge. ... we have 20,000 APIs, right? So it becomes just like because it's so huge, right? There's so much things. So it becomes this problem of scale, right?

Philipp Herzig

Evals are essential for reliable agentic outcomes

The most important thing from a development perspective is actually people start writing their evals. That is, I was on this tour for a very long time because the problem, why does agenda coding work so well, Sarah, is of course, you can verify the outcome, right? You can either say, hey, is the program compiling, or are you unit tests, right?

Philipp Herzig

LLMs are insufficient for predictive tabular data analysis

Now, the problem is, of course, still today, if we look at these predictive questions, right? ... the challenge is large language models are not made for this, right? In a way, how they generate just one token after another essentially in a sequence to sequence modeling, I mean, they're language models, right? And they do this phenomenally well. But if you still want to do these predictors where you have to go back to these classical machine learning approaches...

Philipp Herzig

More clips tagged PRIORITIZE VERIFIABLE EVALS?

Get a daily email of the best quotes & audio clips from the top podcasts.

Subscribe for daily Quicklets