GOVERN AGENTS

“We moved from a classic ML world to a world where we have LLMs, generating responses. And now we want to move on to a world where actions need to be taken, specific goal oriented actions need to be taken. And when the problem that we are working on is a complex one, with multifaceted, aspects associated with it, That's where multiagentic comes into place. So, basically, we have a large complex goal which we have to break down into specific steps, and each step is basically narrowed to a specific agent.”

“So, I think, customers that are new on the multi agentic journey are one of our more naive users. So we have to offer them prebuilt blueprints that they take and run for their use cases. There are savvy customers who know what they want to do, and you offer them those developer kits. So we have all of these different ranges that we offer to the to our customers depending on where they come from, what their use case is, and how can they get to the fastest path to production in the least, constrained manner as possible.”

“All the more important that observability comes to the forefront in stochastic systems like a multigenic application. All the more important for us to be able to replay agentic actions and try to understand how it function. Agent behavior needs observability along many different dimensions in terms of what are the tools involved, what was the reasoning mechanism that led to that tool invocation. And, overall, what was this context that passed across systems?”

“So what in the past, what used to be thought of as non functional requirements such as latency today is product feature. It is it is baked into the experience of a developer. So these are some things that, you know, we are seeing a paradigm shift in terms of what we need to bring to the fore to the developer experience to keep in mind when you're when you're implementing your systems.”

“Chat Concierge for us was, our beachhead initiative around deploying multi agentic deploying a multi agentic solution. So, Chet concierge is essentially a a auto deal dealership, project or application that was deployed out to our auto dealers to basically bridge that experience between dealers and their customers and make it very seamless. And we need to understand we are moving to a world where the car buying experience doesn't start at the dealership. It starts before. It starts when they go to their website and try to figure out, okay, what's the inventory?”

“I'm thinking about an example that we, you know, we've all heard about. I forget the the very specific scenario, but, a business had a chatbot. I think it happened in Canada, had a chatbot on their website, and the customer asked for a discount, and the the chatbot basically gave them a discount. You know, this would clearly be disastrous in a, in a car dealer type of scenario. Like, how do you, make, you know, generative AI and agents safe, you know, for, you know, these dealers that have a lot at stake?”

“When you, you are the most successful when you can offer two things, reasoning and specialization. So reasoning capabilities with our agentic platforms, a agentic frameworks in the platform, we are bringing that to the fore. Specialization is something that is very, very crucial. So this can be achieved primarily using, specialized models and fine tuning. Student teachers student distillation gives you that control you need to have on, providing personalized experiences as well as providing, having some control over your latency metrics.”

“I think the core is that, you know, you really need to treat agentic AI as a system. It's truly a system. You have to start with governed data. You have to kind of put in that risk controls baked into multiple layers of your, of your application or your system. You have to look at, latency as something that needs to be optimized end to end. And, understanding that your biggest gains do come from postproduction telemetry is also critical.”