2 episodes taggedApproximate match across all podcasts
Home/Tags/ACQUIRE AI COMPUTE

ACQUIRE AI COMPUTE

All podcast episode summaries matching ACQUIRE AI COMPUTE β€” aggregated across every podcast we track.

2 episodes Β· Page 1/1

Quotes & Clips tagged ACQUIRE AI COMPUTE

12 on this page

The US must inevitably develop proprietary open source models

β€œI do think that to, to some extent is I I think there is importance to The US that we develop our own models. I think that that would be a massive loss if that there are five companies, you know, five different labs in China that are creating open source models, and we're struggling to get one set up. So it's necessary. I also think it's inevitable. And, you know, like, the deep sea the deep sea moment a year ago, I remember someone saying to me and I thought it was, like, very well said, which is, like, and the world's changing a lot, but they said, hey. You know, we should kinda just forget Mhmm. That this is a Chinese model. We should just act like this came from Mhmm. From meta and and build and build with that in mind.”

β€” Tuhin Srivastava - CEO of Baseten

AWS execs culturally normalize frequent pager alerts

β€œI think, like, one, I think if you've worked at an infrastructure company like, we were once in a meeting with a bunch of AWS execs, and this was, you know, like, very senior AWS folks. All their pages went off multiple times, during our forty five minute meeting. You know? Like, it's a I I I think, like, it's it's it's very much like it's a cultural thing. But, yeah, like, I I don't you know, our, like, inference can't go down and, like, you know, we you know, you you you learn to like, you know, what's this? Like, I think Amir, my cofounder, when his pager goes off, his seven year old said, is that a p zero? Oh, is that is that is that a p zero? And so, you know, I I think that is you just have to get used to it, and that's the culture you live in.”

β€” Tuhin Srivastava - CEO of Baseten

GPUs as a service are commoditized and lack stickiness

β€œI think, like, GPUs as a service is not sticky. I think that's been seen. Like, customers generally just see that as as commodity. Imprint with the software they included is incredibly sticky. You know, like, just just like, you know, none of our top 30 customers have ever churned. You know, we're talking, like, 400% annual NDR Mhmm. Around our business. And so it's like very it's, it's very, very sticky. So I think that software layer is very important.”

β€” Tuhin Srivastava - CEO of Baseten

Founders micromanaging whole problems actually have hiring issues

β€œI think the two or three things that I'll say is, like, you want people where you can give them whole problems. Yeah. And so, like, you know, if if you are if you feel like you are micromanaging, if you feel like you need if you feel like, you know, you you have to be involved in everything, I think that's a bit of a cop out as a founder because you're just like, I just need to be involved in everything. It's like, no. You probably don't have the right people. I think the second thing is, be very, very clear what you're optimizing for.”

β€” Tuhin Srivastava - CEO of Baseten

The inference supply crunch leaves zero slack compute

β€œI think, you know, there there's so much narrative around the supply crunch. And no matter like, as much as we hear about it, I don't think people realize how bad it really is. Like, there is, you know, there is very, very little Slack compute available. Like, you know, we we run pretty large clusters ourselves, and we run them in, like, uncomfortably high utilization. You know, we when I'm saying we're, like, mid nineties utilization Mhmm. Most of the time.”

β€” Tuhin Srivastava - CEO of Baseten

AWS execs culturally normalize frequent pager alerts

β€œI think, like, one, I think if you've worked at an infrastructure company like, we were once in a meeting with a bunch of AWS execs, and this was, you know, like, very senior AWS folks. All their pages went off multiple times, during our forty five minute meeting. You know? Like, it's a I I I think, like, it's it's it's very much like it's a cultural thing. But, yeah, like, I I don't you know, our, like, inference can't go down and, like, you know, we you know, you you you learn to like, you know, what's this? Like, I think Amir, my cofounder, when his pager goes off, his seven year old said, is that a p zero? Oh, is that is that is that a p zero? And so, you know, I I think that is you just have to get used to it, and that's the culture you live in.”

β€” Tuhin Srivastava - CEO of Baseten

The application layer will survive through proprietary workflows

β€œI think the application layer will exist for a number of reasons. One is because, you know, I think this idea, that what it what is valuable to a company, is, you know, the the user signal that they can gather, that only they can gather. And to the extent that that is encoded, in a model, I think a lot of their business will, be at risk. But to the to the extent that it is encoded in workflows, that is where they will be able to develop notes. So a good I think a good example of that is, say, a company like a bridge where the clinicians edits of the notes and what they do with those notes after the fact and the, the thing that happens in, inside the earmark three steps down, and that becomes a workflow that only”

β€” Tuhin Srivastava - CEO of Baseten

GPUs as a service are commoditized and lack stickiness

β€œI think, like, GPUs as a service is not sticky. I think that's been seen. Like, customers generally just see that as as commodity. Imprint with the software they included is incredibly sticky. You know, like, just just like, you know, none of our top 30 customers have ever churned. You know, we're talking, like, 400% annual NDR Mhmm. Around our business. And so it's like very it's, it's very, very sticky. So I think that software layer is very important.”

β€” Tuhin Srivastava - CEO of Baseten

The application layer will survive through proprietary workflows

β€œI think the application layer will exist for a number of reasons. One is because, you know, I think this idea, that what it what is valuable to a company, is, you know, the the user signal that they can gather, that only they can gather. And to the extent that that is encoded, in a model, I think a lot of their business will, be at risk. But to the to the extent that it is encoded in workflows, that is where they will be able to develop notes. So a good I think a good example of that is, say, a company like a bridge where the clinicians edits of the notes and what they do with those notes after the fact and the, the thing that happens in, inside the earmark three steps down, and that becomes a workflow that only”

β€” Tuhin Srivastava - CEO of Baseten

Founders micromanaging whole problems actually have hiring issues

β€œI think the two or three things that I'll say is, like, you want people where you can give them whole problems. Yeah. And so, like, you know, if if you are if you feel like you are micromanaging, if you feel like you need if you feel like, you know, you you have to be involved in everything, I think that's a bit of a cop out as a founder because you're just like, I just need to be involved in everything. It's like, no. You probably don't have the right people. I think the second thing is, be very, very clear what you're optimizing for.”

β€” Tuhin Srivastava - CEO of Baseten

The inference supply crunch leaves zero slack compute

β€œI think, you know, there there's so much narrative around the supply crunch. And no matter like, as much as we hear about it, I don't think people realize how bad it really is. Like, there is, you know, there is very, very little Slack compute available. Like, you know, we we run pretty large clusters ourselves, and we run them in, like, uncomfortably high utilization. You know, we when I'm saying we're, like, mid nineties utilization Mhmm. Most of the time.”

β€” Tuhin Srivastava - CEO of Baseten

The US must inevitably develop proprietary open source models

β€œI do think that to, to some extent is I I think there is importance to The US that we develop our own models. I think that that would be a massive loss if that there are five companies, you know, five different labs in China that are creating open source models, and we're struggling to get one set up. So it's necessary. I also think it's inevitable. And, you know, like, the deep sea the deep sea moment a year ago, I remember someone saying to me and I thought it was, like, very well said, which is, like, and the world's changing a lot, but they said, hey. You know, we should kinda just forget Mhmm. That this is a Chinese model. We should just act like this came from Mhmm. From meta and and build and build with that in mind.”

β€” Tuhin Srivastava - CEO of Baseten

More clips tagged ACQUIRE AI COMPUTE?

Get a daily email of the best quotes & audio clips from the top podcasts.

Subscribe for daily Quicklets