AI's Healthcare Potential, and the Guardrails It Needs

Trexin’s Chief Technology and Innovation Officer, Ton Roelandse, joined the MedCity Pivot Podcast for a conversation about where AI genuinely helps in healthcare, and where, without the right guardrails, it can do real harm.

The discussion held two truths at once. The potential is real: AI can take meaningful work off clinical and operational teams and surface insight that would otherwise stay buried. But healthcare is exactly the kind of setting where “move fast and break things” is the wrong instinct: the cost of a confident, wrong output isn’t a bad demo, it’s a medical error. The throughline of the conversation was that the hard part of AI in healthcare isn’t the model; it’s deploying it responsibly, with human oversight and guardrails designed in from the start rather than bolted on after something goes wrong.

That’s the same conviction that runs through how we work: in regulated, high-stakes environments, trust isn’t a value statement, it’s the product. Getting AI into production safely (so it holds up under scrutiny and actually earns clinical and operational confidence) is the work.

Watch the full conversation on the MedCity Pivot Podcast: youtube.com/watch.

If you’re weighing how to adopt AI in a regulated healthcare environment without taking on unacceptable risk, let’s talk.