Autonomous Vehicle Expansion Hinges on the People Behind the Screens

Autonomous vehicle (AV) robotaxis have taken hold in several key markets around the country, with new hubs emerging steadily. AV companies have so many variables to account for: the vehicles themselves, the underlying technology, local regulations, and more. Even if everything looks exactly right on paper, it may not be enough to establish a competitive presence in the market.

So what does it take? What’s the X-factor needed to make a launch work? Perhaps surprisingly, it’s not the technology. Though there are major differences in the tech behind leading AV brands, the bottom line is this: everyone is using the most advanced tech they can, but it still requires fine tuning and supervision.

Rather, the competitive differentiator lies in how companies respond if AVs don’t operate perfectly. Because behind the scenes, human-in-the-loop teams (“teleoperators”) remotely monitor AVs in the field, keeping a pulse on active trips, ETAs, and incidents that require intervention. Maybe a passenger forgets to buckle their seatbelt; maybe a poorly marked traffic detour confuses the car’s system. Whatever it is, human teleoperators are at the ready to step in, solve the problem, and keep passengers safe.

The quality and agility of this service is what will make or break AV success. It directly affects both passenger safety and the overall passenger experience; it speaks to the organization’s level of care and preparation; it’s the difference between springing into action and leaving passengers stranded and alone. With the right strategy and AI tools, AV companies can make their human workforce a competitive advantage. Here’s how it’s done.

Hiring the best to prepare for the worst

First things first: AV companies need to hire the right people for the teleoperator role. It may not seem like it, but being a teleoperator can be a high-stress, high-stakes job. If someone gets a notification that a car is stuck, it could be something benign like a door not being fully closed. It could also be a passenger experiencing a serious medical event. At the outset, all the operator knows is that the passenger needs help.

It’s crucial to have the right people at the helm in these situations. Teleoperators need to be hyper-vigilant without being stunned into inaction. They need to be able to move situations forward, which may require calling first responders, calmly explaining the situation, and reassuring passengers.

Proactively screening candidates can help AV leaders find the right people for the teleoperator role. Effective screening tools are evidence-based and evaluate candidates’ various characteristics, scanning for traits that are correlated (or have an inverse relationship) with resiliency.

Successful teleoperators have high levels of emotional regulation, a clear sense of purpose, and low levels of neuroticism. These are people who naturally remain calm under pressure; they’re quick on their feet in high-stress situations; they can compartmentalize the incident once it’s resolved, take a breath, and resume monitoring other vehicles. In other words, they’re exactly the kind of people you’d want helping you if something were to go wrong in a robotaxi.

Screening for these inherent traits is key–it helps AV companies identify candidates with the highest potential. But training is what turns potential into action. To be effective in their roles, AV teleoperators need to be supported with robust safety frameworks and curricula that help prepare them for anything. The right programs will help new hires grow into the go-to support system that makes any AV ride possible.

A strong team of teleoperators will directly support passenger safety, confidence, and loyalty. They’ll also help build public trust, demonstrating that the company knows what can go wrong and has prepared for the unlikeliest of situations. But hiring and training the right teleoperators is just the beginning–what comes next is supporting those people so they can sustain their performance day after day.

AI supports the support team

Like any mission-critical asset, AV teleoperators must be given the resources and attention they deserve. This is where AI comes into play, helping organizations assess and support teleoperator wellbeing.

AV teleoperators need to sustain a high level of vigilance when they’re on the job. After several hours of active monitoring, teleoperators may start to feel fatigued; they may not be as responsive as they were at the start of their shift. Every second counts in an emergency situation. AV companies need to be able to monitor teleoperator fatigue and, when performance starts slipping, encourage stepping away from the desk.

AI tools built into the teleoperator platforms can monitor behavioral data like mouse pathways and click delay to detect fatigue and cognitive overload. A teleoperator may start their shift with rapid, direct mouse movements from A to B–but after several hours on the clock, these movements may get more sluggish and sloppy. AI can recognize this pattern in real time and alert the teleoperator (and their manager) that they need to take a break and get refreshed before stepping back up to the plate. Otherwise, both teleoperator and passenger wellbeing is at stake.

AI can also, over time, help teleoperators stay more focused by making data-backed recommendations for product and engineering teams. What teleoperators need is a clean, straightforward system that makes it easy to monitor AVs, identify problems in real time, and intervene as necessary. AI can monitor how often teleoperators need to scroll, how far they need to move the mouse, how often they need to switch applications, and more. In aggregate, this data can illuminate areas for improvement to make AV monitoring systems simpler and more efficient.

With AI as a supporting tool that drives performance and improves day-to-day experience, AV companies can optimize teleoperator performance, wellbeing, and retention in the long term, setting the entire organization up for success.

It’s about preparation, not perfection

It’s an exciting time for the AV industry. The technology is improving every day–sensors are getting smarter and better and vehicles can handle a wider variety of driving conditions. But we’ll always need humans in the loop, and it’s the people behind the scenes who serve as competitive differentiators.

As the robotaxi market takes hold across the United States, public confidence will be shaped less by flawless rides and more by how companies respond when things don’t go perfectly. To make any expansion stick, AV companies need to focus on more than just vehicle technology. They need smart, agile support systems powered by both AI and highly capable people. They need to never lose sight of the human element powering this growing industry.