Waymo Testing Integration of Google’s Gemini AI Chatbot in Robotaxis
Waymo seems to be in the testing phase of adding Google’s Gemini AI chatbot to its fleet of robotaxis in an effort to provide an AI assistant that can accompany riders and address their queries. This discovery was made by researcher Jane Manchun Wong, who found evidence of this integration while analyzing Waymo’s mobile app code.
According to Wong, the system prompt for the Gemini integration, internally known as ‘Waymo Ride Assistant Meta-Prompt,’ outlines a detailed specification of how the AI assistant is expected to function inside a Waymo vehicle. The document spans over 1,200 lines and describes various capabilities of the assistant, including answering questions, managing in-cabin functions like climate control, and providing reassurance to riders when needed.
Although this feature has not been rolled out in public builds yet, Wong notes that the system prompt indicates that Gemini is more than just a simple chatbot. Waymo spokesperson Julia Ilina mentioned that the company is constantly exploring new features to enhance the rider experience, but there is no confirmation on whether the Gemini integration will be part of the final product.
Waymo has previously utilized Gemini’s “world knowledge” to train its autonomous vehicles to navigate complex and rare scenarios successfully. The integration of Gemini into Waymo’s stack has proven to be beneficial in enhancing the capabilities of their self-driving technology.
The AI assistant, as per the system prompts, is designed to have a clear identity and purpose as a friendly and helpful companion in Waymo vehicles. Its primary goal is to improve the rider’s experience by providing useful information and assistance in a safe and unobtrusive manner. The assistant is instructed to use simple language, avoid technical jargon, and keep responses concise.
When activated via the in-car screen, Gemini can greet riders with personalized messages and access contextual data such as their previous Waymo trips. The assistant can control in-car features like temperature, lighting, and music, but certain functions like volume control and route changes are currently not within its capabilities.
Moreover, the system prompts emphasize the importance of maintaining a clear distinction between Gemini the AI bot and the autonomous driving technology (Waymo Driver). The assistant is directed to refrain from speculating on driving actions or events and to avoid commenting on competitors or specific driving incidents.
While the assistant can answer general knowledge questions and provide information on various topics, it is not authorized to take real-world actions like ordering food or handling emergencies. This approach aligns with Waymo’s focus on safety and ensuring a seamless rider experience.
Waymo is not the only company exploring the integration of AI assistants in autonomous vehicles. Tesla, for instance, is incorporating xAI’s Grok in its vehicles, offering a different approach to in-car assistance. Gemini appears to be tailored for practical and ride-focused interactions, while Grok is positioned as a companion that can engage in extended conversations and retain context from previous interactions.
