The VergeAI & LLMs

Your Phone Just Got a New Pair of Hands: Google's Gemini Now Books Rides and Orders Coffee

In 2026, a long-promised vision of artificial intelligence is quietly materializing on our phones. Google's Gemini, in a beta update now rolling out to devices like the Samsung Galaxy S26 Ultra, has begun to perform tasks within apps on a user's behalf. It's a subtle but profound shift: your device is no longer just a tool you command, but an agent that can act.

The system operates in a virtual window. Ask it to order a ride to the airport, and it will open the Uber app, request the necessary clarifications, fill in the destination, and pause for your approval before confirming. It navigates interfaces with a deliberate, sometimes plodding, precision. In one test, when instructed to order a coffee and croissant, the AI spent noticeable time scrolling a Starbucks menu before successfully locating a flat white. It even made a judgment call, specifying the chocolate croissant should be warmed—a small but telling display of contextual understanding.

Watching your phone autonomously tap and scroll through an app is an uncanny experience. This isn't a voice assistant offering suggestions; it's software directly manipulating other software based on a simple sentence from you. While early and limited to select applications, the feature represents a tangible step toward devices that handle digital chores. The real test, now underway, is how it manages the unpredictable exceptions and complications of daily life. For now, it works, and that in itself is news.

Source: The Verge

← Back to News