Today's agents have to operate in a messy reality of flaky connections, ephemeral credentials, and irreversible actions. They need to navigate real software the way humans do: recovering from failures, learning from feedback, and making sound judgment calls. This talk is about the fundamental changes in RL required to make agents ready for IRL. We'll walk through what it takes for training environments to reflect the complexity of the real world, the perception primitives that let an agent see what a user sees, the harness pieces that help it survive contact with real applications, and the failure modes you only discover when you stop scoring and start shipping.
Computer Use sessions at AI Engineer World's Fair 2026 in San Francisco.
Wednesday, July 1, 2026
1:30 PM - 1:50 PM·20m
Track 7 · Room 2024
Capacity: 250 attendees
Sign in to add this talk to your schedule.

Gaurav Mishra
Amazon AGI Lab
Gaurav Mishra is speaking at AI Engineer World's Fair 2026.