Play a mobile game round on Android by screen control
The poster says Gemini computer use on Android played a round of Fire Emblem Heroes by reading the screen and moving characters to fight. ·
Done withGemini
- What they did
- The poster built an Android app in AI Studio to give Gemini tool use on the phone: it could open apps, tap and swipe the screen, and interact with XML UI elements. With that setup, Gemini 3.7 Flash read the Fire Emblem Heroes screen, recognized the turn-based state, and moved the poster's strong characters through a round on its own.
- How it went
- It completed a round, which the poster says earlier Gemini 3.6 could not do and instead tapped around menus before giving up. The poster says the play was not optimal, simple tasks still took a minute or two, and the behavior was inconsistent.
- Worth knowing
- The clearest catch is speed and reliability: even simple tasks took a minute or two, and the poster says the computer-use behavior was still inconsistent.
Try it yourself with Gemini
Use computer use on my Android phone to open [mobile game] and play one round of [mode or level]. Read the screen each turn, move my characters sensibly toward [goal, e.g. winning the battle], and don't spend money or make in-app purchases. Stop when the round ends and tell me the result and the moves that mattered most.
Want help getting this working? Join the Vibe Coding Academy ↗ Run by Alex Finn, who also runs this site.
Source: Reddit · Aug 20, 2026
Related use cases
Orchestrate a multi-phase RAG migration
A walkthrough of using Gemini CLI to coordinate a complex, multi-phase cloud migration project.
Vibe code an HTML5 browser game
The developer of Xenodochium built the game with Gemini, hit repeated errors, and worked around them by starting a fresh chat.
Shop Etsy for party supplies within a budget
Chrome auto browse with Gemini searched Etsy, added items to the cart, applied discount codes and left the cart ready for the user to review.
Build retro games with a child using Claude Code
An author builds games like a space shooter and an animal hospital game with his 7-year-old, using pixel art assets and a spec drafted via Claude's question tool.
Run a D&D dungeon crawl with an AI dungeon master
A browser D&D 5e dungeon crawl where an AI dungeon master runs the game for a three-character party without inventing rules.
Custom agent
Get 5 like this every morning
The best things people got an AI agent to do, each with the prompt to try it.