Turn a handwritten grocery list into a cart
ChatGPT Agent transcribed 15 of 16 items from a photo, found the nearest store and added them to the cart, but missed onions and struggled with login.
Done withChatGPT Agent
- What they did
- Timothy B. Lee gave ChatGPT Agent a photo of a handwritten grocery list, with the items to buy marked in red. He asked it to fill an online cart. The agent transcribed the list, found his nearest store (Harris Teeter) and added items. When a safety proxy blocked the Kroger login page, he told it he would log in himself, then entered his password.
- How it went
- It transcribed 15 of 16 items and added all 15 to the cart, missing onions. Operator had managed only 13 of 16 in an earlier test. After about six minutes it stalled at login, then finished the order.
- Worth knowing
- An OpenAI safety proxy blocked the Kroger-hosted login as irrelevant. Replying that you'll log in yourself, then typing the password, got past it.
Try it yourself with ChatGPT Agent
I'm attaching a photo of my handwritten grocery list. Transcribe it into a typed list and show it to me so I can check for anything missed. Then find the nearest [store] to [my location or zip code] and add every item to the cart. Stop before checkout and show me the cart, any items you could not find and the total, and wait for my approval before ordering.
Source: understandingai.org · Undated
Five of these in your inbox every morning
The best things people got an AI agent to do, each with the prompt to try it.
More like this
Plan a family trip and pre-fill bookings
A reporter had ChatGPT Agent plan a 4-day San Diego trip: it searched flights, compared hotels, built an itinerary and pre-filled booking forms, stopping before purchase.
Find a vintage lamp on Etsy
ChatGPT Agent worked 50 minutes and reported adding five lamps to the cart, but the user's own cart was empty as it ran on a separate computer.
Build a benchmark image collage in Canva
The author had ChatGPT Agent log into Canva and build a collage of benchmark results; after over 75 minutes the result was poor as it fumbled the interface and drew shapes in Python.
- Qwen 3.6 27B
Order groceries online with a local LLM skill
The author built a grocery skill for a local Qwen 3.6 27B model that knows their fridge contents, past orders and real-time stock, and it ordered products for them online.
- Custom agent
Build an Instacart grocery cart from a chat request
A reporter connected Instacart to ChatGPT, which assembled the cart for formula, ice cream and fruit and opened a checkout confirmation in chat.
Plan meals and place grocery orders from a Google Doc
Claude and Muse handle meal planning, pantry inventory and recipe tracking, then Muse reads a Google Doc and places the grocery order in a browser, with the poster confirming payment from their phone.