Companion
A patient tech helper for older adults.
Talk to it, show it a photo, or point your camera at the problem. It explains what's going on, shows you exactly where to tap, and teaches you one step at a time until you can do it yourself.
Works in iPhone Safari and Android Chrome with no install. "Add to Home Screen" makes it an app.
· Live status
Built for Ice Hacks 2026 · Next.js 16 · Google Gemini + Gemini Live · 543 automated tests + real-browser checks
"Siri answers your question. Companion stays until you can do it yourself."
| Home | Show me | Spots scams | Help that fades |
|---|
| | | |
| Three ways to get help: Ask, Show me, Live Help. | Photograph a pop-up, letter or router. It explains, then rings the button to press. | A suspicious text? STOP, why it looks wrong, and how to check safely. | The second time, it lets you try first. Help is always one tap away. |
Technology has become essential, but not everyone has been able to keep up. A pop-up you don't understand, Wi-Fi that won't connect, a text that might be a scam: the usual answer is "ask your grandchild". Companion stays with you through the problem, checks each step, and steps back as you learn. The goal is independence, not dependence on an AI.
What it does
| |
|---|
| Ask | Talk or type. One plain step at a time, says what things look like ("the grey gear"), waits for you. Answers in the language you speak. |
| Show me + Tap here | Take a photo or pick a screenshot. Companion says what it is, then draws a thick, high-contrast ring on the exact button to press. Coordinates from the AI are checked on the server and again on the phone; if the AI isn't sure, there's no ring and it describes the place in words instead. |
| Live Help | Point the camera and talk naturally. Gemini Live sees about one picture a second and answers out loud; you can interrupt it any time. Captions on screen. If Live Help can't start: "Live Help isn't available right now. Let's use Show Me instead.", keeping what you said. |
| Check my step | After each instruction: I've done it, Show me again, That didn't work, or Check my screen with a photo. Companion only says a step worked when you say so or the photo shows it. |
| Help that fades | Each task has five levels: full guidance, shorter steps, "Do you remember where to find that?", try the whole thing and check, then Learned. Asking for help never counts against you. |
| My Skills | Everything you've learned: Learning, Practising, Nearly there, Learned, with "Done on your own 3 times" and when you last did it. No scores. |
| Fridge Card | "Save this lesson for next time" turns a finished task into a large, black-and-white printable card with numbered steps and "if it doesn't work" tips. |
| Safety | Paste or photograph a message. STOP. This message may be a scam. / Be careful / No warning signs found / Can't tell, with the reasons and how to check independently. Never "definitely safe". |
| Call Shield | Play a suspicious call on speaker on another phone; Companion listens with its own microphone and flags requests for codes, PINs, gift cards, secrecy or "safe accounts" as they're said. It can't hear calls on its own phone (no web app can) and never listens in secret. |
| Scam Bait | "Doris", a muddled grandma, writes time-wasting replies to real scam texts; you send them yourself. A practice round uses a clearly labelled pretend scammer. Inspired by O2's Daisy. |
Scam detection, measured: caught 10 of 10 scam messages it had never seen, with 0 false alarms on 10 genuine ones (and 30/30, 0 false alarms on our 60-message set). See Scam scorecard.
以上为 README 的开头部分。其余内容请阅读原文。 查看完整 README ↗
