Turning screenshots into actions

Taking a screenshot is easy. The harder part is adding its date to your calendar, finding its address again, or remembering to reply to the message it contains. That is why Kipp treats screenshots not as a passive archive, but as unfinished work.

You make the first choice

Kipp does not scan your entire photo library in the background. You choose the screenshot to process through PhotosPicker or the Share Extension. Before sending it, the app corrects its orientation and removes metadata and EXIF information. A very long screenshot may be split into a full overview and a few overlapping sections to keep its contents legible.

That first step matters: an explicit user selection, not an automatic library scan, defines the content to be processed. You can also see the sequence on the How it works page.

From visual context to a structured result

The selected image goes through Kipp's secure cloud service to an independent AI provider. Instead of producing separate OCR text and sending that text to the model, Kipp asks the model to analyse the screenshot's visual context directly. It does not ask for a free-form chat response. It requests a structured result containing a title, summary, category, intent, relevant fields and up to three ranked action proposals.

Dates and times, locations, URLs, email addresses, phone numbers, amounts, people, products or tasks can be part of that result. The backend checks the result against a schema and applies additional deterministic validation to fields such as date, time zone, URL, email and phone. Suggestions with missing information or low confidence are marked for review rather than being allowed to run.

A proposal is not an action

Kipp's central safety boundary is the review screen between analysis and action. You see the extracted fields, edit them when necessary and choose whether to confirm. Creating a calendar event or reminder, searching in Maps, opening a validated HTTPS link, copying or sharing text, and preparing an email draft or contact form all happen on the device after that approval. Email is not sent automatically, and a contact is not saved automatically.

A result can be wrong. Confidence and evidence therefore do not replace your judgement; they show you what may need attention. No external action in Kipp runs until you review and confirm it.

The result returns to your workflow

An analysed item stays visible in the Inbox with a state such as New, Needs Review, Ready, Done or Failed. Search, filters and user-created Spaces make screenshots for the same purpose easier to find later. Local results and search remain available offline, and the original screenshot stays in Photos unless you delete it there.

You can explore Kipp's features or read the privacy explanation for the image's cloud processing path. In short: you choose, Kipp structures, you edit and approve, and the action happens on your iPhone.