What broke when we let an AI agent post short‑form video from real iPhones (1,506 posts in)

Description and use

Automating short‑form video posting from real iPhones faced issues with pop‑ups, incorrect post verification, caption errors, and duplicate‑content limits. The solution involved handling modals, confirming posts, reading captions from the screen, and ensuring unique clip segments.

Problem

Automating short‑form video posting from real iPhones failed due to UI pop‑ups, incorrect post detection, caption errors, and duplicate‑content limits.

Outcome

Automated posting achieved 1,506 posts across 44 accounts, but required extensive handling of pop‑ups, post verification, caption correction, and unique clip selection.

Workflow

• Connect iPhones to a Mac and launch official apps via WebDriverAgent.
• Use a coding agent (Claude Code, Codex, or Cursor) to queue clips and invoke a CLI.
• Before each tap, detect and dismiss any modal dialogs or pop‑ups; if unknown, screenshot, skip, and continue.
• After tapping Share, verify the post by checking the platform’s confirmation (post count, live Short, or posted screen).
• Read the caption from the screen, correct any autocorrect errors, and re‑type if necessary.
• If a post fails, retry after 20 minutes, checking the receipt to avoid double‑posting.
• Ensure each account uses a unique clip segment to avoid duplicate‑content limits.
• Maintain receipts for every successful post to support safe retries.

Evidence

Every app throws surprise sheets: rate-this-app prompts, "new feature" cards, permission dialogs, iOS update nags.

Source

The first version counted a post the moment it tapped Share. Uploads fail silently, processing stalls, and drafts get saved instead of published.

Source

Autocorrect and dropped characters happen, especially with emoji and hashtags typed through automation. The poster types the caption, reads it back from the screen, and fixes or retypes it before sharing.

Source

Once posting was reliable, we hit the real wall. The same moment of a video, posted again within about a week, gets crushed, even on a different account.

Source