πŸ“‘ Table of contents

Poki: the open source agent that lives on your iPhone and taps into your real apps

Agents IA 🟒 Beginner ⏱️ 15 min read πŸ“… 2026-11-21

Poki: the open source agent that lives on your iPhone and types in your real apps

πŸ”Ž Two agents, two worlds, the same week

On November 20, 2026, Google Research recounted a decade of Duplex and its direct integration into Tasks, at the heart of the Gemini app (TechCrunch, November 17, 2026). A cloud agent, proprietary, free for hundreds of millions of users, that calls businesses on your behalf.

The same day, a very different project was taking the opposite path. Poki, an open source agent published on GitHub, goes through no server to act: it lives on your iPhone, reads the screen, and types, swipes, and scrolls in your real apps.

Two answers to the same question β€” how to delegate concrete tasks to an AI β€” and two philosophies that are hard to reconcile. ExplainX captured the moment well in its November 21, 2026 edition: the debate is no longer "do we need agents?", but "who controls them?".


The essentials

  • Poki is an open source agent (AGPL-3.0-only) that runs directly on iPhone: it reads the screen and types, swipes, and scrolls in your real apps, with no jailbreak.
  • Installation takes just one sentence: "Install Poki on my iPhone", issued to Claude Code or Codex from a Mac or PC, with the iPhone plugged in over USB. After that, it runs on its own.
  • It uses your accounts: a ChatGPT Plus/Pro login or an API key from Anthropic, OpenAI, Gemini, DeepSeek, OpenRouter, OpenCode Go, or an OpenAI-compatible server.
  • It stops at anything sensitive: payments, deletions, and Wallet trigger a pause pending approval, with each step displayed in the Dynamic Island and on the lock screen.
  • Google responded within the same news cycle with Duplex in Tasks: local + open source versus proprietary cloud agent β€” the duel is on.

Tool Main use Price Ideal for
Poki Local agent that drives your real iPhone apps Free (open source, AGPL-3.0) Automating iOS without jailbreak
Official installation guide Prerequisites, USB cable, VPN, 7-day signing Free Getting the installation right the first time
Poki for Claude Code Your iPhone as an MCP tool for Claude Code/Codex Free Mobile devs: UI testing, video captures
Hostinger VPS to expose an OpenAI-compatible endpoint from a few $/month (November 2026, check hostinger.com) Connecting Poki to a self-hosted model

So what exactly is Poki?

Poki is an open source AI agent that installs on your iPhone and drives your real apps on your behalf: it reads the screen, then taps, swipes and scrolls just like your thumb would.

The project is published on GitHub by an independent developer, under the AGPL-3.0-only license. The pace is dizzying: v0.1.0 on November 5, 2026, v0.4.0 beta 1 on November 13 (release notes). Two weeks to go from "it works on my machine" to a cross-platform installer.

Once installed, Poki needs no one. You trigger it via chat, by holding down the Action button, or through Siri and Shortcuts. Each step displays live in the Dynamic Island and on the Lock Screen β€” you watch the agent work, in real time.

A detail that feels like the future: on iPhone Duo, Poki works on two apps side by side in Split View. An agent that multitasks better than most humans β€” that's a pretty good summary.


Comment Poki controls your iPhone without jailbreak

Poki combines two components: the system accessibility tree for screen reading, and native touch events for actionβ€”without jailbreak or external hardware.

Concretely, the agent doesn't "look" at screenshots like a tourist. It receives the interface structure: buttons, labels, fields. Then it sends touches that behave like physical interactions, indistinguishable to the apps.

Two technical regimes coexist. On iOS 27 and later, control is native. On iOS 18 to 26, Poki goes through an XCTest session. The project specifies having tested on a physical iPhone running iOS 27β€”this is the reference configuration.

Why the accessibility tree is the right bet

Agents that "see" screenshots break with every interface redesign. The accessibility tree, however, describes the structure: it is more robust, less demanding, and aligned with settings designed for humans. In my opinion, this is the healthiest technical choice for this project.

The MCP legacy: when the iPhone becomes a dev tool

Poki wasn't born as an app. The first version was an MCP server linking an agent running on a computer to an iPhone or a simulator; this path is no longer maintained, replaced by the standalone app. However, the integration documentation (poki.bot) clearly describes the exposed surface for Claude Code and Codex: screen reading via the accessibility tree, touch, text input, batch execution, video recording.

For developers, the use cases remain excellent: verifying a mobile build on real hardware, chaining multi-screen UI interaction batches into a single tool call, capturing a video for a bug report. If you already use code mode in Claude Code to chain your tool calls, the iPhone simply becomes another tool in the list.


Installation: a USB cable and one sentence are all it takes

Yes, installation boils down to a single instruction: tell Claude Code or Codex "Install Poki on my iPhone" with the iPhone plugged in over USB, and the installation agent handles the rest.

The operation only needs to be done once, from a Mac or a Windows PC. After that, Poki lives its life on the iPhone, no computer required. The prerequisites, detailed in the official guide:

  • an iPhone XS/XR/SE 2nd generation or newer, running iOS 18 minimum (iOS 27 tested);
  • a Mac on macOS 14+, or a Windows x64 PC with Apple Devices/iTunes;
  • Node.js 24+ for the installation agent on the Mac side;
  • a USB cable and a simple free Apple account;
  • a VPN app on the iPhone routing 10.7.0.1 to the device β€” LocalDevVPN does the job for free, as do Karing or Shadowrocket.

An acknowledged point of friction: the app is signed for 7 days via a free Apple account, and the signature has to be renewed β€” from Poki Setup or from the app itself. That's the price of life outside the App Store: zero Apple commission, but a weekly ritual.

My take: this ritual disqualifies Poki for the general public, and that's just fine, for now. If you want to understand the mechanics Claude Code manipulates during this phase, our guide how to create an AI agent details these perception-action loops.


Your Keys, Your Models: BYOK Arrives on iOS

Poki doesn't bundle any models and doesn't sell any: it connects to your accountsβ€”ChatGPT Plus/Pro login, or API keys for Anthropic, OpenAI, Gemini, DeepSeek, OpenRouter, OpenCode Go, or any OpenAI-compatible server.

This choice changes everything, economically. No intermediary subscription, no margin on your tokens, no imposed engine. You pay for your consumption with the provider of your choiceβ€”or not at all, if you self-host.

And for an agent that must read screens and chain steps, the quality of the model is not a detail. The latest agentic rankings (June 2025) set the tone:

Model Agentic Score (June 2025) Access via Poki
GPT-5.5 (OpenAI) 98.2 API Key or ChatGPT Plus/Pro login
Gemini 3 Pro Deep Think (Google) 95.4 Gemini API Key
Claude Opus 4.7 Adaptive (Anthropic) 94.3 Anthropic API Key
Kimi K2.6 (Moonshot AI, self-host) 88.1 OpenAI-compatible Server
GLM-5 Reasoning (Z.AI, self-host) 82 OpenAI-compatible Server

The self-host options are worth looking into: Ollama exposes an OpenAI-compatible API, so it's set up in two minutesβ€”our guide on open source AI agents with Ollama details the process. GLM-5 Reasoning or Kimi K2.6 run on a simple VPS: a Hostinger starting from a few dollars per month (November 2026, check hostinger.com) is more than enough.

To decide between these engines, our comparison of best LLMs for AI agents remains the best entry point. My advice: start with a flagship model (GPT-5.5 or Claude Opus 4.7 Adaptive), then scale down once your scenarios are stabilized.

Payments, deletions, Wallet: where Poki stops dead

Faced with a sensitive action β€” paying, deleting, touching the Wallet β€” Poki pauses and waits for your approval. The Wallet, on the other hand, is always confirmed, no exceptions.

Approval levels are configured in the settings. And transparency isn't just a slogan: every step is displayed in the Dynamic Island and on the lock screen. You watch the agent act, step by step, and you can interrupt at any time.

These are the right defaults. Many agents chain fifty actions and then hand you a post-mortem summary; Poki checks with you before any damage is even possible. I hope this default behavior becomes an industry norm.

The real privacy question remains, which the project documents honestly: screen content is sent to the chosen model service. If Poki opens your banking app while it's running on a cloud API key, those screens go to that provider. Two countermeasures: a self-hosted endpoint, or a strict case-by-case approval policy.


The same day, Google responds with Duplex in Tasks

On November 20, 2026, Google officially announced the integration of Duplex directly into Tasks, at the heart of the Gemini app: a proprietary cloud agent that calls businesses on your behalf. The exact opposite of Poki.

How it works, as detailed by AI Understanding: Duplex calls businesses from Tasks, and each call identifies itself as an automated system calling on behalf of Google. Merchants can refuse these calls, via their Google Business Profile or mid-conversation. Under the hood, Duplex now runs on Gemini 4 (Hydrogen and Neon) β€” multimodal understanding, planning, low-latency speech synthesis β€” which replace the old narrow, task-specific models.

Tasks is no longer limited to calls: invoice analysis, payments via the Agent Payments Protocol, coordination by email and RCS. And according to TechCrunch (November 17, 2026), the whole thing is being opened up free of charge to hundreds of millions of users on Gemini 4 Hydrogen: calls, reservations, Google Pay, browsing websites. Eight months were all it took: Gemini Spark in May for testers, Task Mode, then general availability β€” a decade-long story that Google Research recounted on November 20.

Criterion Poki Duplex in Tasks (Gemini)
Where the agent runs On the iPhone, locally In Google's cloud
Code Open source (AGPL-3.0-only) Proprietary
Model Yours (BYOK or self-host) Gemini 4 Hydrogen and Neon
Scope All your iOS apps Calls, appointments, payments, email/RCS
Price Free + your API usage Free (November 2026)
Transparency Every step on screen, pause before sensitive actions Calls announced as automated, merchant opt-out
Target audience Technical users Hundreds of millions of users

To be fair: the "this call is automated" announcement is good practice on Google's part, and the free rollout changes the scale of the market. But the trust models are incompatible. With Duplex, you hand your context over to a third party that monetizes an entire ecosystem. With Poki, nothing leaves your phone, except what you decide to send to the model of your choice.

This divide, moreover, isn't just about these two. Our roundup of the best autonomous AI agents traces the same open/cloud line, and initiatives like Poppy 10, the personal agent protocol that installs on every Shopify in the world are already paving the way for interoperability between personal agents.


The limitations, no sugarcoating

Poki is a two-week-old beta, physically verified within a narrow scope: Chinese-language interface, portrait mode, a physical iPhone running iOS 27.

The project lists its own limitations, which is rare enough to be praised:

  • screen content is sent to the chosen model service (see above);
  • physical support has only been verified with the Chinese interface and in portrait mode;
  • no testing on iOS versions below 27 or on iPad β€” even though the official requirement goes down to iOS 18;
  • a breakneck release pace (v0.1.0 on November 5, v0.4.0 beta 1 on the 13th), meaning quality varies from one week to the next.

The structural fragility of "on-screen" agents

The real risk isn't in the beta, it's in the approach: every iOS or app update can move a button, rename a label, break a sequence. The accessibility tree cushions these shocks; it doesn't eliminate them. Agents backed by official APIs remain more stable β€” but those APIs don't exist for everything.

Agentic open source isn't just about the screen, either: DeerFlow by ByteDance: the open-source agent that researches, codes, and creates over the long term explores a completely different path β€” that of long, documented missions. The two approaches will eventually cross paths.


Who it's for, and why: the use cases that already justify the detour

Today, Poki targets two audiences: mobile developers and power users who can live with a weekly beta.

For developers, the value is already there: verifying a build on real hardware, chaining multi-screen UI scenarios in a single tool call, generating video captures for bug reports. That scope alone justifies the project's existence.

For advanced users, it's the repetitive multi-app tasks: copying a piece of data from one app to another, filling out forms, checking five apps in sequence. Within the same open source wave, OpenHuman: the open source AI agent that knows your life before you even talk to it builds the personal context; Poki provides the hands. The two complement each other more than they compete.

And if your needs lean toward long-haul missions β€” research, code, projects that stretch over days β€” DeerFlow by ByteDance remains the open source reference in the field.

On the other hand, three profiles should sit this one out: those who don't want to plug in a USB cable on a Saturday afternoon, those who refuse to send their screens to a cloud provider, and those who can't tolerate any service interruption. For them, waiting six months will be the more rational choice.


❌ Common Mistakes

Mistake 1: Believing that "open source" means "nothing leaves the phone"

The code is open, not the flow: screen content goes to the model service you have configured. The solution: a self-hosted endpoint for sensitive uses, and case-by-case approval for everything else.

Mistake 2: Diving in without checking the prerequisites

An iPhone that's too old won't cut it: you need XS/XR/SE 2 at minimum, iOS 18+, a Mac running macOS 14+ or a Windows x64 PC, Node.js 24+, and a VPN app for the installation phase. The solution fits in one link: follow the project's official guide, not a YouTube tutorial.

Mistake 3: Disabling approvals to save three seconds

The confirmations for payments, deletions, and Wallet exist because an agent sometimes gets things wrong β€” and a wrong tap costs more than an ignored notification. Keep the default settings until you've observed the agent on dozens of mundane tasks.

Mistake 4: Confusing the historical Poki MCP with the standalone app

The old Poki MCP, which connected a desktop agent to an iPhone or a simulator, is no longer maintained. If you follow an outdated tutorial, you'll end up installing a dead project. Aim for the current release (app-0.4.0-beta.1, November 13, 2026) and the standalone app.


❓ Frequently Asked Questions

Short answers, straight to the point.

Is Poki really free?

The software, yes: open source under the AGPL-3.0-only license, with no subscription on Poki's side. But the agent consumes tokens: a ChatGPT Plus/Pro subscription or API billing, depending on the provider you choose. When self-hosting (GLM-5, Kimi K2.6), you only pay for the infrastructure. Factor in the cost of the model, not the agent.

Do you need to jailbreak your iPhone?

No, and that's the project's key technical point. Poki reads the system's accessibility tree and sends native touch events, with no jailbreak or external hardware required. Native control on iOS 27+, XCTest session on iOS 18–26. The catch: a 7-day signature that has to be renewed, via a free Apple account.

Does Poki work without a computer once installed?

Yes. The Mac or PC is only needed for the initial USB installation, and possibly for renewing the signature β€” though Poki Setup or the app itself can handle that. Day to day, the agent is triggered via chat, a long-press of the Action button, or Siri and Shortcuts, directly on the phone.

Which models can you plug into Poki?

A ChatGPT Plus/Pro subscription, or API keys from Anthropic, OpenAI, Gemini, DeepSeek, OpenRouter, OpenCode Go, or any OpenAI-compatible server. For an agent that reads screens and plans, aim for the top of the agentic rankings: GPT-5.5 (98.2) or Claude Opus 4.7 Adaptive (94.3) make the difference on complex multi-step sequences.

Poki or Duplex in Gemini Tasks: which one to choose?

First, two different use cases: Poki drives your iOS apps, while Duplex calls businesses and pays via Google Pay. Then, two philosophies: local, open source, and BYOK versus a proprietary cloud that's free and operates at massive scale. If control comes first, Poki; if simplicity comes first, Tasks.

Is my screen data sent to a third party?

Yes, to the model service you've configured β€” this is a limitation documented by the project itself. With a cloud model, your screens pass through that provider. The only complete workaround is self-hosting an OpenAI-compatible endpoint on your own machine or a VPS.


βœ… Conclusion

At the end of November 2026, Poki and Duplex embody the two possible futures of the mobile agent: the one where your phone obeys your API key, and the one where it obeys someone else's cloud β€” a fragile but free beta facing off against a polished but locked-down service. Try Poki from its GitHub repository, and tell us in the comments which philosophy wins you over.