Instinct's Powerful AI Assistant Raises Privacy and Security Concerns

Instinct, an AI personal assistant currently in private access, has captured widespread attention—not just for its impressive capabilities, but also for the significant privacy and security questions it raises. Early testers have described the agent as feeling “like magic” and have called it one of the “most exciting launches” since OpenClaw. However, beneath the buzz, concerns are emerging about its security model and the implications of its terms of service.

What Is Instinct?

Developed by a small team led by former Sierra research scientist Noah Shinn, San Francisco–based Instinct is operated by Spear Street Technology, according to its terms of service and California business filings. The company is currently operating in stealth mode, per PitchBook data.

How It Works

Instinct connects to your applications and devices, including email, messaging apps, calendar, and even your device’s audio, location, and screen. Users can interact with the assistant via text message or WhatsApp, asking it to handle tasks like booking appointments, scheduling rides, cleaning up inboxes, organizing information, managing shopping, or finding cheap flights.

Privacy and Security Concerns

While testers generally praise Instinct's performance, several have voiced concerns about its approach to customer privacy and security. The company’s Terms of Service grant Instinct a broad, “perpetual and irrevocable” license to “access, use, host, cache, store, reproduce, transmit, display, publish, distribute, and modify” any user materials—including for training its AI models. The terms also specify that Instinct may receive data from users’ devices, including screen captures, cursor movements, and keyboard inputs.

Furthermore, the terms allow Instinct to enter into “agreements, commitments, or transactions” on users’ behalf, which would be legally binding. This raises a timely question: Are the trade-offs of giving AI this level of access and autonomy actually worth it?

Some users have taken to social media to circulate screenshots of these terms and express their unease—noting that even prominent figures endorsing the tool may not fully realize what they’re agreeing to. As of now, Instinct remains in private testing, so these concerns have not yet hit the wider public at scale. But as AI assistants become more integrated into daily life, the balance between convenience and control will only grow more critical.

via TechCrunch AI

Related