Signal's President Meredith Whittaker has sounded a warning about the growing trend of treating AI chatbots as trusted companions, stating that they are not conscious beings and should not be considered friends. In an interview with Bloomberg, Whittaker emphasized that agentic AI systems, which require near-total access to a user's digital life to function, are structurally incompatible with end-to-end encryption.

Whittaker's comments come as the use of AI chatbots like ChatGPT and Claude is becoming increasingly widespread. These tools are designed to simulate human-like conversations and can be used for tasks such as answering questions, generating text, and even creating art. However, Whittaker argues that these systems are not sentient interlocutors and should not be treated as such.

Background and Context

Signal is a non-profit organization that operates the most widely used end-to-end encrypted messaging protocol in the world. The company's encryption is also used by WhatsApp, which has over two billion users. Whittaker has previously stated that Signal would leave the EU rather than comply with any law requiring it to compromise its encryption.

Whittaker's comments about AI chatbots are part of a broader discussion about the implications of agentic AI systems on privacy and security. Agentic AI systems, such as Microsoft Copilot, require near-total access to a user's digital life in order to function. This includes access to messages, credit cards, browsers, and other sensitive information.

Whittaker argued that this level of access is incompatible with end-to-end encryption, which is designed to protect users' privacy by ensuring that only the sender and recipient can read encrypted messages. She stated that an AI agent that can read a user's messages before they are decrypted would constitute a "backdoor" in the context of Signal.

Why it Matters to the Industry

The implications of Whittaker's comments for the adult industry are significant. Many platforms and operators rely on end-to-end encryption to protect users' privacy and ensure compliance with regulations such as age verification. If agentic AI systems are allowed to compromise this encryption, it could have serious consequences for the industry.

For example, if an AI agent can read a user's messages before they are decrypted, it could potentially be used to identify minors or detect prohibited content. This would undermine the very purpose of end-to-end encryption and put users' privacy at risk.

Furthermore, Whittaker's comments highlight the need for greater transparency and accountability in the development and deployment of agentic AI systems. As these systems become increasingly widespread, it is essential that their impact on privacy and security is carefully considered and addressed.

What Comes Next

The implications of Whittaker's comments are far-reaching and will likely have significant consequences for the industry. As the use of agentic AI systems continues to grow, it is essential that developers, operators, and regulators work together to ensure that these systems are designed and deployed in a way that prioritizes users' privacy and security.

Whittaker's comments also highlight the need for greater collaboration between companies like Signal and Microsoft. While Microsoft has touted its Copilot system as a revolutionary tool for productivity and convenience, Whittaker's warnings suggest that this may come at a significant cost to users' privacy and security.

Key Facts

  • Signal's President Meredith Whittaker has warned that AI chatbots are not conscious beings and should not be treated as friends.
  • Agentic AI systems, such as Microsoft Copilot, require near-total access to a user's digital life in order to function.
  • This level of access is incompatible with end-to-end encryption, which is designed to protect users' privacy.
  • Whittaker stated that an AI agent that can read a user's messages before they are decrypted would constitute a "backdoor" in the context of Signal.
  • Signal operates the most widely used end-to-end encrypted messaging protocol in the world, with over two billion users.
  • Whittaker has previously stated that Signal would leave the EU rather than comply with any law requiring it to compromise its encryption.

The implications of Whittaker's comments are significant and will likely have far-reaching consequences for the industry. As the use of agentic AI systems continues to grow, it is essential that developers, operators, and regulators work together to ensure that these systems are designed and deployed in a way that prioritizes users' privacy and security.