AI and Privacy: Reasons to Worry - Senstone

AI and Privacy: Reasons to Worry

8 Aug, 2025

In the blink of an eye, AI went from sci-fi to routine; just as quickly, AI became a privacy nightmare. From drafting company emails to helping users deal with depression, AI models deal with some very delicate matters, but the convenience comes with a hidden cost. Any information that you have ever fed to AI is no longer secure. Confidential documents, personal conversations, every single word.

 

It’s a sobering reality. AI is always taking notes. Always listening.

Why We Are in Trouble

The root of the issue with AI and privacy is a technological one. Whenever you use a public-facing AI model (such as ChatGPT), the data you input doesn’t stay on your device. It’s transmitted to a third-party server, where it’s processed, and the AI’s response is generated. This is the very essence of how these cloud-based models function. That means your private thoughts, company secrets, and personal information are no longer under your control. They are on someone else’s servers, subject to their security protocols – or lack thereof. Not everyone is as privacy-abiding as Senstone.

 

And what if the user feeding info to an AI is your hospital? Your therapist? Your employer?

 

Concerns along these lines, even if perfectly justified, are often dismissed as paranoia; but not in this case. The lack of privacy in AI is becoming a mainstream issue that even industry leaders are acknowledging (albeit grudgingly). 

 

OpenAI CEO Sam Altman, for example, has spoken about this very topic. In his interview with Theo Von, he noted the lack of legal confidentiality with AI systems. “If you talk to a therapist or a lawyer or a doctor about those problems, there’s legal privilege for it. There’s doctor-patient confidentiality, there’s legal confidentiality, whatever. And we haven’t figured that out yet for when you talk to ChatGPT.” (Yet, he says. After years of dealing with a deluge of personal user data.)

 

This is a great warning that the digital “therapist” you’re confiding in has no legal obligation to keep your information confidential. Your words might – and will – be used to improve the model and show you ads. The trust we place in AI systems is, for now, built on nothing.

Can AI Become Secure And Private?

 

So, what’s the solution? Is a world with AI destined to be a world without privacy? Not necessarily. The answer could lie in a new paradigm: private AI servers, or what some are calling “AI in a box.”

 

Instead of sending your data to a third-party server, this model involves running a large language model on your own hardware or a private, secure network disconnected from the rest of the internet. The AI lives “in a box” that is entirely under your control. Your data never leaves your environment, ensuring that all information remains confidential and secure. 

 

Sounds good, right? This approach would allow us to use the full power of AI without sacrificing privacy.

 

What’s more, the shift from a public, cloud-based AI to a private, local one could redefine how we interact with technology. It’s a move away from the “move fast and break things” ethos of the early tech boom and toward a more mature, privacy-centric model. 

 

As AI becomes more integral to our personal and professional lives, the ability to control our own data will no longer be a luxury – it will be a necessity. The conversation has started, and now it’s up to us to demand solutions.

More like this:

icon plus

Updates on voice capture technology for operations.

Subscribe