Mom's Family Photos Became Deepfake Porn. She Did Nothing Wrong.

She wasn't sharing anything risky. Just family photos on Facebook — the kind every parent posts. Birthday gatherings. Kids at the beach. Cousins at a wedding. Normal life, shared with people she loved. Then someone told her those photos — her whānau's faces — had been pulled into AI-generated pornographic images. More than 15 people from her community had been targeted. She hadn't done anything wrong. The photos weren't suggestive. They were just... photos.

That's the part that should stop you cold. Not "she posted the wrong thing." Not "she should have known better." The photos were innocent. The technology is what changed. And if you have a social media profile with photos of your face, your kids, your family — you need to read the rest of this.

This Isn't a Celebrity Problem Anymore

For a while, deepfakes — AI-generated fake videos and images that swap real faces onto other bodies — felt like someone else's problem. Taylor Swift's problem. A politician's problem. A problem for people with millions of followers and PR teams.

That era is over.

The New Zealand story, reported by 1News, is a case study in how the threat has shifted. Criminal groups are no longer going after high-profile targets. They're scraping hundreds of photos from ordinary Facebook profiles — family portraits, school photos, holiday snaps — and running them through AI tools that are now widely available, cheap, and dangerously easy to use. The technical barrier to doing this has essentially collapsed. You used to need a skilled programmer. Now you need an app and bad intentions.

The mother in this story later said she wished she had locked her profile down. Her exact words, after discovering what had been done with her family's images: "I had done that from the very start." That sentence is the whole story. She did everything most of us do. And it wasn't enough. This article is part of a series — start with Deepfake As A Service Fake Boss Scams Workplace Risk.

Read that again. This isn't a fringe use case. This is the primary use of deepfake technology right now. And the scale is growing at a pace that's genuinely hard to absorb: according to the Views4You Deepfake Database, deepfake pornographic video production was 464% higher in 2023 than it was in 2022. Not 64% higher. Four hundred and sixty-four percent. In a single year.

The Part Nobody Tells You About the Extortion

Here's where it gets genuinely terrifying for parents. This isn't just about humiliation. It's about money — and it's happening to kids.

The FBI warned in June 2023 that attackers had shifted their playbook. Forget the old-school approach of befriending someone online, gaining their trust, and coaxing them into sharing a real photo. That takes time and effort. Now, criminals scrape publicly visible social media photos — your kid's Instagram, your family Facebook — run them through AI, manufacture a fake explicit image, and then message the victim directly. No prior relationship required. No warning. Just a shocking image and a demand: pay up, or we share it.

A 15-year-old girl in one documented case received a fake nude image of herself built entirely from her Instagram photos. Researchers described it as "really convincing." She had posted nothing remotely explicit. Her face was real. The rest was AI-generated fiction. The psychological impact? Every bit as real as if the image had been genuine.

"When criminals use deepfake technology to create explicit content from innocent photographs, victims face the additional trauma of seeing themselves depicted in situations they never participated in, creating a unique form of psychological violation." — Minc Law, legal analysis of AI sextortion

Schools are now caught in this too. According to Malwarebytes, blackmailers have been scraping ordinary school website photos — the same team photos and yearbook shots every school publishes — feeding them into AI deepfake tools, and using the manufactured images as leverage. Some schools have quietly removed student photos from their public websites entirely because of this. Let that sink in: schools are hiding pictures of their own students to protect them from a threat that didn't exist three years ago.

And the numbers involving children are staggering. The Conversation reported a 1,325% increase in AI-generated child sexual abuse material between 2023 and 2024. That's not a typo. Thirteen hundred percent in one year. Previously in this series: Your Loan Officer Just Called About The Wire It Wasnt Him.

The Panic Is the Weapon

So what happens when someone receives one of these messages? Usually: instant terror. That's not a character flaw. That's a completely human response to seeing a realistic image of yourself — or your child — in an explicit situation you know never happened. Your brain goes into emergency mode.

And that panic? That's exactly what the abuser is counting on.

In traditional extortion — the kind that didn't involve AI — victims could hold onto a small logical lifeline: "This image doesn't exist. They're bluffing." Deepfakes close that escape route. Even if you know the image is fake, it looks real. The fear that someone might believe it is real. That someone might share it. That your reputation, your relationships, your family could be destroyed by something that never happened — that fear is extraordinarily powerful, and it drives people to pay, to comply, to stay silent.

Silence is the worst possible response. Paying is the second worst. Because in most cases, paying doesn't make it stop. It tells the extortionist the target is scared and willing — which typically leads to more demands, not fewer.

Here's a useful question to hold onto: if someone sends you a shocking image and demands secrecy, money, or silence — do you have any actual reason to believe that image is real? Not "does it look real." Does it make sense, given what you know about your own life, that this image genuinely exists? That pause — just that two-second check-in — is enough to short-circuit the panic response that extortionists are designing for.

What You Can Actually Do Right Now

The uncomfortable truth is that no single action makes you completely safe from this. But there are real, practical steps that reduce your exposure significantly — and none of them require a technical background. Up next: Your Boss Just Called It Wasnt Him And It Cost 25 Million.

Start with your social media privacy settings. Go check them tonight, not someday. On Facebook, switch your photo albums to "Friends only" or tighter — not "Public." On Instagram, make your account private if it's not already. Do this for your kids' accounts too. The New Zealand mother's profile was open so her whānau could access photos easily. That's a completely understandable reason. It's also how her family's faces ended up in a database of abuse material. The convenience isn't worth it.

If you've ever wondered whether an image of you or someone you love is circulating somewhere it shouldn't be — that's a legitimate worry, and it's exactly the kind of question that identity and image-monitoring tools exist to help answer. Knowing what's out there is the first step. You can't act on a threat you don't know about.

The deepfake threat used to feel distant. Something that happened to famous people, or to teenagers who had made a mistake online. The New Zealand mother's story removes that comfortable distance. She was doing what millions of parents do every single day — sharing her family with the people she loved. The technology moved. The threat moved with it. We need to move too.

Her final wish — that she had locked her profile down from the very start — shouldn't have to be a lesson anyone learns the hard way. But here we are. And the photos you posted last Saturday? They're still public if you haven't checked.