A quiet but intensifying conflict is playing out inside American families: grandparents, aunts, uncles, and friends are feeding children's photos into AI image generators — Grok, Meta's tools, custom book and merchandise sites — and producing eerily polished results they share with delight. On the other side are Millennial and Gen Z parents who understand, with varying degrees of alarm, that uploading a child's face to an AI platform means surrendering biometric data to a company whose future uses of that data are entirely opaque.
The generational divide isn't really about technical literacy. Researchers argue it's about fundamentally different relationships with privacy. Baby Boomers came of age when privacy was the default for ordinary people — you weren't a public figure, so no one was tracking you. Millennials watched the internet transform from anonymous AOL chatrooms to the permanent, searchable, screenshot-able record of Facebook and LinkedIn. Gen Z grew up after cancel culture made the consequences of that permanence viscerally real. Those lived experiences make the risks feel categorically different to each cohort.
The stakes are escalating fast. xAI's Grok is currently facing a lawsuit from a child sexual abuse survivor who alleges the chatbot generated new deepfake exploitative images of her after real abuse images were uploaded to the platform. Meta launched a Muse Image tool this past summer that let users generate images based on other people's publicly posted photos — and shut it down within a week under fierce backlash. Europe is weighing regulations that would restrict AI chatbot and companion access to users under 15. Meanwhile, a 2021 Penn State study found that older adults who posted more photos to Facebook reported higher feelings of competence and wellbeing — a real psychological pull that keeps grandparents coming back to share.
The family stories illustrate how difficult these negotiations are in practice. One mother tried to compromise with her own Boomer mom by allowing only pre-approved photos where the baby isn't the focal point — her mom has already broken the rules twice. A 22-year-old named Brandon discovered his mom had dropped him into an AI-generated '80s-themed image as a fun TikTok trend; he told her he was uncomfortable having his image used without consent and now worries about how his biometric data is being processed inside open-source AI models, with no legal mechanism to demand its removal. One Gen Z man working in AI governance came home to find an AI-generated caricature of a family photo hanging on his grandparents' kitchen wall.
The normalization feedback loop may be the most insidious dimension of the problem. The more AI-generated family images circulate on social media — graduation posters, birthday eCards, custom children's books — the more they read as normal and harmless, which prompts more uploads, which trains more models, which makes the tools more capable and more widely used. Reclaiming an image once it enters that pipeline is functionally impossible today, and the spread of smart glasses and ambient surveillance tech is making it harder by the day to control your own likeness in the first place.
Gist is a free AI reader for your browser, iPhone, and Android. Get concise summaries and key takeaways from any article or podcast.
Get Gist — Free