Meta's Llama model has memorized Harry Potter and indian homemade sex videosthe Sorcerer's Stoneso well that it can reproduce verbatim excerpts from 42 percent of the book, according to a new study.
Researchers from Stanford, Cornell, and West Virginia University analyzed dozens of books from the now-infamous Books3 dataset, a collection of pirated books used to train Meta's Llama models. Books3 is also at the center of a copyright infringement lawsuit against Meta,Kadrey v. Meta Platforms, Inc.The study's authors say their findings could have major implications for AI companies facing similar lawsuits.
According to the research paper, the Llama 3.1 model "memorizes some books, like Harry Potterand 1984, almost entirely." Specifically, the study found that Llama 3.1 has memorized 42 percent of the first Harry Potter book so well that it can reproduce verbatim excerpts at least 50 percent of the time. Overall, Llama 3.1 could reproduce excerpts from 91 percent of the book, though not as consistently.
"The extent of verbatim memorization of books from the Books3 dataset is more significant than previously described," said the paper. But the researchers also discovered that "memorization varies widely from model to model and from book to book within each model, as well as varying in different parts of individual books." For example, the study estimated that Llama 3.1 only memorized 0.13 percent of Sandman Slimby Richard Kadrey, one of the lead plaintiffs in the class action copyright suit against Meta.
So, while some of the paper's findings seem damning, don't call it a smoking gun for plaintiffs in AI copyright infringement cases.
"These results give everyone in the AI copyright debate something to latch on to," wrote journalist Timothy B. Lee in his Understanding AI newsletter. "Divergent results like these could cast doubt on whether it makes sense to lump J.K. Rowling, Richard Kadrey, and thousands of other authors together in a single mass lawsuit. And that could work in Meta’s favor, since most authors lack the resources to file individual lawsuits."
Why is Llama able to reproduce some books more than others? "I suspect that the difference is because Harry Potter is a much more famous book. It's widely quoted and I'm sure that substantial excerpts from it on third-party websites found their way into the training data on the web," said James Grimmelmann, a professor of digital and information law at Cornell University, who was cited in the paper.
What this also shows, Grimmelmann said, is that "AI companies can make choices that increase or reduce memorization. It's not an inevitable feature of AI; they have control over it."
Meta and other AI companies have argued that using copyrighted works to train their models is protected under fair use, a complex legal doctrine. However, the extent of memorization could complicate those arguments.
“Yes, I do think that the likelihood that LLMs are memorizing more than previously thought changes the copyright analysis,” Robert Brauneis, a professor with the George Washington University Law School, said in an email to Mashable. He concluded that the study’s findings could ultimately weaken Meta’s fair use argument.
We asked Meta for comment on the study's findings, and we'll update this article if we receive a response.
Disclosure: Ziff Davis, Mashable’s parent company, in April filed a lawsuit against OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.
Lieu Elected to House Leadership as DPCC Co
Chinese car sales see recovery in August with 2.2% y
An Odd Coupling
The Power and the Noise
Torrance Optometrist Receives ‘Best in South Bay’ Award for 9th Year
Back When American Fascism Was Bad
Arsenal vs. PSG 2025 livestream: Watch Champions League for free
Alibaba opens its AI model Tongyi Qianwen to the public · TechNode
Go For Broke Displays Portraits of Nisei Vets
JBL Go 3 Eco speaker deal: Get 25% off
Kayoko Wakita to Be Honored by Studio for SoCal History, Girl Scouts
TikTok to give US merchants big discounts during Black Friday · TechNode
Chinese EV maker WM Motor’s Hong Kong IPO collapses · TechNode
Douyin to expand group
Book Launch Party for ‘NCRR: The Grassroots Struggle for JA Redress’
BMW MINI to produce electric vehicles in China in 2024 · TechNode
Best Amazon deal: Get the FlexiSpot Standing Desk for just $95
Ant Group unveils finance
Laura Bush: Separating Families Raises Parallels to JA Incarceration
Great Wall Motor launches Haval H6 in Mexico · TechNode
Gardena Obon This WeekendRecap: Day 2 of Paris Major qualifiers‘Quiet Beauty’ Author to Speak at ManzanarEWP Actors Conservatory Studio Lab Project Presents 'His Girl Friday'Visionary Sculptor Ruth Asawa Dies at 87FaZe find form to eliminate 9INE from ParisToshi Seeger, Wife of Pete Seeger, Dies at 91Vitality crush Grayhound to earn first win at EPL‘A Principled Stand’ Tells Gordon Hirabayashi’s Story in His Own Words‘Quiet Beauty’ Author to Speak at Manzanar Grateful Crane Presents ‘Songs for a Sansei’ JANM Mourns Passing of Sen. Feinstein ESGVJCC to Screen 'Kanei Chronicles' Online L.A. Councilmember Lee Accused of Ethics Violations A Friend of S.F. Japantown 'Manzanar, Diverted' to Be Shown at UCLA ‘ABCs of Asian American History’ Aimed at Young Readers VJCC Celebrates Year of Rabbit Manzanar Baseball Project Calling for Volunteers Satoshi Nakamoto's Last Unfinished Project Inspires New Online Marketplace
0.1362s , 8458.328125 kb
Copyright © 2025 Powered by 【indian homemade sex videos】Enter to watch online.Meta’s Llama has memorized huge portions of Harry Potter,Global Perspective Monitoring
