Meta’s new commercial terms will allow the scraping of news sites: experts

3 days ago (niemanlab.org)

I don’t really understand the legal theory here. Party A (Meta) writes a contract with Party B (a business account holder) ostensibly granting A the right to scrape B’s website and a license to the content.

But why is there any presumption that B owns the content or has any right to grant this license? It’s extremely common for a publisher to license content from a third party under terms that may not allow this sort of sublicencing. What happens if the publisher can’t grant this license?

  • In this case, Party B is sandwiched between Party A (scraper such as Meta) and Party C (the third-party content provider). The scraping agreement dictates A-B relationship and the licensing agreement dictates B-C relationship. Devil is in the fine print as far as what is allowed in both agreements.

    Party B has already committed to uphold B-C. Entering A-B may put them at risk of violating that agreement by appearing to grant Party A rights that Party C never granted to anyone but Party B (and maybe even rights that Party B doesn't enjoy). Party B's options are don't consent to A-B (e.g., withdraw from Meta program), take down the Party C content (which would suck if they've already paid for it), or negotiate a carve-out with one or both of Parties A and C.

    (IANAL)

    • I am not an expert in licensing legalese, but that strikes me as awfully wrong. If I am e.g. a musician and I license my work to be used by B for specific purposes and B unilaterally signs an agreement with A that gives them rights to my stuff, the question is gonna be what MY licensing terms allow. They have an agreement with me. Whether they enter other agreements is their decision to make, but they still have to fulfill my terms.

      Sure, they should not sign things that put them into the spot of having to break my licensing agreement with me, but the fact that these kind of legal stretches are even seen as valid in the US reassures me in my stance to avoid business relations with the US. I prefer countries with a legal system that can't easily be bent out of shape using money.

      1 reply →

    • If they really want to be spiteful they can rewrite all the news articles they post to Meta using Muse. Then we can finally see if the theories of statistical model collapse hold up at the trillion param level model scale.

      1 reply →

  • I'd guess that Meta is going to scrap everything anyway, and this license addition is just something that they think may come in useful if there are future court cases. The details of who has permission to grant licenses won't matter until then.

    • Yes that makes senses. It's a hedge.

      Meta's past behaviour has been to ignore illegality in business, with the hope that they can either win in court or stave off legal action altogether.

      That's how they acted with the books they pirated to train models and when they targeted children with gambling products to increase revenue.

      They love a legal grey area. It's not what's moral it's what you can get away with.

      1 reply →

  • Not a lawyer, but my understanding is that crawling is a gray area. By putting that into their terms of service that most of the planet is agreeing to, they protect themselves in the case someone complains.

    Also, this is about crawling and has little to do with the license of the contents.

    • Not a lawyer, but my understanding is that if a Big Tech company doesn't explicitly rule out using your data, they're using your data. And if they rule it out explicitly, they will eventually still use your data.

  • Isn’t the reasonable expectation that publishers don’t transfer rights they don’t own?

    What happens if the publisher has a license granted by their tier1 but their tier1 can’t grant this license?

  • Not a lawyer, but what if someone did this:

    - Find examples of content that will constitute infringement. Then send Meta legal a notice saying here are examples where the publisher does not own the content, and their scraping is not legal. Our current/future clients will be damaged by Meta's planned actions.

    This might elevate it to willful infringement.

    • Just register the copyright on things that you expect Meta to use. Registering a copyright is cheap and gives you the right to sue for triple damages for any infringement after the copyright is registered. You must have a registered copyright to sue, if you register the copyright after the infringement you can only sue for actual damages.

      Consult a real lawyer if this matters to you. The above is my understanding of the law, but I'm not a lawyer and different countries have slightly different laws.

  • Is that different from them doing whatever with your data, without knowing if that's actually messages written by you, pictures of you alone taken by you etc?

  • My guess is - legal or not, Facebook might’ve calculated the consequences (aka, fines) and decided it is worth the cost. Most publishers will not have the resources to fight them in court anyways

    • Most publishers have resources - it is millions, but it looks like a cut an dried case that they are highly likely to win. A 2 $million investment that results in $10 million dollar is a good investment. The numbers seem reasonable, though of course publishers need to consider their real situation.

  • Given how most of SV seems to work, they will likely simply continue scraping the content regardless of license.

  • Excerpts from "Commercial Terms"

    Current

    https://www.facebook.com/legal/commercial_terms

    Licenses: As described in The permissions you give us section in our Terms, you grant us a license to content that is covered by intellectual property rights (like photos or videos) you share, post, or upload on or in connection with our Meta Products.

    For any access or use of the Meta Products, that license applies to content you or someone on your behalf (such as your agency that places an ad for you or your service provider that manages your Page content for you) makes available on or in connection with any Meta Product.

    You also will ensure that you own or have secured all rights necessary to grant the licenses and rights you (or someone on your behalf) grant to us under the Commercial Terms and any applicable supplemental terms, including permission to display, distribute and deliver your content within the Meta Products. https://www.facebook.com/legal/commercial_terms_preview

    New (Effective Oct 30, 2026)

    https://www.facebook.com/legal/commercial_terms_preview

    Licenses & Rights You Provide Meta: As described in "The permissions you give us" section in our Terms, you grant us a license to content that is covered by intellectual property rights (like photos or videos) you share, post, or upload on or in connection with our Meta Company Products ("Content").

    That license applies to Content you or someone on your behalf (such as your agency that places an ad for you or your service provider that manages your Page content for you) makes available on or in connection with any Meta Company Products.

    Without limiting anything in our Terms and for clarity, Meta may use such Content as described in our Terms, including to provide, develop, improve, research, and maintain Meta Company Products, services, and features provided under these Commercial Terms and any other applicable supplemental terms.

    This includes business, commercial, and related services to help you create and deliver ads and other commercial content, provide users information about your products and services, and connect you with users who may be interested in your products and services.

    You represent and warrant that you own or have secured all rights necessary to grant the licenses and rights you (or someone on your behalf) grant to us under the Commercial Terms and any applicable supplemental terms, including permission to display, distribute, create derivative works, and deliver your Content within the Meta Company Products, and that your Content will comply with all applicable policies for the Meta Company Products.

    You authorize us (or any entity acting on our behalf) to use automated software (such as web scrapers, bots, robots, spiders, crawlers, and user agents) and create test credentials to access, index, cache, analyze, collect, retrieve, or crawl the domains, web pages, or URLs (and any content available through them) that are associated with your products or services, or that are made available through your or users' use of Meta Company Products and services, and to periodically pull updates from such domains, web pages, or URLs.

  • Perhaps it's debatable whether the sentence beginning "You authorize..." is part of a license

    For example, the current Commercial Terms use the heading "Licenses" whereas the updated ones refer to "Licenses and Rights"

    Licenses can be revoked by the licensor (B)

    Under Meta's "Terms", the license given to Meta ends when the content is deleted

    https://www.facebook.com//business/terms

    What if Meta wants to keep "scraping" in perpetuity

    Does the express authorization in that sentence, which might be used as defense to a CFAA claim, for example, end when the content is deleted from Facebook

    What if the express authorization to "scrape" is not part of a (revocable) license grant based on copryright (e.g., CFAA does not require copyright)

    The Meta Terms and Commercial Terms have no termination provisions

    There are no notice provisions

    There is no negotiation

    There is no reciprocity

    For example, A is allowed under the Commercial Terms to use automation to access B, B is prohibited under the Terms from using automation to access A

    Arguably the only parts of this "agreement" that can be terminated are the licenses given to Meta and these end only when the content is deleted from Meta's systems

    But that's not within B's control

    It's up to Meta to ensure the content is "fully deleted"

    What if Meta fails in that regard

    Accepting Meta's terms is agreeing to limit Meta's maximum liability to $100

    Not only that but Meta has a list of exclusions that allow deletion to be delayed or denied, including "technical limitations" (see below)

    In sum, attempting to terminate licenses given to Meta may be a "nondeterministic" process (apologies for any errors in using nerd speak)

    Was it Senator Hatch who told Zuckerberg something like, "Your terms suck"

    Excerpt from "Terms"

    https://www.facebook.com/legal/terms

    3. Deleting Your Content: You can delete individual content you share, post, and upload at any time. In addition, all content posted to your personal account will be deleted if you delete your account. about how to delete your account. Account deletion does not automatically delete content that you post as an admin of a page or content that you create collectively with other users, such as photos in Shared Albums which may continue to be visible to other album members. It may take up to 90 days to delete content after we begin the account deletion process or receive a content deletion request. If you send content to trash, the deletion process will automatically begin in 30 days unless you chose to delete the content sooner. While the deletion process for such content is being undertaken, the content is no longer visible to other users. After the content is deleted, it may take us up to another 90 days to remove it from backups and disaster recovery systems.

    Content will not be deleted within 90 days of the account deletion or content deletion process beginning in the following situations:

    ...

    where deletion within 90 days is not possible due to technical limitations of our systems, in which case, we will complete the deletion as soon as technically feasible; or

    ...

    In each of the above cases, this license will continue until the content has been fully deleted.

  • > But why is there any presumption that B owns the content or has any right to grant this license?

    Because they placed the content on a public website.

    > What happens if the publisher can’t grant this license?

    Then it's unlikely that the content is something they themselves have the rights to broadcast on their website.

    • Dead wrong on both points. Having a license to publish something on a website does not mean that the publisher has the right to grant sublicenses or transfer the license to someone else. For example, stock image licenses are normally non-sublicensable and non-transferable.

      6 replies →

    • > Because they placed the content on a public website.

      I don't think this is a very good argument. For instance, if I have a company, called 'tickle-cats', I may expect regular customers to go and tickle a cat for, say, 1 cent, as cost. So I would expect regular people to visit my homepage.

      I may not necessarily expect or want to have bots, scrapers and what not, per se. I may have this by extension - possibly, e. g. to rank a website more highly. But bots and so forth are not my real target audience to begin with (and some are just malicious, trying to disrupt the business); some company owners may want to not have to do anything with them (bots, crawlers etc...). That's just one example of many more; I don't think the distinction "public versus private" is the only one that can be applied here.

      1 reply →

    • When pubs & cafés play music here in the UK they pay royalty fees to PRS for Music.

      If I record the songs playing & they sell bootleg CDs, I don't have a defence of "but it was played in public, so all copyright was waived". That's not how copyright works.

      1 reply →

This is some next level legal judo. Say what you want about the metaverse or muse, but it's clear that Meta is still innovating when it comes to its Terms of Service.

  • In a just world, meta wouldn't exist like this. I fail to see any benefit in a company like this. I can't think of a single useful product or advancement they've made besides creating the page that makes grandma go insane and young people everywhere to hate themselves.

    They're pointedly worse than most other social media. Even twitter doesn't really pretend they're anything but a place to say slurs now that "comedy is legal".

    Meta feels so much more nefarious due to how 99% of their business is quiet deals with data brokers and ad buyers, and they just smile and nod as if they make anything positive at all. It feels like a company that makes most of it's money selling heroin, but they have a cute storefront so they get a pass.

    • > I can't think of a single useful product or advancement

      > They're pointedly worse than most other social media.

      I agree that there's a lot wrong, but both Marketplace and Groups are actually pretty valuable and useful. To say that Facebook is just a feed of memes and politics is reductive.

      3 replies →

    • That's the system we live under here.

      You either have a government capable of controlling its corporations or you get corporations capable of controlling the government.

  • the scariest engineers are financial and legal engineers

    • Scary in what sense?

      Those are certainly among the most interesting engineers. For example, what were the American Founding Fathers, if not "legal engineers" (and certainly many of them were also "financial engineers", given this was one of their most pressing needs).

      I guess if you find yourself preferring the status quo all the time they might be scary but given I can't think of any time in history where the status quo was totally desirable I'm not sure what there is to be scared of exactly.

      Could you be more specific?

      9 replies →

    • No, it's the pick-up artists. They're the ones that know how to find ways to get around saying "no" to touch what they wanna touch even if the rest of us didn't want them to.

      1 reply →

Doesn't them requiring a license from partners to train on their content undermine the more general argument that they don't need a license from copyright owners to train on copyrighted content -- which I assume most big AI firms would love to make?

IANAL, but this looks like Meta lawyers trying to shield themselves against partners' suing them, but enough cases like this could help set a precedent that -- yes, you do in fact need a license.

  • If you don't have a license to download the material, aren't you doing piracy?

    If the licenses say that download is only permitted if you agree not to train on it or similar, then if you have downloaded it, you have agreed to the license, have you not?

    • I don't think it works like that. I can't just write "By reading this comment, you have agreed to pay me $100." and expect that to be legally enforceable unless you explicitly agreed to a contract to that effect in advance before reading the comment.

      I could write "If you don't agree to pay me $100, I reserve the right to block your future access to my comments." (Which is what a ToS is.) But that's not a license agreement.

      1 reply →

  • TOS has nothing to do with copyright. A TOS can prevent scraping, training, or any other activity that is not covered by copyright. Public web scraping is subject only to copyright because no TOS has been agreed to, but what Meta is doing here applies to scraping things that are not available on the public web.

  • > but this looks like Meta lawyers trying to shield themselves against partners' suing them

    it's less about getting sued and more about not being blocked from being able to scrape.

  • Even if you don't actually need a license, I would assume that making it an explicit term of the contract makes the dispute shorter.

  • Not really. Consent has always been required. If a web server happily serves you up news content then you've been given clear consent to use it. Yes means yes. However, a site reserves the right to say no to whomever it pleases. News sites especially often don't happily serve up their content. Often you need to pay for access, for example. Hacking into their systems to retrieve content that wasn't normally happily given to you is clearly against the law. These terms gives Meta access to all content that is accessible to Meta users, seeing publishers agree to not say no to Meta.

I do not want to be cynical, yet my reading is that they are most likely doing it already. This is to provide a legal cover to it.

That's a bold move. I imagine a lot of businesses will leave Meta over this. And if their gamble pays off, and businesses can't afford not to advertise on Meta platforms, then there is probably a good antitrust case for them abusing their oligopoly power.

  • There have been many many reasons for businesses to leave Meta over the past decade, and almost none of them have

  • Doubt it. Most are already being scraped by meta and do nothing about it because they lack the technical competency to even notice it.

What happens when I put a Terms of Service on my website (esp. with a firm click-wrap) which says Meta agrees to not scrape my website--notwithstanding any prior agreement--and will owe me a billion dollars in damages if they do?

  • You should do it, so we find out.

    (But my guess is that such Terms of Services are not considered accepted only by visiting or crawling the website. There probably need to be at least a clock through performed by an human)

    • How about if you put that notice on the website, but also write it out explicitly and post it via registered mail to the Meta lawyers. Explicitly state that the content on your site is not licenced to be scraped for free and any usage must be paid for (eg $10/GET with penalties for non-payment), and that any usage of the site by Meta or their agents is an indication that they accept the terms fully.

      Then check your logs and start sending appropriate invoices.

      Then after 1yr of unpaid invoices: <profit>

      1 reply →

    • Hey, if they can bypass a ToS agreement with a bot that clicks for them, so can I!

      Well, assuming, y'know, justice under the law and such.

  • If Meta clicks on the checkbox and agrees to the TOS then it is binding on them just like any other contract. If they don't, then it isn't.

When you sign trade deals with US, you're essentially enslaving yourselves to them. What Meta is asking is essentially that. The former is usually done covertly; the latter is done overtly. That's all. Nothing new here. Classic US way of doing business.

If you're not OK with the terms, you think you can walk away, right? R i g h t?

I don’t use Facebook much but the last time I logged in I was surprised to discover that I am now a business and can’t change it back.

In Meta's defense, I don't think you actually need a business' consent to scrape their website.

  • No, but you do in order to rebroadcast some content they created themselves. If they obtain this consent from a business, then that business cannot find some piece of their copyrighted stuff in Meta's AI output and launch a copyright complaint.

  • You don't need their consent, but they don't suffer if they block you. Now Meta is saying they would be breaking their TOS.

  • Do business accounts on FB provide user activity data, such as checkout completion, user acquisition funnels, or other useful labeling of web behavior?

    Because the scrapes become more interesting once combined with such information.

    • You have to set up a Meta Pixel and include it into all your webpages for that. Then these events become visible in the Meta Events Manager.

  • No but they’re covering themselves as they’re also making fake accounts to bypass login walls. Probably to avoid a similar nitter issue.

I assume this is because of Muse? A lot of businesses block bots which stops Muse from being able to buy from those websites on a user's behalf. It seems like that'd be good for the businesses too.

  • This makes the most sense. Meta can guarantee at least that cohort of sites will permit their agents to operate, and all they needed to do was publish a tos update. Some Meta PM is smiling today, in between bites of infant flesh.

  • iirc when I was dealing with reviewing traffic and AI scraping bots recently, I noticed something about Meta's: When a user links to a page, the bots that grab oembed data to generate the link preview are using the same User Agent string as the Meta AI crawlers that scrape content.

    For context, oembed data about your page could be seen as information you're basically happy to share, so other sites can create things like previews.

    That's not necessary, there are other companies that just use different UA strings for the different tasks. They appear to deliberately make it so that if you have nothing to do with Meta and block their content scrapers, you also break basic functionality for people who happen to share a link to your site in their products.

So basically, thanks for building our business side of Facebook for all those years, we are changing the rules of the game now in so if you want to continue using our service, we get to use all of your website's data however we like in perpetuity.

There isn't even a veil of "customer satisfaction is important" anymore.

That's terror. Terror built into the system.

  • This is not a healthy way to think. Meta strong-arming news websites is not the beginning of the end. Get off the internet and try to enjoy your life.

  • I really hoped Deus Ex would become less relevant to real-world problems as the years went on, but here we are...

    > "[T]hey'll give people some freedom, but essentially it will be 20th-century capitalism: a corporate elite protected by laws and tax-codes."

This company is poison. You have built a few things people liked, bought some other things people really liked, and then used that good will to completely screw over the entire internet.

I know why you haven’t quit yet, but you probably should right? You’ve got your vested shares and you’re comfortable. Why are you still doing this to us?

  • One could argue that if you hate these megacorps then the best thing you can do (as an engineer)is to work for them and purposefully be a monkey wrench in the cogs. Be competent enough to not get fired, maximize the company resources you take up while minimizing your output. Delay delay delay and if you're really good at it, never deliver. Take as much of their time and money as possible and give as little back. Thats basically what they're doing to the rest of us. And when its gets too evil you can always leave. In the meantime you are taking up headcount that could have actually advanced their goals further, faster, evil-er.

    • Maybe? But I don’t think most folks working for these companies are trying to get hired as insurgents employing the CIA handbook. Slowing down Facebook resource-wise as an engineer would only expedite the rent-seeking behavior. This also assumes manager incompetence and not getting fired - which I’d buy for a few months but years would require some spy-level dedication.

The article doesn't mention the geographical scope of these new terms, but I suspect those are illegal in Europe, right?

This is super weird, to say the least. Through dark patterns, publishers rarely get a choice. But making it so explicit and in-your-face is the next level of Meta's dictatorship.

As a business owner who has meta accounts and even advertises on meta, I have long since blocked their crawler traffic. They try to hide their scraper traffic dishonestly behind user agents that purport to be Facebook users browsing the web via their Facebook browser, the thing is, I know it’s a lie because there is absolutely no reason for 1000s of Facebook users from Ireland to want to know anything about a small local business in Canada, that only services local clients within 50km radius due to the nature of the business. So I know it’s a lie, therefore was blocked. And guess what, fuck your terms of service the blocks are staying in place.

  • I have never, I hope I'm not living under a rock, heard this from Google. Not with Gemini and not in the pre-LLM days where they were indexing the web

    Facebook is run by a criminal known for such lovely things as 'if you need info on anyone at Harvard just ask, they 'trust me', dumb fucks', 'I'm going to fuck them [Winklevoss twins] probably in the ear' 'you can be unethical and legal and that's how I live my life haha' and that's just at Harvard never mind all the other things he's done since

    • Google had "Don't be evil" in their agenda and removed it when they officially went evil.

No matter what the terms of service are scraping is happening actively already.. I know website having over 11k monthly vistis with under 100 being genuine clicks

I fail to understand how is this different to a google web crawler in practice other than ignoring the robots.txt?

They don’t want to be behind Google and Bing which all these businesses already let index.

I am not a lawyer, but I can't see how any court would enforce this unconscionable term in a clickwrap license.

  • It's really a miracle that any judicial system considers "clicking accept without reading" to be a valid form of binding contract in the first place.

    • And that they let businesses change the license at any time, with just an email notification, and the only way to opt out of the new terms is to stop using the service.

      6 replies →

    • In Canada at least it currently has the same level of legal binding as signing a paper contract with a pen.

  • This is an agreement between two businesses, not a clickwrap license being forced upon consumers. Businesses have plenty of alternatives to Meta; they can just close their accounts if they don't like the terms.

  • Is it illegal to scrape websites? Idk, feels like consenting to being filmed in public, it's already legal.

    • I don't know about the USA, but it seems that generally filming in public where you catch sight of passerbys and filming a specific person in public spaces are wildly different things.

      If I stand outside your house and follow you all day recording your every moment in a public space, is that legal or has that turned into harassment? Certainly in many countries, filming an incidental person may be legal but filming them in detail and from every angle is not (eg upskirting)

      1 reply →

Ok fine. So will it stop crawling my websites so extensively? I never had a business account

how is this legal btw ????? to use Meta platform you must agree that your content is being used to train AI ???? for free ?????

oh man, ready for a farm of fake accounts on the Internet to scrape content! The Internet is broken!

Can we ban Meta and the rest of Usanian BigTech already? Or at lease regulate / break them down? Dis is beyond rediculous... even Russia doesn't have such elaborate oligarchs =,=

HN title now matches article. Previously:

  Business accounts will consent to Meta scraping their websites Starting Oct. 30

Scraping is easy. The hard part is that the page can change after you scraped it, and there's no way to prove what it said before.

The test credentials thing, to bypass publisher paywalls with fake accounts, is pretty smart

IANAL and I know I'm a minority opinion, but: seems to me that scraping must be legal. If you put content online, it is readable by anyone (or anything) who cares to look. Don't want it read, put it behind a login or a paywall.

Well - don't outsource your company to Suckerberg's evil empire.

Oddly enough, many don't seem to want to have a company homepage, in particular smaller companies.