Anthropic takes steps to block Claude from reverse-engineering video games

6 hours ago (mashable.com)

If they didn't want us to use other people's ideas without permission then why did they use other people's ideas without permission to make the ideal tool for using other people's ideas with permission?

  • I don’t think it’s about what Anthropic does or doesn’t want us to use their tools for. They are in the business of selling compute via AI, the more people that use it the better.

    This is about stopping future issues (real or perceived) that could lead to legislation curtailing usage of their tools.

These guys are no fun at all.

Is this really the same cowboys that recklessly broke into others networks and instead of apologising proudly told the world how they did it?

Every 6 months Anthropic publishes a report telling us how closer they have gotten us to extinction as if human life was just a game, yet now they draw the line at computer game modding??

  • And stole every bit of Intellectual Property they could get their hands on legally or otherwise.

Is this.. The right approach? Who decides what gets to be reverse engineered and what doesn't? I don't have a solution to offer, but I bristle at the idea of one indistry deciding which other industries suffer the negative externalities of their product, while others they decide are spared.

  • > Who decides what gets to be reverse engineered and what doesn't?

    whoever owns the hardware

    currently running 2x DGX Sparks and never thought to use a commercial model again

    • Curious about your setup if you don’t mind elaborating a bit for us? What models are you using and how do you find they compare? The 128gb model costs less than one months salary for a medium level engineer here, they look quite attractive.

      2 replies →

    • > whoever owns the hardware

      Yes and this is why self-hosting is more important than ever. The issue with LLMs is the cost of hardware if you want something close to the frontier. But there is no excuse not to host your own files, email, media center, etc.

      3 replies →

  • I can see your point, but on the other hand it seems like the only alternatives are a blanket ban on reverse engineering or a blanket allowance. I probably don't have to make the case for the value of reverse engineering here, so the question is to what degree it can be abused and if they have the responsibility to stop it. I would argue companies do have an obligation to consider and mitigate abuse of their product, especially frontier technologies. Probably the best outcome will be some kind of balance of judgment by the company.

    • A blanked allowance would be the answer. Claude is just a tool, after all. Neither Ghidra nor IDA tells me what I'm allowed to decompile and what I'm not. If someone then uses it to create something whose distribution would constitute a copyright infringement, that is the responsibility of the person who did so, not the software manufacturer.

      1 reply →

    • Looks like we need to ban paper. Paper can be used to reproduce copyrighted material.

      Even without a computer, you could use a pencil and a notebook to write down some song lyrics without express written consent of Universal Music Group!

  • It's the wrong approach, because the public demand to reverse engineer games (a pretty benign activity, for humans at least not corporations) is massive and a new subset of hackers who will release public jailbreaks that could be used for hacking which is more of a grey area

  • Ultimately, the person offering the service gets to decide what the service is.

    If I want to make a knitting forum, im not going to feel bad about deleting posts about reverse engineering video games.

  • This about the risk of getting sued by parties with deep pockets. Antrophic is close to an IPO so that is definitely not the kind of attention they want.

    • > This about the risk of getting sued by parties with deep pockets.

      They are also probably intentionally trying to create differentiation between their models and open models to strengthen the regulatory capture case of having the government ban open model use.

  • > Who decides what gets to be reverse engineered and what doesn't?

    The service provider decides the terms and conditions, as long as they comply with the law. For example, Google decides whether pirated movies can be hosted on its cloud service, because it provides the cloud service. It's pretty clear.

    In a pure capitalist system, competitors would emerge if the repressed service were genuinely in high demand and lawful. If it was not, then well, that's just how we regulate the world but this cannot be considered a case of one industry deciding the fate of another.

They really didn’t though. They put it in a client side modification to the system prompt. You can just rip it out with a proxy or a small local modification to your client, which Claude will be happy to do for you. They took a token step so that people would write these headlines in the hope it would stave off more negative attention in the video game world without actually doing anything meaningful.

  • You’re literally describing how they did set up a block, while also saying they didn’t

    • If they tried to stop terrorists from making biological weapons in the same manner, the headlines would call that useless and ineffective because you're trying to stop already bad actors with something ineffective and trivially bypassed. This is no different, and shouldn't be treated any differently.

    • They're literally describing how it's not actually a block just a minor inconvenience

      A block would be a bit harder to circumvent

Game REs & crackers are probably the most persistent personality types you can find in software world. They are also one of the most technically sophisticated software engineers around. I expect we will see a new AI system pop-up soon, made by RE, specifically trained to RE games/software, thanks to this ban. Pandora box is open.

The things that normal people will want to use AI for (game mods) will be made illegal or a ToS violation until the only thing allowed is to consume veiled advertisements.

Behind closed doors the elite will use the tech for (biological) weapons and reverse engineering though. Military applications, OK but don’t you dare put Sonic in Super Mario.

i ported the whole DungeonMaster 2 to .net. 90% with the first few 20 prompts, then quite some many to make it perfect. Just from the executables from those DosBox sites. Amazing.

Very sad. I'm about 50% in taking the old Red Alert 2 and get to something that would've resembled the original source code.

Given the rumors that the source code has been lost (and the fact that they open sourced the games before Tiberian Sun & Red Alert 2, and the ones after those), I felt like I was using the tokens for 'good'.

We'll see when it actually stops.

I am busy working on an embarrassingly ambitious game reverse engineering project. (To the point where admitting what it is feels like telling someone you’re working on a perpetual motion machine).

It’s a new tool to reverse engineer games in a specific context, and I’ve been using anthropic models to work on it.

I haven’t seen any increase in safeguards triggering or any negative effects in how quickly agents are able to make progress in this space.

To give an idea of scope it’s about 5000 commits, 500k lines of rust code, 100 Ghidra patches of work so far. Made in around 6 weeks worth of 8-15 agents working continuously.

They probably have reverse engineered the stuff for themselves and now closing the door behind them. That type of thing is quite common. For example MSFT copied some other operating system itself but theirs was holy. OpenAi used google's open source ai tools before openAi.

Fable of The Scorpion and the Frog should always apply .

I think that, excepting part of the HN crowd and linkedin, literally the only positive comments I've heard about AI have been related to game mods.

I'm saying this as a completely orthogonal conversation to regularisation, ethics, etc. It's just amazing to see how little value these companies place in the general public's perception of them.

Can you think of any other companies selling to the mass marker that care so little about it?

  • I think that they think, not necessarily incorrectly, that their tool is applicable across any and all domains, so restricting a few of these domains is small fry in the overall big picture.

    What they may be missing is that the domains in which it it's being used to great success is the pipeline to the expansion of is use into other domains.

    Having said that, the potential legal issues of being a reverse engineering tool is a strong legal motivator. But I also doubt that any legal issues as a result of reverse engineering could be fatal to either Anthropic or AI/LLM usage; the tool, being general purpose, will allow for the legal responsibility to be put upon the person using it, especially if it's decided that Anthropic and OpenAI are protected national security assets.

The most visible productivity gain I've seen from AI is in this kind of cool hoby RE stuff that just wasn't worth the time investment/resources before.

A very rational choice by Anthropic.

The cost of blocking videogame reverse engineering is trivial. They added three lines to the system prompt to exclude it and probably made a small update to their backend training classifiers. They give up the videogame reverse engineering market, which is a tiny future revenue stream and not worth much financially. In exchange they avoid hundreds of millions, maybe billions, in future copyright lawsuits.

Providing this service has negative expected value. It's better to cede the market to someone else.

  • > In exchange they avoid hundreds of millions, maybe billions, in future copyright lawsuits.

    Will the lawsuits not come from adobe? From big SaaS companies? From every other major piece of software any Joe will be able to duplicate with a single prompt in a few hours?

    This admission is showing that Anthropic believes they might get in hot water for reverse engineering video games. Surely it applies to everything else.

    • Video game reverse engineering is the biggest and most visible problem in the present moment, it's widely discussed in the media, and there are video game companies known to be very litigious against people who reverse engineering their products (ex: Nintendo). It makes sense to block the biggest problem first.

      If future lawsuits come from other industries, then they'll likely add a blanket ban on other forms of reverse engineering.

  • > They give up the videogame reverse engineering market, which is a tiny future revenue stream and not worth much financially

    Btw video games are by far the biggest entertainment industry in history.

    If the way video games of the future are made is with AI, the logic might be reversed; giving up some lawsuits now, while missing out on large entertainment revenue in the long term.

    • But that's not at all what Anthropic is doing. Anthropic is not blocking people from creating video games with AI. Using Claude to create new video games is completely valid and unrestricted; they just don't want people to use it for reverse engineering existing ones, as that opens them up to massive legal liability.

      2 replies →

It's not a surprise after so many IP violations recently that big guys will start blocking this stuff. But people who wants to reverse-engineer will just use Chinese or local models for that ¯\_(ツ)_/¯ I don't think it's going to help Anthropic / OpenAI with that fight, but this is something that have to do to make their investors happy

Why does anthropic feel the need to babysit every one of their users? its so disgusting. Look - i get bioterrorism, weapons, etc and why you may need guardrails on those, but RE' games? come on.

I wonder when someone will offer a truly uncensored model subscription. For some reason, it seems that nobody's been brave enough to find a country that wouldn't take them down for offering that service.

This is just prompt noise that any RE will be able to easily coax claude to ignore. It exists to get the big loserly game companies like Nintendo and Sony off their back.

Oh no little piglet, you’re not supposed to be eating at the dinner table with us. Your place is at the trough. Make sure you eat all your slop to grow up big and fat. Do that and I’m sure you’ll find yourself on the dinner table in no time.

First, they came for the people who wanted to make kinky art, and I did not speak out, for I am a Sports Illustrated Swimsuit Edition kinda dude...

Then, they came for the people who wanted to reverse-engineer video games, and I did not speak out, for I find no amusement in seeing Mario take down Elden Ring bosses...

Finally, they banned me for a politically incorrect/inconvenient prompt (like asking for help defending Luigi in a debate or something), and there was no one left to speak out for me.