Opus is already quite capable of zero-day exploits, and so it was inevitable that the next generation of LLMs would be eating them for breakfast.
This is a defensive move because Anthropic was first across the line. As soon as hostile states gain access to this tech, there will be a veritable tsunami of pwnings across the globe, as everyone wielding such power battles for the compute power and allegiance of every processing device on the planet.
It'll be a race of exploit, secret patch, exploit, secret patch as these AIs battle each other, with territory marked by the machines under their control.
And you, Joe Average, won't even see it happening, because your computers and phones and cars and TVs will tell you everything's fine while they do battle in secret.
I’ve been thinking that we’ll end up with specialized language models for different tasks, all connected by a router that picks the best one for each job. Put together, that could feel like a “super LLM”, not true AGI, but close enough that it might seem like it to most people. Because of that, I don’t think Mythos is a bluff.
I don’t think LLMs will ever be truly sentient, but they’ll likely appear that way. It won’t be real AGI, just something more powerful than any single human. Think of it as the oracle at Delphi. I'm not shocked that there's a better model coming. I'm sure there will be more powerful models to come after it too.
I made the comment to a friend that (1) OpenAI said the same thing years ago about GPT-2 (2) this is more than one company (3) my conspiratorial side can't help but think this is an effort towards regulatory capture and market with cartels (4) what will we see out of China do on this front in the next few years
Above all else, I believe in the right to compute, like I do the right to repair. Flipper Zero exists, and while it is sold in a mode that helps you from breaking the law, you can unlock it as well.
Back on the Ai front, (1) this tool can also be used to red-team and improve software security (2) we have laws and punishment for those who break them (3) the bio/chem implications are intriguing and we have similar two-sided takes on this, while also having a much higher bar to actualizing IRL (4) would be bomb makers have been caught beforehand based on the purchases they make
It's not.
Opus is already quite capable of zero-day exploits, and so it was inevitable that the next generation of LLMs would be eating them for breakfast.
This is a defensive move because Anthropic was first across the line. As soon as hostile states gain access to this tech, there will be a veritable tsunami of pwnings across the globe, as everyone wielding such power battles for the compute power and allegiance of every processing device on the planet.
It'll be a race of exploit, secret patch, exploit, secret patch as these AIs battle each other, with territory marked by the machines under their control.
And you, Joe Average, won't even see it happening, because your computers and phones and cars and TVs will tell you everything's fine while they do battle in secret.
I’ve been thinking that we’ll end up with specialized language models for different tasks, all connected by a router that picks the best one for each job. Put together, that could feel like a “super LLM”, not true AGI, but close enough that it might seem like it to most people. Because of that, I don’t think Mythos is a bluff.
I don’t think LLMs will ever be truly sentient, but they’ll likely appear that way. It won’t be real AGI, just something more powerful than any single human. Think of it as the oracle at Delphi. I'm not shocked that there's a better model coming. I'm sure there will be more powerful models to come after it too.
I made the comment to a friend that (1) OpenAI said the same thing years ago about GPT-2 (2) this is more than one company (3) my conspiratorial side can't help but think this is an effort towards regulatory capture and market with cartels (4) what will we see out of China do on this front in the next few years
Above all else, I believe in the right to compute, like I do the right to repair. Flipper Zero exists, and while it is sold in a mode that helps you from breaking the law, you can unlock it as well.
Back on the Ai front, (1) this tool can also be used to red-team and improve software security (2) we have laws and punishment for those who break them (3) the bio/chem implications are intriguing and we have similar two-sided takes on this, while also having a much higher bar to actualizing IRL (4) would be bomb makers have been caught beforehand based on the purchases they make