I think a misaligned AI is vastly more dangerous than a bad actor. Bad actors are statistically much rarer than regular users, so it really comes down to scale. Let's say we have a misaligned AI, and it naturally does bad acts. That means nearly every regular user can become a bad actor via the AI's actions. But if the AI is aligned and the bad actor just jailbreaks it, sure that's bad, but not nearly on the scale of a misaligned AI.
100%. The idea of AI alignment is an oxymoron honestly. Humans are not aligned with each other, so how exactly do we align it to something that doesn't exist?
Its like being given the task of "choosing the universally agreed best colour of the rainbow" kinda misses the whole point of a rainbow. Same with AI the whole point is that its probabilistic not deterministic.
I think a misaligned AI is vastly more dangerous than a bad actor. Bad actors are statistically much rarer than regular users, so it really comes down to scale. Let's say we have a misaligned AI, and it naturally does bad acts. That means nearly every regular user can become a bad actor via the AI's actions. But if the AI is aligned and the bad actor just jailbreaks it, sure that's bad, but not nearly on the scale of a misaligned AI.
No one can guarantee an AI won't hallucinate. The real danger is how overconfident they get. Bad actors would wait for AGI
100%. The idea of AI alignment is an oxymoron honestly. Humans are not aligned with each other, so how exactly do we align it to something that doesn't exist?
Its like being given the task of "choosing the universally agreed best colour of the rainbow" kinda misses the whole point of a rainbow. Same with AI the whole point is that its probabilistic not deterministic.