On the day of Anthropic's IPO a group of people gathered to protest at their offices.
These people are concerned that Anthropic is implementing "recursive self improvement" recklessly.
And, I'm annoyed at them.
Since most people don't pay much attention to the details of technical news about software... their complaint blends in with those who think LLMs are being implemented recklessly for less exotic reasons.
It almost feels like deliberate misinformation designed to muddle the debate.
But looking into it? I think some of the people who fear "recursive self improvement" are sincere. I just can't understand how they could fixate on the one kind of harm this new software hasn't demonstrated an ability to do.
What about the people who have been harmed psychologically by chatbots? The financial malpractice? The buggy software? The ruined internet?
Why can we focus on concrete harm and not... this fantasy.
Listen.