Basically the point at which I went from "GenAI is a technology with negative effects, it should be resisted" to "delete the models, delete the software that runs the models, destroy all digital or physical artifacts ever made using the models" was when someone posted on here showing there's a command line tool in new MacOS that drops you into a chat prompt with the "Apple Intelligence" model, and in the screenshot they asked it who invented Hypercard and it said "Steve Jobs"
@mcc Sounds like someone trying to describe George Lucas with the John Company meme.
@scottmichaud @mcc I think you confuse him with the real founder of Mastodon, John Mastodon.
@gins @scottmichaud @mcc you know John Mastodon too!?!
@scottmichaud The name sounds somewhat similar, in a way that might ??? be possible to get from the fragment-pasting thing transformers do, to the CEO of Apple who started in September 2026
@scottmichaud John Small Berries? John Whorfin? John YaYa?
@503bartley One funny example is Mini, because the product was named after him, not the company.
@mcc is it possible that the computer was reading about Atkinson's acid trip when he designed it and went on its own trip? 🤔
@mcc tl;dr: significant decision based on someone on social media who posted a cropped screenshot.
Is that where human - uh - neo-luddite "intelligence" arrived now? 🤦 🤡
@mcc that tool only uses the local only model with very few parameters and a tiny context window. I wouldn’t consider that representative of AI at all.
@collin If it's not appropriate to use the tool for the purpose, then why expose a frontend to use the tool for the purpose?
I'm not really interested in the best-case or even median performance of an LLM. I'm interested in the harm done. A lot of the harm comes from shoving LLMs into things indifferently. Some tools may be more likely to supply answers to some queries. But they're all lying just as confidently, so an LLM user doesn't know if they're using a likely-right or likely-wrong model.
@mcc I just think saying we should throw out all AI tools and everything made with them because a command-line tool you have to use sudo to run the first time is kind of crappy at some things is a bit extreme. It works really well for things like the proofreading function to fix grammar mistakes. My impression is that it’s exposed in case you have a shell script that’s a good fit or its limited capabilities.
@mcc Apple is often willing to have developer tools be a little rougher in places because the people using them are savvy enough to grasp the limitations and how to get something out of it is my impression.
@collin@ruby.social @mcc@mastodon.social
Even better question, what is the appropriate use? Every time someone criticizes LLMs for being confabulation machines, someone says that XYZ usage is just you using them wrong. Ok, then what is the correct use? Why is it that defenders can't answer that?
@mcc @davepolaschek if you ask the more capable models meant for this kind of knowledge based question, it answers correctly.
@mcc once again reminded of how the Juicero shithead actually seemed to think that Steve Jobs invented the personal computer
@mcc
Feck, you're right. Burn it.
RE: https://mastodon.online/@dale_price/113251999711212082
@mcc Xcode’s LLM autocomplete used to suggest “Adolf Hitler”, “Leonardo da Vinci”, and “Steve Jobs” as an array of famous designers.
To those suggesting that using these models outside of their original intended purpose is the real mistake here, I would ask why Hitler (or da Vinci or Jobs, for that matter) was included in the training materials for a coding autocomplete model
@dale_price @mcc Their indented purpose is "for entertainment use only".
@ahltorp I like entertainment too much for that.
Ohhh yeah that's fighting words.
@mcc There was a time when we joked that the Internet was the largest pool of unvetted (and unreliable) facts. It wasn't that long ago. And that's the data the #broligarchy chose to train their "AI" models with. So it's no surprise that this monster creation hallucinates almost constantly; its core data is utter crap.
And then the user asked the question a slightly different way, as if to prod it into giving a different answer, and it replied "Steve Jobs and John Lucas" (I still as of now am sincerely not sure who John Lucas is, all I know is that he is not Bill Atkinson)
EDIT: I'm sorry, I looked up the post and I had it backward, it *first* claimed Hypercard was invented by Steve Jobs and John Lucas and then when pressed credited it to Steve Jobs alone