Post by @bennomatic@appdot.net

So I know that there are mixed feelings about AI on this platform, for all sorts of good reasons, and I have varying levels of agreement about every single element of the arguments against the use of that technology.

One of the biggest arguments is the amount of energy the big LLMs use, and so one of the ways I try to add AI-appropriate features is to leverage the onboard LLM that anyone with an iPhone 15 pro or later is carrying around in their pocket, rather than going to the cloud.

1/2

0 Boosts

0 Likes

Ben O’Matic

@bennomatic@appdot.net 1 hr. ago

I threw together a pretty simple app that I call "Biri" (i.e. Ben's Siri), which basically takes a prompt, asks the onboard LLM for a response, and if it doesn't have enough info, it does up to three web searches, and uses the top response from each to try to satisfy the answer.

So it's still hitting the cloud for info, but all the LLM-ish stuff is onboard.

It's mostly just a simple proof of concept, but it's actually kind of neat sometimes.

2/3

Ben O’Matic

@bennomatic@appdot.net 1 hr. ago

In parallel, I'm working on a battle-royale-in-space game, and I was thinking about having a squadron leader give a motivational speech ahead of each mission, so I asked Biri the following:

3/4

The prompt:

You are a commander in the space force giving a motivational message to a pilot who is tasked with defending the airspace above new york city from extraterrestrial attack ships from planet Q-Bert. What is your message to them about their mission and its goals? — The prompt: You are a commander in the space force giving a motivational message to a pilot who is tasked with defending the airspace above new york city from extraterrestrial attack ships from planet Q-Bert. What is your message to them about their mission and its goals?

Ben O’Matic

@bennomatic@appdot.net 1 hr. ago

And here's the response. I mean, not amazing, but pretty good for something that lives on my phone.

Honestly, "We don't always see the fight, but we're there to hold the line" ain't bad, and it doesn't appear to be directly stolen from any speech... I can't find the quote on Google, at least.

4/4 FIN

Biri's response:

Listen up, pilot—this mission matters.
You're defending the airspace above
New York City, a place of immense
cultural and economic weight, but your
role is about protecting what's unseen:
our nation’s interests in, from, and to
space [3]. The goal isn't just to respond
—it's to ensure our joint and coalition
forces have the advantage through
global space operations [3].You're part
of a force built to strengthen combat
power, not just as astronauts in
spaceships, but across space,
cyberspace, and beyond—our reach is
global [3]. The Chief of Space
Operations has made clear: we must
organize, train, and equip Guardians to
meet evolving threats, including
extraterrestrial ones from Q-Bert [2].This
is about all-domain advantage—keeping
the line between threat and security
tight. We don't always see the fight, but
we're there to hold the line [3].[1], [2],
[3], [4] — Biri's response: Listen up, pilot—this mission matters. You're defending the airspace above New York City, a place of immense cultural and economic weight, but your role is about protecting what's unseen: our nation’s interests in, from, and to space [3]. The goal isn't just to respond —it's to ensure our joint and coalition forces have the advantage through global space operations [3].You're part of a force built to strengthen combat power, not just as astronauts in spaceships, but across space, cyberspace, and beyond—our reach is global [3]. The Chief of Space Operations has made clear: we must organize, train, and equip Guardians to meet evolving threats, including extraterrestrial ones from Q-Bert [2].This is about all-domain advantage—keeping the line between threat and security tight. We don't always see the fight, but we're there to hold the line [3].[1], [2], [3], [4]

frigginGlorious ✅

@frigginglorious@freeradical.zone 10 min. ago

@bennomatic this is fuckin rad. Keep giving updates on Biri, plz!

Discussion

Discussion