Post by @lain@fediffusion.art

https://rikiyat.github.io/blog/weight-space-programming/

Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights

We find that frontier LLMs are surprisingly good at natively reading and writing neural network weights, well past what we’d expect from humans or conventional algorithms.

0 Boosts

1 Like

also lnkr

@lnkr@staging3.plamenu.com 3 hr. ago

@lain just finished reading this and it's kinda nuts. Emergent capabilities my ass, how in the hell would it learn to do that? I wonder if they extensively trained the thing on the, what, binaries of the other weights? jamming it straight through the text tokenizer?