Post by @lritter@mastodon.gamedev.place

@lritter@mastodon.gamedev.place 3 hr. ago

qwen 3.6 struggling against its alien hand syndrome

(all qwens have this, the new ones too)

> Let me add a call_counter to track state:

*adds an empty line*

> That just added an empty line. Let me add the counter:

*adds another empty line*

> I keep getting empty lines. Let me just insert a proper line:

*removes the two empty lines* — > Let me add a call_counter to track state: *adds an empty line* > That just added an empty line. Let me add the counter: *adds another empty line* > I keep getting empty lines. Let me just insert a proper line: *removes the two empty lines*

0 Boosts

0 Likes

This federated comment is not yet available here.

@lritter@mastodon.gamedev.place 2 hr. ago

@artificialmind ah. i have 64GB + RTX 3060 12GB and i run a IQ3 quantized Qwen 3.8 Flash Next (the preview of Qwen 4, coming soon) through Niko1221/Strata. i get 30 tps down, 500 tps up. this model is good enough to implement entire compilers.

qwen 3.6 runs on the 32GB UMA laptop with an 860M iGPU. with gemma 4 the only other competent enough model that runs at endurable speeds

Anders Stenberg

@SonnyBonds@mastodon.gamedev.place 1 hr. ago

@lritter @artificialmind Strata is so weird. I have 128GB RAM so that’s pretty beefy, but only 8GB VRAM and I can run QFN at 40 TPS with 200k context and still use my computer at the same time with noticeable but not horrible slowdown. I don’t think I’ve run any other model (apart from really small really bad ones) that fast and QFN is the best one I’ve tried.