LLM question: is the result deterministic with the same model and prompt?
I guess this also assumes they haven't changed any of the system prompts between prompts. There is probably no way of knowing that, is there?
0 Boosts
0 Likes
@jaranta I'm pretty sure the answer is no. It's not a case of always picking the highest scoring token, but some kind of random selection from high scoring tokens. But my knowledge dates from 2023ish, so take it with a pinch of salt.