froztbyte

eek

lol, yeah

"perverse incentives rule everything around me" is a big thing (observable) in "startup"[0] world because everything[1] is about speed/iteration. for example: why bother spending a few weeks working out a way to generate better training data for a niche kind of puzzle test if you can just code in "personality" and make the autoplag casinobot go "hah, I saw a puzzle almost like this just last week, let's see if the same solution works...."

i.e. when faced with a choice of hard vs quick, cynically I'll guess the latter in almost all cases. there are occasional exceptions, but none of the promptfondlers and modelfarmers are in that set imo

[0] - look, we may wish to argue about what having billions in vc funding categorizes a business as. but apparently "immature shitderpery" is still squarely "startup"

[1] - in the bayfucker playbook. I disagree.

(excuse possible incoherence it’s 01:20 and I’m entirely in filmbrain (I’ll revise/edit/answer questions in morning))

re (1): while that is a possibility, keep in mind that all this shit also operates/exists in a metrics-as-targets obsessed space. they might not present end user with hit% but the number exists, and I have no reason to believe that isn’t being tracked. combine that with social effects (public humiliation of their Shiny New Model, monitoring usage in public, etc etc) - that’s where my thesis of directed prompt-improvement is grounded

re (2): while they could do something like that (synthetic derivation, etc), I dunno if that’d be happening for this. this is outright a guess on my part, a reach based on character based on what I’ve seen from some the field, but just…..I don’t think they’d try that hard. I think they might try some limited form of it, but only so much as can be backed up in relatively little time and thought. “only as far as you can stretch 3 sprints” type long

(the other big input in my guesstimation re (2) is an awareness of the fucked interplay of incentives and glorycoders and startup culture)

I would be 0% surprised to learn that the modelfarmers "iterated" to "hmm, people are doing a lot of logic tests, let's handle those better" and that that's what gets here

(I have no evidence for this, but to me it seems a completely obvious/evident way for them to try keep the party going)

fuck off

kiiiiiiind of a pretty weird post to be making with a thread necro-reply tbh

thought up a new simile for agi noises:

all the “super-intelligent agi” stuff is them rattling a sheet of metal and calling it thunder

this has been happening for a while, just getting coverage again now. first coverage was months ago. morphed/evolved pretty quickly out of the typosquatting shit

((a lot of people in the) security space absolutely fucking loves "giving names" to things that have been (known to be) happening before, and acting like suddenly they're the ones who first saw the thing. see this nonsense for another good example of that happening)

for the same reasons as this, not really a thing I'd post, even in jest

the existence of these callcenters (often in india, but hardly only there - much of africa is beset by the same problem) is an outright fucking feature of the years-long capitalist market optimisation hell-loop. and as annoying as their "output" (for lack of a better word) may be in one's daily life, at the end of the day it's still a bunch of people at the bottom rung getting fucked

(e: I mention "callcenters" but "AI support centers"/"data review"/"remote shoppers"/.... - it's all the same fucking exploitation-offshoring dynamic)

+1! and there's so many better options anyway!

right off the top of my head (in addition to inside/instead): incognito, insecurely

not true! if I want to be really fucking angry, pgp is a great solution to getting that done quickly!