• jj4211@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    14 minutes ago

    This is a critical thing for AI proof points, they work best when the outcome can be objectively verified and failures feed back in for retry, putting into the context window guidance that disqualifies the statistical path it would have chosen.

    A human is so much more likely to get it right the first try, if they can get it right at all.

    This has some utility, closest to practical in some cases of programming, though people can be bad at judging when that can be practical.

    The other useful scenario is when being wrong is still “good enough” a lot of the time, like creating specific instructions for a human out of broader documentation. Yeah it’s wrong a fair amount, but close enough that a human can compensate.