• jj4211@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      11 minutes ago

      This is a critical thing for AI proof points, they work best when the outcome can be objectively verified and failures feed back in for retry, putting into the context window guidance that disqualifies the statistical path it would have chosen.

      A human is so much more likely to get it right the first try, if they can get it right at all.

      This has some utility, closest to practical in some cases of programming, though people can be bad at judging when that can be practical.

      The other useful scenario is when being wrong is still “good enough” a lot of the time, like creating specific instructions for a human out of broader documentation. Yeah it’s wrong a fair amount, but close enough that a human can compensate.