5 Comments
User's avatar
SDN's avatar

“"Show me the reasoning behind this determination" goes from unanswerable to a database query.”

The problem, and we’ve already seen it demonstrated, is that the person typing the query has no control of the query that actually runs. It’s a trivial exercise to set a flag on the data that says “unless the person running the query has this access, don’t even show the data exists.” It’s also a standard database feature called “query rewrite” where the query is transformed for any number of reasons.

Not “there are records you can’t see”, but “no record exists”. The FBI used it systematically over RussiaGate. So there are already controls over who can see the data.

MM's avatar

Making citing the rule cheap requires it to be reliable. We've seen cases where it wasn't.

I wonder if those cases were so public at least partly to slow down adopting AI. "It's unreliable".

Though I've seen AI hallucinations in my own work (software). Hallucinatory precedents is entirely believable.

Lindee's avatar

What bothers me most about reading AI-generated text is that it asks more time and energy of the reader than the writer. Even AI "layered over" a text, as you suggest-- in another one of the seven posts from you in my email inbox today-- as a means of changing our relationship to language, is less human-readable, as it was not human-written. I am interested in your ideas, which is why I subscribed in the first place, but I cannot continue to read these posts, as for me personally the artificial prose is unbearable.

HBD's avatar

Do I understand correctly that you believe this stack’s articles to be AI generated?