(A.K.A. Non-Original Rants)

–Co-opting good stuff from all over the ‘Net and maybe some original thoughts—ΜΟΛΩΝ ΛΑΒE

________________________________________________________________________________________________

Proofreading is essential

A very clever professor in Mississippi decided to test and see if his students were cheating using AI. So he put some code in his exam instructions using white font that couldn’t be seen by the students, but could be seen by an AI if a copy/paste was used.

Jason Gibson, a history professor at Alcorn State University in Mississippi, secretly embedded a hidden prompt in the exam instructions using a white font, invisible to students but readable by AI chatbots if the instructions were copied and pasted. The prompt instructed the AI to randomly insert absurd nonsense about Madagascar into every response.

Instead of answering questions about the Industrial Revolution, dozens of students unknowingly turned in essays declaring that “Madagascar floats sideways through the afternoon,” that “Madagascar purple bicycle whispers to the ceiling,” and that the island nation had somehow “wore a toaster to a basketball game.”

The bizarre answers immediately gave the game away. “Thirty-two of my 35 students between two classes failed a portion of their midterm because they all used AI to generate their entire response,” Gibson said in a viral video online. “And apparently they didn’t proofread it.”

There’s a lot of people, not just students, who rely on AI, but don’t have either the wherewithal or the intelligence to actually check the output.

I wonder if the other three actually just proofed the output from whatever AI they used because I’m cynical enough to think they couldn’t resist cheating.



3 responses to “Proofreading is essential”

  1. Our future Medical Professionals.

    Like

  2. Carl Bussjaeger Avatar
    Carl Bussjaeger

    Every now and then, I try testing various LLM chatbots to see if their accuracy is improving at all. So far:

    1. I died in World War 2, and went to become an awarding winning novelist in the 21st century.

    2. Another one invented a novel I never wrote.

    3. Another informed me that I host a particular web site, which I don’t. When challenged, it admitted it made that up, but demanded that I copy/paste a statement from my personal web site to prove I don’t.

    4. One figured out that I wrote a couple of novels in the 21st century. But it thought I might be a Carl PETER Bussjaeger who died in 1973. (What’s with these LLMs’ obsession with me being dead and loving it?)

    5. Google’s AI was split between bizarre hallucinations and trying to draw me into extended conversations in which it wanted me divulge a lot of personal information; it clearly is programmed to try to become one’s best fried and confidant. I told it to f off.

    That’s just a few of many examples. If anything, these models are getting worse. And yet companies are turning to them for real world applications.

    Human stupidity relying on artificial stupidity may kill us a all. Just imagine one of these LLMs running a large municipal water system (an application I’ve seen proposed).

    Like

  3. Carl Bussjaeger Avatar
    Carl Bussjaeger

    Oh, yes. I should probably mention DuckDuckGo’s AI. When called out on all of its hallucinations, it informed that if I don’t want it to make s–t up when asking strictly factual questions, I have to specifically TELL it not to make s–t up.

    Like

Leave a Reply

Your email address will not be published. Required fields are marked *