Two Home Affairs officials suspended after AI 'hallucinations' found
67 points by jruohonen 10 hours ago | 18 comments

rubenvanwyk 26 minutes ago
Nice seeing an article from SA here :) unfortunately, this surprises none of us.
reply
lgleason 5 hours ago
If this happened in the US or Europe it would be an interesting story. In South Africa, this is just par for the course and the quality of the work may not have been any better had it been written by the current people staffing home affairs.
reply
stroebs 2 hours ago
Add the insult that these two officials have no doubt been suspended on full pay and benefits while the year-long investigation takes place at great expense to the tax payer. After which they are moved to a different government department as “punishment”.
reply
orbital-decay 4 hours ago
Why does this page want to know my precise location?
reply
aussieguy1234 5 hours ago
I would be totally unsurprising if corrupt politicians in developing countries start using AI extensively for basic governance.

What will be interesting is to see who does a better job. Corrupt politician by themselves, or the AI they outsource their job to.

reply
antonvs 7 hours ago
[flagged]
reply
antonymoose 6 hours ago
Wait until you find out about IBM and Fanta!
reply
antonvs 3 hours ago
Yes, I'm aware. But the point is not just that some businesses survived being Nazi-friendly - Hugo Boss is another example. The point is it's more unusual that a propaganda outlet whose entire purpose was to promote an evil regime survives that regime.
reply
quantified 10 hours ago
[flagged]
reply
wewewedxfgdf 7 hours ago
The entire world sells products to encourage you to do your work with AI assistance.

But god forbid that there should be any evidence of that in your .....work. You'll be suspended or fired.

Holy god, it looks like someone used AI and were a bit sloppy in their editing!!!! YOU'RE FIRED!

Maybe someday when there's been enough such reports people will shrug like they do about security breaches now.

reply
protocolture 6 hours ago
I dont know if its "evidence of AI" so much as "Evidence of laziness causing extreme public embarrassment"

Every good AI policy is basically:

1. You may use <supported LLM with enterprise data agreement>

2. You are still responsible for the quality of your output, customer facing embarrassment is your fault and will not be attributed to the technology.

In this case, the LLM was used to generate a reference table.

>“It seems that these references were generated and attached to the document after the fact, as they are not cited in the body of the text.

Like its just a retrospective justification for the content they have written, its not lazy editing it implies a complete lack of research, while fraudulently trying to imply the research was completed.

reply
root_axis 6 hours ago
These suspensions send the appropriate message. This isn't the same thing as poorly reviewed marketing copy, hallucinations in government policy papers are unacceptable.
reply
suprjami 6 hours ago
These people are employed to serve the public and are paid by public funds. This is a socially critical job which affects people's entire lives, and in South Africa possibly their personal safety. This isn't just another coporation who needs to make line go up.

The wording of the article suggests that large parts of the documents where false and should have been caught by review, for which these two director-level people were responsible. This seems to be more than just editing which was "a bit sloppy".

I suggest if you were an immigrant whose citizenship application was denied based on an AI hallucination, forcing you to uproot and move your family out of the country against your will, you would not appreciate that and would take a different view.

reply
delfinom 6 hours ago
Wow, way to argue maliciously.

The only reason any AI usage is rejected in this scenario is due to errors.

Human error is one thing, but if a human uses AI and does not verify its output and then publishes it as some sort of authoritative work, you are pushing deep past ethical issues and often into legal issues.

Government word is law so government employees posting bad information from AI when it's their job to post good information is practically a crime in of itself.

Yes, humans can also publish information by mistake, but there's a massive difference between a human getting some numbers wrong vs. AI completely inventing citations.

My megacorp recently published their first AI usage policy, more or less, go nuts using AI but you will be 100% be held accountable for reviewing output to be acceptable, including but not limited to terminations.

reply
add-sub-mul-div 6 hours ago
> Maybe someday when there's been enough such reports people will shrug like they do about security breaches now.

Yes, it's a real danger that it becomes a whole shift downward for society. We stop objecting to errors and mediocrity because they've become so normalized.

reply
cwnyth 7 hours ago
God forbid people actually have to do work and fact-check the hallucination machines!
reply
wewewedxfgdf 7 hours ago
You're correct - whether you keep your job depends on how well you conceal that you used AI.
reply
embedding-shape 6 hours ago
I don't think most people care if you used AI or not, as long as it's correct. AI or no AI, incorrect and false stuff makes people tired of you.
reply
add-sub-mul-div 6 hours ago
People who are paying even a slight bit of attention understand and anticipate the correlation between AI and slop/hallucination. There's a reason those terms have emerged. And there aren't corresponding terms for AI success/quality.
reply
benjiro3000 6 hours ago
[dead]
reply
Terr_ 6 hours ago
Yes, but at the same time: "God forbid managers and executives actually permit people enough time to do do work and fact-check the hallucination machines." Especially in contexts where they are also mandating that staff find ways to use the hallucination machines.

Much like industrial accidents, some portion of blame has to go to the system, rather than any individual.

reply