Ukraine's AI drones entered 'Terminator mode' and killed Russian soldiers -- no human fired
Source: Yahoo
A Ukrainian drone manufacturer has confirmed to New Scientist that a test involving 10 fully autonomous AI-controlled drones operating with no human oversight or connection killed Russian soldiers on the front line of the Ukraine war approximately two years ago.
The disclosure, made at a press event hosted by the Ukrainian embassy, marks what weapons experts are calling a historic threshold in the history of warfare.
The drone-maker behind the technology, Alexander Kokhanovskyy, described the operation in blunt terms. The drones were launched toward the front line near the cities of Bakhmut and Chasiv Yar during a Ukrainian counteroffensive push, programmed to cover between three kilometers (1.86 miles) and five kilometers (3.10 miles) over approximately 10 minutes, at which point they entered what Kokhanovskyy called "Terminator mode" a state in which an onboard AI model independently searched for, identified, and attacked targets with no human input.
"We just launch it, and we know everything will be dead everything that will be found there in this particular area will be dead," Kokhanovskyy told New Scientist. "There is no connection to the drone at all, you cannot see the video, nothing. Everything it sees will be killed."
-snip-
Read more: https://www.yahoo.com/news/world/articles/ukraine-ai-drones-entered-terminator-093000061.html
More, from New Scientist:
https://www.newscientist.com/article/2529849-fully-autonomous-drones-have-killed-human-soldiers-for-the-first-time/
The test took place two years ago and involved quadcopter drones that were programmed to fly towards the front line, cover between 3 and 5 kilometres over around 10 minutes and then engage Terminator mode, in which an AI model searches for and intercepts targets.
With no way to tell what the automated drones had seen or targeted, human-piloted drones were sent into the area after the test to manually check results. Victims included a couple of soldiers, one truck, says Kokhanovskyy. While there is no recording of the automated drones attacking these targets, it was concluded that the drones had killed them.
Kokhanovskyy says that he was not at the test personally but that it was carried out by an unnamed military unit near the cities of Bakhmut and Chasiv Yar as part of a Ukrainian counteroffensive push. The Ukrainian Ministry of Defence did not respond to questions about the test or the current legal position on the use of fully autonomous weapons.
-snip-
So reckless and unethical. Really stupid.
Srkdqltr
(10,073 posts)highplainsdem
(63,540 posts)It's extremely important that Ukraine have the moral high ground in this war against Russian aggression, and there's no moral high ground in testing autonomous killing machines on humans.
And there was no need to shut off recording by the autonomous drones - if it was actually shut off - when they needed to check the results from the test. Claiming the test wasn't recorded live sounds like an excuse for not showing everything that really happened.
cbabe
(6,951 posts)highplainsdem
(63,540 posts)not have been able to program the drones to always differentiate between humans and other targets, it's quite possible they were sent to kill everything that moved, or at least everything over a certain size that moved.
Notice he said everything and not everyone. The drones likely killed pets, livestock and wild animals, as well as humans.
cbabe
(6,951 posts)the complete unreliability of ai.
Response to highplainsdem (Original post)
highplainsdem This message was self-deleted by its author.
LisaL
(47,910 posts)I can envision lots of things could go wrong here. How does a drone know if it's a Russian soldier they are firing on, as opposed to a civilian or even Ukrainian soldier?