An armed robot developed by Turkish defense companies is displayed at a facility in Duzce, Türkiye, on April 29.
Omer Urer/Anadolu via Getty Images
hide title
Omer Urer/Anadolu via Getty Images
GENEVA – Negotiations on possible rules for the use of lethal autonomous weapons, also known as “killer robots,” are underway at the United Nations in Geneva.
Supporters of controls on autonomous weapons say this week’s UN conference on Certain Conventional Weapons (or CCW), which meets only once every five years, is the last best chance to agree on rules before it is too late.
Warfare technology has advanced rapidly in recent years, and some experts warn that the world is just months away from having weapons that can choose targets and make the decision to kill autonomously.
In Ukraine and Gaza, AI-assisted weapons have already been used to eliminate targets, and Ukrainian civilians have reported being “hunted” by drones while shopping or going to school. But these are still controlled remotely by humans.
Humanitarian organizations say the decision to kill – and responsibility for that choice – must remain in human hands. Ahead of this week’s meeting, the United Nations, the International Committee of the Red Cross and the Pope have called for legally binding rules. UN Secretary-General Antonio Guterres warned that allowing fully autonomous weapons to kill would be “crossing a moral red line.”
What are the risks?
The Red Cross is particularly concerned that the existing rules of war – the Geneva Conventions – cannot be fully respected by autonomous weapons. War is often chaotic and confusing, and the situation can change quickly. According to the Conventions, soldiers who are wounded or in the process of surrendering can no longer be targeted.
Georgia Haines, legal counsel for the Red Cross, is concerned that autonomous weapons cannot distinguish between a soldier who is still fighting, one who is injured and one who wants to surrender.
‘The risk is that, based on the technology we are seeing, they will not be able to understand contextual signals in the same way as a human. Therefore, the risks of a target being misidentified are incredibly high.”
Meanwhile, human rights groups warn that the technology behind AI-assisted weapons is becoming cheaper and easier to use. The more it is adopted by the military, the greater the danger of proliferation and its use by terrorist groups or law enforcement agencies in repressive regimes. In theory, a swarm of autonomous drones could be programmed to kill anyone wearing a red sweater, anyone carrying a sign, or even anyone who speaks a certain language.
Many of the countries now meeting in Geneva take those concerns very seriously. At least 50 countries, including Ireland, Italy, Brazil, Mexico, France and Germany, are calling for a strict timetable to agree binding rules governing autonomous weapons.
But among states already developing and using semi-autonomous weapons, there is resistance. The United States, Russia and Israel have indicated they will oppose legally binding rules, and Washington has instead proposed a five-year timetable for drafting nonbinding guidelines.
The United States is traditionally a late adopter of international treaties. For example, it did not ratify the Ottawa Convention on landmines, although it eventually stopped deploying them and reduced its stockpiles.
Under President Trump, doubts about international law have increased. Washington has imposed sweeping sanctions on the International Criminal Court, and just this weekend, Secretary of State Marco Rubio, in a keynote address to the Federalist Society, warned against “citing laws to men with swords.”
The problem for states meeting in Geneva is that UN negotiations on specific arms limitations are supposed to be conducted by consensus. This was achieved in 1995, when countries agreed to ban blinding lasers, but other agreements have proven elusive. With landmines, countries frustrated by the delay eventually took negotiations outside the UN process to create the Ottawa Convention.
This week there may be a compromise: a longer or even indefinite negotiation period to reach rules that individual states can adopt as binding or non-binding. For diplomats who support that solution, it is a way to ensure at least some progress. For activists, it is far from ideal, with some comparing it to kicking a very dangerous can down the road.