Posted: Tuesday, February 26, 2008 7:15 PM by Alan Boyle
This gun-toting Foster-Miller SWORDS robot was introduced into the conflict in Iraq in 2007.
Thousands of robots are already on the battlefield in Iraq and Afghanistan, but what happens when you hand the robot a gun and turn it loose?
Some researchers fear that giving military robots autonomy as well as ammo is the first step toward a "Terminator"-style nightmare, while others suggest that in some scenarios, weapon-wielding robots could someday act more humanely than humans.
The pros and cons of killer robots are taking center stage Wednesday in London, at what's considered the world's oldest military think tank, the Royal United Services Institute.
On one side of the issue is Ronald Arkin, a robotics researcher at Georgia Tech who is working on a Pentagon-funded project to build a sense of ethics into battlefield robots - "an artificial conscience, if you will," he told me.
"The basic rule is to try to engineer a system that will comply as best it can, given the information that it has, with the laws of war," Arkin explained. "And it's my belief that eventually we can do better than humans in this regard."
On the other side is Noel Sharkey, a robotics expert at Britain's University of Sheffield who served as chief judge for the long-running TV show "Robot Wars."
Nowadays, Sharkey is sounding the alarm about the prospect of real-life robot wars: He's calling for an international ban on autonomous weapon systems until it can be shown that they can obey the laws of war.
"I think we should be addressing this immediately," Sharkey told me. "I think we've already stepped over the line."
Killer robots aren't on their own ... yet That doesn't mean killer robots are on the loose. To date, the battlefield 'bots have been used as not-so-autonomous extensions of human warfighting capabilities. For example, the missile-armed Predator drones that have played such a prominent role in Iraq and Afghanistan are remote-controlled by teams of living, breathing pilots.
On the ground, robots have traditionally done reconnaissance or hunted for roadside bombs. Just recently, the Pentagon just went through a tangled procurement process to order up to 3,000 next-generation machines. (After a legal battle, the contract was won by iRobot, which also makes the Roomba vacuum cleaner and other robotic helpers.)
Last year, the Pentagon started sending gun-toting robots to Iraq, but even those robots aren't designed for autonomous operation. Instead, they're remote-controlled by human operators and are equipped with fail-safe systems that shut them down if they go haywire.
What worries Sharkey is that the military may be on a slippery slope leading to a robotic arms race. "My real concern is that the policies are going to make themselves, that the 'autonomization' of weapons will creep in piecemeal," he told me.
For example, Sharkey pointed out that the Pentagon is already on a path to make a third of its ground combat vehicles autonomous by 2015. "Then you'll put a weapon in one of them, and then it will gradually creep in bit by bit.," he said.
He also pointed to the Pentagon's roadmap for billions of dollars' worth of robotic research over the next 25 years. As the United States and its allies put more and more robots on the battlefield, their rivals will surely follow. "Once you build them, they're easy to copy," Sharkey said. "The trouble is that we can't really put the genie back in the bottle."
Even if the United States takes care to build robots with a "conscience," others may feel under no pressure to do likewise. A couple of years ago, Iranian-backed Hezbollah guerrillas sent a remote-controlled drone over Israel, and Sharkey said al-Qaida and other terrorists could follow suit with their own breeds of robo-bombers.
"If you don't really give a toss, you can just put an autonomous weapon running into a crowd anywhere," Sharkey said. "It's only a matter of time before that happens."
Killer robots with a conscience? Arkin agrees with Sharkey that it's high time to start thinking about the implications of autonomous weapon systems.
"I think that's a reasonable debate, and there's good reason to have that debate at this time, just so we understand what we're creating," he said. "I would be content if it was decided that autonomous systems have to be banned from the battlefield completely."
But when it comes to designing the combat systems of the future, Arkin argued that there should be a place for autonomy, or at least an embedded sense of ethics. He pointed out that humans haven't always had a good track record on battlefield behavior.
"Human performance, unfortunately, is a relatively low bar," Arkin said.
One of Arkin's suggestions would apply even if a robot is under human control: The robot should be able to sense if something wasn't right about what it was being asked to do - and then require the human operator to override the robot's artificial conscience.
In other scenarios, the data flooding in about a potentially threatening encounter might be so overwhelming that mere mortals would not be able to process the input in time to make the right decision. "Ultimately, robots will have more sensors and better sensors than humans have to see the situation," Arkin said.
Arkin said he doesn't advocate the idea of creating robot armies to sweep over a battlefield. Rather, they would be used for targeted applications: For example, once an urban area is cleared of civilians, a robot could be set up to watch out for snipers and fire back autonomously, he said.
"The impact of the research I'm doing is, hopefully, going to save lives," he said.
But Arkin described his efforts as mere "baby steps" toward the creation of battlebots with a conscience. "There are no milestones or timetables for doing this right now," he said. "We're pioneering this work to see where it would lead."
New laws of robotics This work goes way beyond science-fiction author Isaac Asimov's Three Laws of Robotics, which supposedly ruled out scenarios where robots could harm humans.
"Asimov contributed greatly in the sense that he put up a straw man to get the debate going on robotics," Arkin said. "But it's not a basis for morality. He created [the Three Laws] deliberately with gaps so you could have some interesting stories."
Even without the Three Laws, there's plenty in today's debate over battlefield robotics to keep novelists and philosophers busy: Is it immoral to wage robotic war on humans? How many civilian casualties are acceptable when a robot is doing the fighting? If a killer robot goes haywire, who (or what) goes before the war-crimes tribunal?
Sharkey said such questions should go before an international body that has the power to develop a treaty on autonomous weapons.
"In 1950, The New York Times was calling for a U.N. commission on robotic weapons," Sharkey said. "Here we are, 57 years later, and it's actually coming to pass - and we still haven't got it."
I see no good coming from this, its one thing to have remote controled robots to use in hazardous enviroments( mine fields , NBC contaminated areas, clearing a room, etc) with HUMAN CONTROL.
Posted by: Killjoy
This is the only robot I'm worried about.
Posted by: celticsfan
EXTERMINATE!!!
Posted by: NPD108
It does kinda look like the machines from Terminator 3 only smaller...
Posted by: USMCMP5811
A robot may not injure a human being or, through inaction, allow a human being to come to harm.
A robot must obey orders given to it by human beings, except where such orders would conflict with the First Law.
A robot must protect its own eexistence as long as such protection does not conflict with the First or Second Law.
Posted by: 60chevy
The smarter robots are the more chance humans are in trouble. Once a robot gets to much knowledge then it will relize humans are there worse own enemy.
ma police, boston ma police, massachusetts police, massachusetts police, mass state police, mass police, ma, mass, massachusetts, massachusetts, massachutes, massachusetts law, massachusetts polece, police, officer, police officer, cops, police gear, law enforcement, police duty gear, state police, sheriff, law, police supply, police agency directory, police agency, police department, traffic officer, police dept, state trooper, dispatcher, massachusetts county sheriff, massachusetts sheriff, massachusetts department of corrections, ma doc, doc, dept of corrections, police information, civil service, ma civil service, massachusetts crime, police training, police academy, ma police academy, massachusetts officers, masscop, masscops, mpa, bpa, ibpoa, police association, massachusetts police news, massachusetts crime news, mass most wanted, police career information, police patrol, police administration, police books, crime scene training, police discussion, crime discussions, cops
About MassCops, the home for Massachusetts law enforcement.
The Massachusetts Law Enforcement Network opened in 1998 and is now a part of the New England Police Network The site is a pro-police discussion forum intended for sworn police officers and civilian law enforcement officials as well as those interested in pursuing a career in law enforcement here in Massachusetts.
The goal of The Massachusetts Law Enforcement Network is to provide an informal network of law enforcement officials here in Massachusetts for educational and informational purposes.
The forum covers many topics such as Police Related News Articles, Agency & Profession Discussions, Police Training as well as Law Enforcement Career Information.
The Massachusetts Law Enforcement Network and The New England Police Network (NEPN) and it's network sites are privately owned websites/domains and are not affiliated with or endorsed by any government association or agency.
MassCops (masscops.com) and (masscop.com) are privately owned are not affiliated with or endorsed by the Massachusetts Coalition of Police (masscop.org)