Slashdot Mirror
Pentagon Chiefs Fear Advanced Robot Weapons Wiping Out Humanity (mirror.co.uk)
Longtime reader schwit1 writes: Huge technological leaps forward in drones, artificial intelligence and autonomous weapon systems must be addressed before humanity is driven to extinction, say chiefs of Pentagon
From a report: Air Force General Paul Selva, the Vice Chairman of the Joint Chiefs of Staff at the US Defense Department, said so-called thinking weapons could lead to: "Robotic systems to do lethal harm... a Terminator without a conscience." When asked about robotic weapons able to make their own decisions, he said: "Our job is to defeat the enemy" but "it is governed by law and by convention." He says the military insists on keeping humans in the decision-making process to "inflict violence on the enemy. [...] That ethical boundary is the one we've draw a pretty fine line on. It's one we must consider in developing these new weapons," he added. Selva said the Pentagon must reach out to artificial intelligence tech firms that are not necessarily "military-oriented" to develop new systems of command and leadership models, reports US Naval Institute News .
From a report: Air Force General Paul Selva, the Vice Chairman of the Joint Chiefs of Staff at the US Defense Department, said so-called thinking weapons could lead to: "Robotic systems to do lethal harm... a Terminator without a conscience." When asked about robotic weapons able to make their own decisions, he said: "Our job is to defeat the enemy" but "it is governed by law and by convention." He says the military insists on keeping humans in the decision-making process to "inflict violence on the enemy. [...] That ethical boundary is the one we've draw a pretty fine line on. It's one we must consider in developing these new weapons," he added. Selva said the Pentagon must reach out to artificial intelligence tech firms that are not necessarily "military-oriented" to develop new systems of command and leadership models, reports US Naval Institute News .
Surprised no one mentioned this yet. Why people think the Air Force guy is crazy is beyond me. Of course autonomous systems that kill are a threat to humanity.
HBI's Law: Frequency of calling others Nazis is directly correlated with the likelihood of the accuser being Communist.
I'm wondering if humans will ever shake off their extremely violent ancestry and wind down the war and militarism. The US is the greatest exporter of weapons and the most militarily aggressive country in the world with military action in over 100 countries.
https://www.thenation.com/arti...
If we can't lead by example in toning down endless warfare, and instead provide the cover that other countries need to justify and build their own drone and robot armies, then the world of the future is going to be a very dismal place indeed.
A brain is a terrible thing to waste... Mind? That's debatable.
War and violence are inherent to the profitability of the military industrial complex. You cannot have greatness and executive bonuses without corporate profits.
I'll see your senator, and I'll raise you two judges.
and woman as well. If not then you have a wide open gap for people to clam sex discrimination and or sex change BS to get out of it. They closed off the gay loop hole.
Until repair/refuel/replenish is automated...you don't have to worry about more than a first strike. Of course, you aren't hooking the nukes up to these, are you? (nervous silence)
His concern isn't entirely unjustified. We're increasingly relying on robots to do the actual killing, but we've currently designed the systems so that humans need to be involved in the decision making. The fact that we're involving humans puts a natural bottleneck on our operations, since there's only have so much attention we can give. At some point (e.g. World War 3), it be seen as more efficient to launch a fleet of drones that vastly outnumbers our pilots, equip each with facial recognition systems and a list of targets, and tell them to kill on sight.
I'm not saying it's a good idea, but there's no denying that it would be an efficient way to get the job of killing done, and that it's the sort of measure a country might turn to in desperate times.
But at that point, we'd be just one bug away from a system that produces false positives and starts gunning down everyone in sight. We're just talking about faulty weapons, not machines that can think or understand what they're doing. But if they're deployed en masse, a single bug could have catastrophic results, in much the same way that landmines have remained a problem in many parts of the world, decades after the wars that put them there had ended. This isn't Skynet or an AI intent on world domination. This is simply a machine with a bit too much responsibility.
Well, a bug will produce collateral damages, however it will not lead to human race extinction or not even near it. An autonomous killing robot still need to refuel, replenish ammo, etc. So, it is not entirely autonomous. It still relies on external systems to keep going. Beside that, if this kind of race toward an autonomous killing machine is launched, there will be also development for counter measures against it. It is not like your ennemy will sit and rest waiting for being killed by your machine. No matter how wonderful may your killing machine be, there will be efficient counter measures against it.
Achille Talon
Hop!
His concern isn't entirely unjustified. We're increasingly relying on robots to do the actual killing, but we've currently designed the systems so that humans need to be involved in the decision making.
Forget the military drones. (Or at least, they're a smaller component of the overall issue.)
We have computer-controlled cars. They will be deployed in massive numbers over the next ten years. If remote updates are possible, anyone who can update a popular model has access to a distributed weapon of mass destruction capable of causing hundreds of thousands of deaths in a matter of moments.
Warfare-oriented tech isn't the only vector for mass attacks.
Real lawyers write in C++
I'd like to say that toning down endless warfare would be nice, but I think we have the dangerous idea that we are in a post-violence world.
This may be the future, but it isn't the Star Trek future. Being an example to others is honestly not yet at the point where it will lead to a cascading effect and end violence.
What happens when the US ceases to patrol off the Horn of Africa without the Somali's having their people prosperous and their country stable? Very simply, more piracy, because the Somalis are still poor and fighting each other.
What happens when the US leaves the Gulf while the Arab States and Iran have not sworn off violent fundamentalist ideologies? Escalation and threats to the current production of a great deal of the world's supply of energy and no moderating force, because no one else is interested in ignoring sectarian goals for peace and unity.
Yes, our mission in those areas acts as an irritant in some ways, and certainly bad decisions in that area can cause dangerous moments, but this is not yet a situation where picking up and unilaterally swearing off war or international military missions is going to have the effect you have hoped for. Places like Iran and the Arab States and India and Pakistan, and other areas need to treat each other like Canada, Europe and the US treat each other to get to the point where stepping away will result in anything but war and serious instability.
Actually obtaining democracy peace to the point where most of the West have gotten today, as imperfect as it is, took centuries of brutal warfare and bloody revolutions, and that is AFTER most of those Western countries had agreed that representative and government and the rule of international law was a good idea. The US had to pretty much fight a brutal Civil War and years of tensions with Europe to get there, and Western Europe itself didn't clean up its act until WWII. The rest of the world has a long way to go on that front and while it would be nice to say that they just have to adopt our institutions, we have already seen what happens when an uneducated population, unused to peace and democratic institutions is forced to turn into a democracy. It becomes a "Democratic Republic" which works exactly like a dictatorship or oligarchy.
There would be survivors of any nuclear conflict. Maybe millions of survivors. It would suck to be a survivor, life would be really hard under a nuclear winter with all distribution networks destroyed. Humanity would survive though at a much diminished rate.
Nice assertion, but we still might not survive. Starvation and disease could take the rest. Human-kind has been close to extinction before. We could make it there again. And maybe this time, not be quite as lucky.
That is all.
It is for geopolitical control and great profit. Even our own government admits that we have created more terrorists than we kill, which I assume is not because our government and military are incompetent, it is just a form of job security. There wasn't nearly as much bloodshed and civil war in the Middle East until we went in with our military and intelligence agencies to institute "regime change" by way of war. Now there are civil wars (e.g., Libya, Syria and Iraq) where there had not been before we intervened militarily. We were not attacked by any of those countries, and it is an international war crime to commit unprovoked military aggression. Millions of refugees are fleeing the fighting. None of it had to be, and none of it has brought about any type of peace or stability, not even in Afghanistan where we have been the longest (who also did not attack the US).
You know full well that the US is the most aggressive country on the planet. We are not keeping the peace, we are making sure that peace can not happen and that the wars will go on indefinitely, thus keeping the region in turmoil, and keeping the profits flowing. Please point to one place where our military has produced "peace" since the first Gulf War. I just pointed to a number of places where we undid the peace, and created endless war.
A brain is a terrible thing to waste... Mind? That's debatable.
blah-blah, white-man's burden, blah-blah...
Not saying the west should pull out or that we are in a post-violence world, but it might be a good idea to step back and see if the west is helping or hurting.
Too often we are jumping in to protect our "interests" instead of helping the "situation". It may be we are doing too much short term reacting...
FWIW, the US Civil War wasn't really much about instability as it was a conflict over the future of the recently annexed territory and the power of the central government. The small guy lost in the end (after lots of bloodshed) their right to secede from the union and were basically adopt the institutions of the union. Is that what you are saying what happens when an uneducated population, is forced to turn to a "Democratic Republic" (e.g., the USA's current form of govt)? ;^)
It's so much clearer now...
The so called "peace" we have today in the west is of course illusory (as seen by recent events like Crimea). The waves of immigrants to Europe fleeing the *real* instability in Syria and the economically challenged countries the middle east is showing the cracks in European stability.
Let's face the sad truth, stability that everyone desires seems to only draw on the wealth of a nation. Given the current assortment of "wealthy" nations historically used mercantilism to create much of their wealth from these in-stable countries, is it no wonder that we continue to attempt to project stability in a region to protect our interests. But what of *their* interests? Hence we return to the white man's burden argument... ;^)
I hate to use China as an example, but it used to be a dumping ground for European and Japanese influence peddling (e.g., opium war, concession ports, forced trade, occupation, etc), until they managed to get everyone to leave them alone for a few decades. Sure it was brutal (great-leap-forward, cultural revolution, etc), but they managed to dig themselves out of a hole into some reasonable form of stability mainly because they simply got wealthier without interference. Now they look like they might take over the world. Perhaps this is what people fear the most and keeps the west involved in other countries...