Slashdot Mirror
Massive US Military Social Media Spying Archive Left Wide Open In AWS S3 Buckets (theregister.co.uk)
An anonymous reader quotes a report from The Register: Three misconfigured AWS S3 buckets have been discovered wide open on the public internet containing "dozens of terabytes" of social media posts and similar pages -- all scraped from around the world by the U.S. military to identify and profile persons of interest. The archives were found by veteran security breach hunter UpGuard's Chris Vickery during a routine scan of open Amazon-hosted data silos, and these ones weren't exactly hidden. The buckets were named centcom-backup, centcom-archive, and pacom-archive. CENTCOM is the common abbreviation for the U.S. Central Command, which controls army operations in the Middle East, North Africa and Central Asia. PACOM is the name for U.S. Pacific Command, covering the rest of southern Asia, China and Australasia.
"For the research I downloaded 400GB of samples but there were many terabytes of data up there," he said. "It's mainly compressed text files that can expand out by a factor of ten so there's dozens and dozens of terabytes out there and that's a conservative estimate." Just one of the buckets contained 1.8 billion social media posts automatically fetched over the past eight years up to today. It mainly contains postings made in central Asia, however Vickery noted that some of the material is taken from comments made by American citizens. The databases also reveal some interesting clues as to what this information is being used for. Documents make reference to the fact that the archive was collected as part of the U.S. government's Outpost program, which is a social media monitoring and influencing campaign designed to target overseas youths and steer them away from terrorism.
"For the research I downloaded 400GB of samples but there were many terabytes of data up there," he said. "It's mainly compressed text files that can expand out by a factor of ten so there's dozens and dozens of terabytes out there and that's a conservative estimate." Just one of the buckets contained 1.8 billion social media posts automatically fetched over the past eight years up to today. It mainly contains postings made in central Asia, however Vickery noted that some of the material is taken from comments made by American citizens. The databases also reveal some interesting clues as to what this information is being used for. Documents make reference to the fact that the archive was collected as part of the U.S. government's Outpost program, which is a social media monitoring and influencing campaign designed to target overseas youths and steer them away from terrorism.
Unless they're claiming these were private posts the spooks somehow hacked into, it's just another public copy of already public data.
Thanks Democrats for voting that clown in. He took the Bush-era surveillance and expanded it by leaps and bounds. It's time we appoint a special prosecutor and investigate all of the abuses of the Obama administration.
Why doesn't the military store their own stuff?
If you can still claim copyright etc, it doesn't mean you can claim anything on social media is 'secret'. If so. this is nothing more than what every Sysadmin with half a brain has been saying... containers on machines you don't control are not secure.
does /. count as social media, antisocial media maybe ? Anyhow, did centcom scan slashdot ? Is centcom the new UI for slashdot ?
Nullius in verba
If it's in the cloud, even the secure cloud, it's open.
You may not think it is, but it is.
And, yes, other nations do - and will - have access to it.
-- Tigger warning: This post may contain tiggers! --
Justice says it is only reasonable to have encryption if they can read it.
It they can only protect it as well as this, reasonable is a sad story.
a) Amazon buckets didn't always come that way, it took some pressure for Amazon to accept that this was a poor default setting.
b) In most of these cases, it's simply incompetence - I can't get OAuth to work, let's just set it to public and hope nobody guesses the bucket name.
Custom electronics and digital signage for your business: www.evcircuits.com
...as my company switches to AWS Workspaces, someone asked me what AWS is. I explained it and summarized: it's a very powerful and capable platform, yet its users are perfectly capable of powerfully shooting themselves in both feet.
Chewbacon
The Bible is like Wikipedia: written by a bunch of people and verifiable by questionable sources.
... again.
I'm sure Russia is super-scared.
As for that guy who some day suggested that all other people was inferior: https://slashdot.org/comments....
At-least those willing to relocate to the US.. Well.. I'm pretty sure some Russian and even North Korean computer users will know their shit and could had been interested in doing something in the US too.
They have placed their human spies deep within the command and policy setting structures of the US and UK mil, governments.
Why worry about "social media" when US and UK gov policy is been created by decades of well placed spies.
Other nations don't worry about social media in the same way the USA wasted billions trying to "sway" people.
"Social media" does not change a persons faith and what their faith will always command them to do.
Smart nations, faiths, cults, criminals just line their spies up at UK and UK job fairs and recruiting efforts on university campuses.
Over decades some move up to upper and middle management passing any efforts at detection by MI5, FBI.
A polygraph investigation (the test is just color of law cover for the long term investigation) won't find a person who is not lying and has never been corrupt.
Well placed spies then move to more trusted parts of the UK and UK mil thanks to changes in who needs to be added to the security services. Security is now second place to hiring lots of different people from all over the UK and USA with very different backgrounds. Other governments, cults, faith groups, criminal groups just line their clean, trusted spies up at jobs fairs and note who many of their best students get accepted every decade.
In the past the US and UK really put some thought into getting trustworthy staff. Now its just about virtue signalling that all kinds of applicants are welcome.
Social media spying is not that important for spying, other nations, cults, faiths, gangs, criminal groups have that covered with decades of their own people deep in the US, UK police, security services, special forces and mil.
The other aspect other nations really like using US and UK social media is to find US and UK spies trying to pass as low level UK, USembassy workers in their own nations.
The US and UK will often try and place advanced mil/university graduates with amazing "skills" in with their low ranking embassy staff.
Other nations use years of collected and stored social media to track back over embassy workers education and work history.
Private detectives and contractors who do complex background and reference checks will often be able to show when and how a persons social media was altered or created by US/UK clandestine services to create a fake history for a created embassy worker.
Its hard to pass a created image of a person enjoying a party with no link to the US mil when private detectives have saved images of the same person in a different part of the USA in the mil years ago. Collect it all was low cost and a lot of early social media was saved in real time.
Domestic spying is now "Benign Information Gathering"
UK Parliament moved their email and documents into the *Microsoft* cloud in Ireland......
(From Snowden): CIA was/is spying on all its allies, and each day a brief on legislation was prepared for Bush (and later Obama) on who was considering what legislation. If it was bad for the USA, it could be headed off. The joke being that when allied leaders called the President he already knew the details of the legislation they were going to talk about, and already had lined up talking points and counter allies as leverage.
So now all that cloud data is used to inform Donald Trump, his various business partners, and potentially (via the secure link Jared asked the Russians to provide) Trump's Russian friends too.
It's quite staggering that GCHQ would permit the highest law making body in the land to put its data into a cloud they know they and NSA have access to. Exposing the law making process to known foreign surveillance. Theresa May complains of Putin's 100+ propaganda channels trying to stir up racism during the Brexit vote... yet Parliament are exposed to back channel orange.
In most of these cases, it's simply incompetence - I can't get OAuth to work, let's just set it to public and hope nobody guesses the bucket name.
I want to know how people guessed the bucket name: I'm impressed that they do.
"First they came for the slanderers and i said nothing."
Well, let's start with the usual suspects. Did a contractor / employee have access to it, and, I don't know, have the WeatherBug application running in the background?
I mean collecting billions of people's private posts and leave them open online.
...the government was caught leaving copies of books it found in the public library in places where the public could see them! Seriously, this seems like a complete non-story if all the information in the S3 bucket was already public information. They just went out and gathered a bunch of stuff that you or I could already get by simply googling it and stored it in one place. Now if some of the information was not public already, then that is a different story...and would have been highlighted in this one if it really was the case.
GZIP is more like a factor of 3-4 times for text. The only way they could get a factor of 10 compression ratio would be if they were using something like PAQAR 4.5, which I kinda doubt...
A book about the Democratic party is pretty much guaranteed to be PR, either by a party supporter or by an opponent. In neither case should it be believed. Instead watch what it does and how it acts. The same is true for the other parties.
A Democratic event is more revealing, but attending at more than a low level event requires approval by those higher up in the party. While there are obvious reasons why this is necessary, it mitigates against trusting what you see as being an accurate mirror of the intentions of those in control. So again, watch what it does and how it acts.
And, of course, watching means that your reports come from trustworthy sources. So don't believe what you see reported easily. Require multiple sources with differing biases.
Have you started to notice that this is a lot of work? That's why people usually pick someone they trust to form their opinions. Too bad people are so bad at picking trustworthy people.
I think we've pushed this "anyone can grow up to be president" thing too far.