NSA's Novel Claim: Our Systems Are Too Complex To Obey the Law
Reader Bruce66423 (1678196) points out skeptical-sounding coverage at the Washington Post of the NSA's claim that it can't hold onto information it collects about users' online activity long enough for it to be useful as evidence in lawsuits about the very practice of that collection. From the article: 'The agency is facing a slew of lawsuits over its surveillance programs, many launched after former NSA contractor Edward Snowden leaked information on the agency's efforts last year. One suit that pre-dates the Snowden leaks, Jewel v. NSA, challenges the constitutionality of programs that the suit allege collect information about Americans' telephone and Internet activities.
In a hearing Friday, U.S. District for the Northern District of California Judge Jeffrey S. White reversed an emergency order he had issued earlier the same week barring the government from destroying data that the Electronic Frontier Foundation had asked be preserved for that case. The data is collected under Section 702 of the Amendments Act to the Foreign Intelligence Surveillance Act.
But the NSA argued that holding onto the data would be too burdensome. "A requirement to preserve all data acquired under section 702 presents significant operational problems, only one of which is that the NSA may have to shut down all systems and databases that contain Section 702 information," wrote NSA Deputy Director Richard Ledgett in a court filing submitted to the court.
The complexity of the NSA systems meant preservation efforts might not work, he argued, but would have "an immediate, specific, and harmful impact on the national security of the United States.'
Adds Bruce66423: "This of course implies that they have no backup system — or at least that the backup are not held for long."
The computer version.
If you can't have your data available to demonstrate what you're doing it lawful, and you are going to delete it, then only reasonable conclusion is what you are doing cannot be proven lawful.
Therefore, the program is not lawful, and you need to stop.
Problem solved.
This amounts to "your honor, we collect so damned much information we couldn't possibly hold onto it long enough to be subject to legal oversight. Trust us."
What crap.
Lost at C:>. Found at C.
I guess they really are making Skynet... Seriously though, everything the NSA has said since this whole scandal started reeks of "The end justifies the means." They're basically a cartoon villain at this point.
So wait, the NSA's argument as to why their program is legal.. is that they're too incompetent to design a system that can follow the law. Shouldn't this be grounds to fire everyone at the NSA for incompetence, if this is the argument they're using?
"This of course implies that they have no backup system — or at least that the backup are not held for long."
It implies nothing other than the NSA continues to lie whenever an order to turnover data is presented.
When the foot seeks the place of the head, the line is crossed. Know your place. Keep your place. Be a shoe.
Then it's time to stop what you're doing. People's rights are more important hiding politicians' (and their benefactors') dirty laundry. What you're doing is undermining the fundamental principles that separate western democracy from the dark ages.
My biology is so complex it's not understood yet either!
Woohoo! Behold the new lawless me!!!!!
Mostly random stuff.
Just give everyone the finger, it's faster.
---- The above post was generated by the Turing Institute. Maybe.
Everything concerning the NSA has "an immediate, specific, and harmful impact on the national security of the United States."
Releasing any information has "an immediate, specific, and harmful impact on the national security of the United States."
Saving any information has "an immediate, specific, and harmful impact on the national security of the United States."
Any whistle blowers have "an immediate, specific, and harmful impact on the national security of the United States."
Disagreeing with any official has "an immediate, specific, and harmful impact on the national security of the United States."
Giving out the legal reasoning behing their operations has "an immediate, specific, and harmful impact on the national security of the United States."
Why have more people not clued in that the NSA is "an immediate, specific, and harmful impact on the national security of the United States."
they have damaged the reputation of their agencies simply by believing that none of their secrets would get out. My mom always told me that once more than one person knows something it is no longer a secret and will not be kept that way.
The NSA, The CIA, the FBI and the Justice department have already been caught in BOLD FACED LIES in regards to their activities on dozens of occasions. The Presidents (both Obama and Bush) have gone on National Television and lied directly to the American people regarding this programs over and over and over again. Several NSA directors have gone in front of congress and lied while under oath. They were then called back and admitted that they're lied. You cannot trust anything they say at all. The only solution to this is to shut down the agency. They are willing to violate the law, the constitution, court order and even the will of the president. No regulatory reform or court order will be effective against an agency that thinks its charter is more important than obeying the law or will of the people. They fundamentally believe that your physical safety is more important than our individual rights. That is totalitarianism. It is not a belief that is compatible with democracy.
It's the biggest system there is. There's nothing to 'back it up to', for various reasons. The letter of the (original) order can't be complied with, without shutting it off, and saving the current contents for the upcoming hearing (or trial). In the meantime, we have nothing as far as NSA protection goes. I get that.
That doesn't mean the the spirit of the order can't be complied with. Snapshots of sections, randomly chosen database blocks from among representative groups, a sampling of the most called routines; something. If it's a freaking computer, then there is some way that evidence can be gotten without bringing the system down, assuming cooperation on the part of the admins. I hope they are not getting off the hook.
Out of one side they will argue that they can't possibly store all this massive data they are collecting. And then they will turn around and blame the courts for needing more storage to store all this data they are collecting. See we can't stop spying on the American people... the courts are making us.
If the data cannot be saved, then speed up the trial! It's been going on for a while now.
A basic legal principle is that ignorance of the law is no excuse.
It may be a factor in applying penalties, but it does not affect the finding of fact re guilty or not guilty.
If the NSA has historically used perceived complexity of operation as a reason for turning a blind eye to their legal obligations, they may be guilty of massed conspiracy.
So if their system is too complex to obey the law....the short version of what they said is "We built a system without regard to the law" and "We broke the law". Thank you for the confession. Now its time to start dismantling and prosecuting thanks.
"I opened my eyes, and everything went dark again"
Next one will be "proper process is too complex, so we just directly jail anyone that our trusty staff think that deserves it"
This reminds me of the story of the kid who murdered his parents, then threw himself on the mercy of the court because he was an orphan.
We have (or at least had) a Constitution to protect citizens from governmental abuses of this nature.
Circle the wagons and fire inward. Entropy increases without bounds.
and if they're collecting too damn much information to hold it, let alone process it, then it's almost all GIGO. dump the assumptions and Orwell on your desk for reference, and narrow your search. the FBI never caught a bootlegger chasing the history of every barefoot kid on the street, either.
if this is supposed to be a new economy, how come they still want my old fashioned money?
Do you think "The tax code is too complex for me to figure out, so I don't really have to pay, do I?" would work?
Aww, poor NSA, their systems are too complex for them to control according to the law? What a terrible 1st world problem to have! Fear not NSA, I have a solution that will take this horrible burden off your shoulders, and make the rest of us happy at the same time: simplify your goddamn systems to the point where you can 'control' them and be in accordance with the law. Either that or maybe we need to take a chainsaw to your 'systems' and just chop them down to a reasonable size. Here, here's an abacus, that's about all I'd trust you motherfuckers with at this point.
Are YOU using the TOOL, or is the TOOL using YOU? Think about it!
They don't actually mean that the system is too complex to obey the law.
They merely mean that it is too complex for "journalists" to tell whether they are obeying the law or not.
I say we EMP the whole site from orbit. It's the only way to be sure!
Since it would mean that they don't routinely hold onto this information for further analysis, future blackmail, etc. However, it seems far more likely that they are simply lying when they say they can't do this.
Shesh you guys have made the NSA into an all powerful, all knowing, all seeing boogeyman. Think about the "system" you describe and the huge amount of data that we KNOW the NSA routinely collects. Where I don't discount the possibility that the data could be used for blackmail, the problem you have is finding the data you need (the needle) in the huge data set they are collecting (the field of haystacks).
Do you load this in to some MySQL database so you can run an SQL query on it? Um, not if you want an answer anytime soon. There are ways to do this, but we are talking about really large numbers of disk drives, CPU's and specialized bits of software to dig through the haystacks. Not to mention that you simply must have a place to start looking, a target to investigate, unless you figure on just going after some random person and trying to find something you can use for profit... Then there is the pesky size of all this data. It seems very reasonable that the NSA is running out of space and needs to routinely purge older data.
So I don't think you have anything to fear from the NSA, especially if you fear blackmail for something that happened more than a few weeks ago.. Unless you are linked to a terrorist group or something....
"File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
NSA is lying.
Actually, I think they are telling the truth this time....
How much data do you think they are collecting? A Lot right? Or why would anybody be up in arms? The NSA is the all knowing, all seeing boogeyman you know, so they have to collect nearly everything. You cannot archive that much stuff forever, certainly there will be limits on how much they can keep online.
"File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
"Sorry. My financial transactions are far too complex for me to maintain tax compliance records."
Have gnu, will travel.
My big ass hairy guess is the systems algorithms automatically controls what is stored and what is dropped without human intervention, and any real attempt to permanantly store any particular thing would mean basically shutting down the collection system. The size of the system the NSA is using would have to be mind-boggling, the amount of data coming in is staggering; new stuff has to be incoming faster than any backup could ever keep up with. It's highly likely that new stuff would over-write old stuff, making it impossible to secure particular records reliably.
I'm sure that there has to be some metadata system that ranks how long and in what detail data is to be retained, and what most of us boring normal people is downgraded faster than people that keep tripping the filters, the NSA has to be bumping up against the limits of what is possible to do on a regular basis; I'm amazed they actually can do what they are doing.
Apocalypse Cancelled, Sorry, No Ticket Refunds
American citizens should not have to pay to be spied on by an Unconstitutional organization.
https://www.youtube.com/c/BrendaEM
You act like it's some crazy notion that people in government would covertly collect information on private citizens for purposes of blackmail to "keep them in line"---not because those citizens are breaking any law, but because certain officials deem them to be dangerous to their own personal agendas and power structure. Have you ever heard of a guy named J. Edgar Hoover? Perhaps you should look into that.
Today's Sesame Street was brought to you by the number e.
Isilon + Hadoop + Content Analyst (http://en.wikipedia.org/wiki/Content_Analyst_Company)
The last piece is just what the civilians have access to. It came out of the intelligence community. You can guarantee that the NSA has something way more advanced and/or better optimized at this point. Specifically look at Conceptual Clustering and Categorization.
Their challenge is not going to be pulling the data out of the haystack. It is going to be having enough analysts to sort through the results and enough guidance from on high as to which result sets to review first.
"an immediate, specific, and harmful impact on the national security of the United States."
Yes, and see, they measured it out to be on the order of .0000000000000001% of a mission obstacle lasting all of 6 seconds. But by strict definition, it qualifies to trigger the "let us do anything we want without conditions" mechanism they love so much.
"This of course implies that they have no backup system — or at least that the backup are not held for long."
Unfortunately, it proves nothing. The recording systems capture EVERY byte coming along the cables and can be used to REPLAY exactly what data went between two points at any time. This means they can go back and re-examine traffic to find hidden transmissions they overlooked before. They don't throw anything out (specifically stating that they keep anything encrypted forever) and longevity is reported as anywhere from 4 days to several years of 100% of the Internet's activity. Reports vary due to being what the system was capable of at the time, probably. The UT center probably won't be full until your kids are out of diapers and graduating high school.
She should sell it; then she can afford to give you a proper education in sentence structures, spelling, grammar and hyperlinking.
Change is certain; progress is not obligatory.
Isilon + Hadoop + Content Analyst (http://en.wikipedia.org/wiki/Content_Analyst_Company)
Totally aware of this technology, actually have done professional work with it.
Their challenge is not going to be pulling the data out of the haystack. It is going to be having enough analysts to sort through the results and enough guidance from on high as to which result sets to review first.
No, the challenge here is knowing what to look for in the data you collected. You have to use No-SQL techniques to sort though the raw data using map-reduce jobs and collect the information you want about the specific target(s). The individual data reduction steps are *easy* if you have a target to start with. What's hard is performing these steps in a resource constrained world when you have huge data sets that are constantly changing. So the Data part of this is not analyst constrained, it's compute and storage resource constrained. Analysts should only be formulating the queries and setting the queries loose on specific targets and then looking at the results.
"File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
You act like it's some crazy notion that people in government would covertly collect information on private citizens for purposes of blackmail to "keep them in line"---not because those citizens are breaking any law, but because certain officials deem them to be dangerous to their own personal agendas and power structure. Have you ever heard of a guy named J. Edgar Hoover? Perhaps you should look into that.
Oh I don't discount the mis-use of government power, believe me. What I'm saying is that the NSA system requires a TARGET to look for or the data is pretty much worthless. Somebody has to formulate the data query, program the system to actually perform the query wanted, then set the query process in motion for a specified target before they will get results. As I understand this system, if a data item doesn't trigger some kind of flag that says it's of interest, it's going to be removed from the system fairly quickly, at least in its raw form.
So, if you are not already a target that sets off flags, you are lost in the noise and your data is deleted. If you are a target, heaven help you and your friends...
"File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
My experience with the technology has been peripheral. The demonstration I saw showed clustering and with that technology, it removed the need to know what to look for. It put the concepts / clusters together for you and let you see, at a high level, basically what the data set was about. This was assuming that the data set was trained on itself. If you had a more focused training set, say one derived from already vetted intelligence, the algorithms could sort through the noise to find conceptually similar result sets.
The above assumes that there are compute and storage resources available to do the initial training. Obviously the entire data set is too large, so it needs to be culled and that is the challenge.
Off topic and not terrorism related, but it would be interesting to see the correlations between big wins in the stock market and communications patterns between individuals leading up to them. Not that the SEC has the stomach for it, nor am I comfortable with the civil liberties implications of such a setup, but it would be cool to let the algos go for a year or two and see what potential prosecutions they bring back.
I don't know about stupid and incompetent, but you're entirely wrong as to the fundamentals of the 2008 financial crisis.
It's nice to make this about individual responsibility, but that's just not what happened. You probably heard the terms "credit default swap" and "mortgage derivatives" but didn't understand them. Essentially what was happening was major financial companies found that they could package up a bunch of low-rated mortgage-backed securities, hide the information about the individual loans, and turn a bunch of shitty loans into an AAA-rated security, and then trade the risk to someone else. Moody's and S&P were getting their cut from rating these things, and did not even have the information to be able to rate them properly. Then we have the credit default swaps, which were a little-understood and unregulated market, but essentially a way for companies to trade debt as if it were an asset, specifically all of the risk they were exposed to as part of these MBS deals. The concept of trading debt as an asset is not new, but it really only works when you have a good idea of how risky the debt is. There was a booming market[1] in these credit default swaps right up until the first wave of foreclosures hit and the MBS market started crumbling, and then whoever was left holding the bag got screwed.
Banks generally don't do stupid things, even when the government wants them to. They sure as shit don't advertise things that are going to lose money. There were a lot of people with a vested interest in pinning this on the individual consumer and the government, but the seeds were sown with the repeal of Glass-Steagal. The federal loan program ticked along quietly for over a decade, but the mortgage market exploded due to the derivatives market. Taking a shitty subprime mortgage and packing it into an AAA-rated security was like printing money. There was no governmental obligation to offer NINJA loans, for example, and yet Wikipedia has a lovely advertisement offering free money to essentially anyone with a pulse. The loans peaked in 2006; 2008 marked the first round of foreclosures.
Wikipedia has a good but lengthy article on the subprime mortgage crisis, and "The Big Short" is a good read that covers the origins and fallout of the crisis. You can also read the Financial Crisis Inquiriy Commission report. In point of fact, reading anything about the subject would be an improvement in your understanding; your specific theory has been destroyed in any number of sources. It's a complicated subject, and to be honest the exact details of a lot of these things escape me, but you have seized upon a simple answer that suits your preexisting beliefs. Start from the evidence and work backwards instead -- why did Bear Stearns collapse? It wasn't because they were issuing mortgages. This will save you from looking like an ignorant Wall Street stooge in the future.
[1] "The volume of CDS outstanding increased 100-fold from 1998 to 2008, with estimates of the debt covered by CDS contracts, as of November 2008, ranging from US$33 to $47 trillion"
Those who advocate genocide deserve every protection afforded by law, and none afforded by common human decency.
What would they do for anyone else? They'd just seize the servers for investigation and be done with it. Not let you give some wimpy cry about your retention policies--hard to enforce retention when your server is sitting in some FBI storeroom waiting to have its hard drives combed over.
Where I think the results of your thought experiment would be interesting, the results of it would clearly be unusable as evidence and would not be something the SEC would have the legal right to do.
But, I would imagine that the number of people you could prove where insider trading doing this would be extremely limited. Apart from congress (who are exempt from the insider trading laws anyway), most people are usually not that prone to do things that are clearly illegal. Most of the companies who do trading are careful to train on insider trading and ethics for a reason. The companies are liable should they have folks doing illegal trades, the people leaking information are also criminally liable, even if they don't profit from the trades. The SEC has made it clear that this kind of crime doesn't pay, and if you get caught, it's not going to go well for you. I think the message has generally been received.
The problem has moved on to other things.... Now days, It's about shaving fractions of a penny on huge blocks of stock, duping retail customers into taking the hair cut in the process, and laughing all the way to the bank...
"File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
NSA: Not Safe for Americans.
NSA: No Sales for America. The NSA is a powerful advertisement that nothing complicated made by a U.S. manufacturer is safe.
NSA: Not Sensible for America.
The headline implies that the systems are too large to meet some statutory obligation. This is not the case; the truth is that they are saying their systems are too large to comply with this new, not-previously-existing requirement.
I'm not saying I believe them, but it's certainly a plausible argument. It's perfectly normal for the subject of a subpeona or other court order to object to it on the grounds that compliance would prevent the ordinary course of business. I can certainly conceive of a system that takes in huge amount of data and discards 99.99 percent of it; it's par for the course in Business Intelligence systems in the private sector. Wal-Mart, for instance, does not need to retain indefinitely which transactions at particular times contain particular sets of items. After a year or so, the data is far less useful, and ever-larger datasets are harder to search and process. It makes perfect sense to completely discard the data after a certain period of time and have no provisions in the system to archive it on a long-term basis. (This whole concept is referred to as Information Lifecycle Management.)
A court order saying "Wal-Mart, keep all transaction data indefinitely, starting Right Now" is certainly going to result in Wal-Mart objecting on the grounds that it cannot do so without completely destroying it's business.
http://motherboard.vice.com/re...
The government appeared to want it both ways, Andrew Crocker, a legal fellow at the EFF, told Motherboard. "They said [the Internet data collected under the Foreign Intelligence Surveillance Court] is not relevant to our case, but they've also made statements, in asserting state secrets, that we touch on issues under the guidance of the FISC."
So I guess they bought into their own secure "cloud" and have the same issues regular customers do.
Tracy Johnson
Old fashioned text games hosted below:
http://empire.openmpe.com/
BT