This is one of the most irritating thing in IT. People think they can figure out law, accounting, fiscality, politics, marketing or diplomacy by using what they perceive as "common sense".
Here is the thing. All those disciplines are a gray area by nature, and the right answer is largely a matter of professional interpretation. Can you put that number in that column? Can you consider that such or such situation has caused actual damage to someone? There's no compiler to tell you if this is right or not, there's just people navigating a fuzzy field armed with their experience and knowledge. They live in a world where two people can have opposite opinions and be both right at the same time.
Anyone with a background in applied disciplines like IT or engineering is trained to look at things with a problem-solving angle. That's a great attitude, but unfortunately it sometimes make people overestimate their grasp of concepts that are outside of their area of expertise. It's a lot like those artists who have it all figured out (war, terrorism, pollution, crime, poverty). Case in point: this "enlightened" feedback from Ben Affleck during Bill Maher show: http://www.youtube.com/watch?v...
This reminds me of the anarchist scare in the 20s. The communist scare in the 50s. The nuclear holocaust in the 60s. Then the "Japan invasion" in the 80s. Then the death of the American manufacturing economy in the 90s (which is still the world's largest, believe it or not). Then the IT outsourcing to India in the 2000s. Etc.Etc.
The only constant in this culture is people who claim it's about to collapse.
You obviously have no experience working in the public sector. "The government" is not an organized entity with a secret agenda. It's a tapestry of independent organizations with conflicting interests managed by people with little or no incentive to implement the short term policy established by whoever is temporarily in charge as dictated by the random lobbies that got them elected.
The fact that you mention GCHQ leads me to believe that you are from the UK, because nobody outside that tiny island gives a shit about your local, watered-down version of an intelligence service. I wasn't even sure about the right order of the letters in that acronym, I had to double-check your post. That should tell you how meaningless they are. If it was not for James Bond movies nobody in the world would even know that you have spies. It's like if some dude from Italy was to come here and start spewing paranoid garbage about AISE hiring people to brag about spaghetti on Yahoo Answers. (Yeah, I had to google "italy intelligence agency" to find the name for that one).
In any event, I guess believing that "the government" is posting on Slashdot to shape public opinion is a security blanket for you. So keep up denouncing random people as shills of The System if that makes you happy. In the meantime I'll definitely look up that other conversation you mention because that's immensely fascinating; if you don't see me replying in that thread it will be because your points are too strong and convincing.
I'd actually say that I consider the MapReduce only focus as a limitation of Hadoop, but the fact that so many other tools have been built on top and so many things integrate is definitely a huge asset in its favor.
Most of the tools built on top of Hadoop use HDFS (the Hadoop filesystem) and no Map Reduce at all. I think you are a textbook example of someone who learned Hadoop by using HortonWorks and therefore has no idea what are the various underlying moving parts.
In SSIS (the ETL tool that comes with SQL Server), the default isolation level is serializable. People often use SSIS to stage data and/or feed a denormalized data warehouse.
Someone claiming that an analytics tool is causing locks in SQL Server does not know what they are talking about. The most recent BI engine from Microsoft (Tabular) does everything in-memory, and with the older one, which is OLAP-based, data is typicalled moved out of SQL Server and into a SSAS cube.
There's the possible scenario of someone deciding to use ROLAP; feeding a cube from a live production database. But if someone took pains to setup that kind of thing and yet used a locking isolation level, then he should not complain about it on Slashdot, he should RTFM.
I've seen it lock tables even on only reads causing other processes to be terminated.
That's because someone who does not understand how the product works has configured a serializable transaction isolation level. I would suggest to RTFM but maybe you need to start with the basics: http://en.wikipedia.org/wiki/I...
Because that kind of setup works mostly for highly specialized requirements, such as processing ad clicks or log files. That's totally different from a data warehouse, where you store a lot of data with the idea that users can do a bit of exploration and analysis on their own using client tools like Excel, Tableau or MicroStrategy.
There's 3 kinds of setup for Big Data:
1) Massively parallel processing, such as AWS Redshift or Google Big Query (or IBM Netezza if you have money). Those are regular databases on steroids and they let you query data on your own. Redshift is basically a huge multi-tenants Postgres cluster.
2) MapReduce, such as AWS EMR. This is more or less a clunky kind of ETL where you need to code every single question to which you want an answer. It scales well on the volume side (because of Hadoop distributed file system) but it is extremely tedious to implement and offers zero self-service capabilities for data analysts beyond what is hard-coded in your setup. The ETL language from Apache, Pig, is very basic - for just about everything you need to fire up Eclipse and write Java code. There are a few SQL frameworks that can sit on top of Hadoop, but none are blazing fast or immensely reliable, and for the most part with those SQL solutions it ends up being a cheapskate alternative to a proper DW.
3) Machine learning, such as Spark or Mahout (also based on Hadoop file system). Those also require extensive programming and typically won't offer clear answers, they are mostly useful to find trends or patterns. It's all the rage right now with "data scientist", just like MR was all the rage 3 years ago and did not really stick because it's too clunky. Again this is a scenario where you know what you are looking for, because you have to "train" your system for specific tasks.
HortonWorks is an all-inclusive Hadoop setup that includes most of what is needed for #2 or #3, but since AWS and Azure offer for pennies a totally scalable Hadoop environment, in my experience HortonWorks is for companies who want nothing to do with the cloud or for total newbies who want to see what is that Hadoop thing. But it does not offer the benefits of letting you learn what are the moving pieces because it comes all configured.
So unless you have a very specific set of reports of indicators and a shitload of data, the only serious answer is to keep doing what BI people have been doing for decades: build data warehouses and use a decent front-end that includes a flexible reporting platform and self-service capabilities (such as OLAP). And only if you have tons of data should you even bother with Big Data products, as none of those are cheap. Redshift is in the $1000-$5000/TB/year range. For a large organization that's nothing, but for some guy trying to start a vague BI initiative that's expensive.
When it comes to non-Big Data BI (i.e. something to setup on a few servers at most), the options are the following:
1) SQL Server and its built-in BI suite, or Oracle and its built-in BI suite. A bit expensive but very flexible. Not ideal for self-service unless you have experienced DBAs.
2) Any RDBMS + IBM Cognos or + SAP BusinessObjects. Expensive but you can define data universe then let users build their own reports. Ideal for self-service and for situations where you don't have a full time DBA who can write queries or build OLAP cubes.
3) A patchwork of FOSS: MySQL, Mondrian, Jasper, Talend, etc. Free but not integrated so it requires a bit of work.
Big Data != BI. It just means that you have more data that you could process on a regular database cluster. Even with social networks, ads and blogs, I haven't seen that many situations where this is truly needed.
Seriously, is it because of your upbringing, your religion, a fear of castration that you never got over, your politics, hidden worries about your own identity (that last is a frequent issue).
Pretty rich coming from a guy who pretends to be a girl on internet.
Absolutely this. "Oh, boo hoo. I'm such an activist, but I can't take the heat when the feds do a little tough talk."
Mitnick, Manning, and Snowden piss on this crybaby from great height.
Those other individuals you mention are an anarchist and two people who published confidential information that they stole from their employer - and one of those individuals conveniently discovered "her" true nature after being sent to military prison. I don't know what great height your refer to.
Anyways as an AC your opinion as to who can take heat or not is beyond ludicrous. Why don't you go back to jerking off on 4chan animated gifs and pwning Facebook accounts of 14 years old girls.
If I could just get to the point where someone would actually TALK to me and find out what I can do and just how good I am at writing code, I might have a chance...
Funny story about that.
A few years ago I was contacted for a DBA job. I went in for a technical interview; it was actually a written test, and the interviewer warned me that it was "very difficult". So I started answering the written questions and I was a bit puzzled because besides basic SQL questions there was a lot of.Net stuff (also very easy questions).
The next day the hiring manager called me and said that I had been given the wrong test: it was their test for senior.Net developers, and apparently I had the highest score they ever saw on their test. He said the job was mine if I wanted it. I declined, and they were really pissed so I figured I would not become their DBA either.
So here's the conclusion: if you want to get hired, apply for a totally different position and hope they make a mistake...
Seriously, I've just given up trying to go to events. If it's advertised and doesn't have a huge entrance fee and/or absurdly niche audience it will be a madhouse.
Like those rave parties, when one had to bring a blue sock to a specific parking attendant to get the address of the convenience store behind which a midget dressed like Mickey Mouse sold a map to the event that could only be seen under uv light.
I think the establishment looks at the top grossing apps on the various app stores and figures that the people buying that kind of product don't require clever lies and properly fabricated evidences to be manipulated.
As I said to the OP you're (correctly rebutting...) replying to, what is showing on a "television screen" is not a real good indicator of the actual time. It's "an" indicator, but you have to believe two things that are kinda common today : that she's not lying, and that she doesn't have a DVR.
What kind of DVR can playback tv shows from the future? Is that a MythTv plugin?
I think you are just trolling, I can tell because your subject line is becoming more and more whiny, but if you are indeed interested in this topic get the latest summer issue of the Army Technology Magazine.
This is truly fascinating. The army tried for years to build those exoskeletal kits but field testing always came back with the same issue of soldiers removing their headgear under stress. So they switched to a new model that focus on augmented reality instead of VR. It's a simple helmet with a flip-top device that they can easily get out of the way as needed. Still full face but it's a transparent window and it works better for regular soldiers.
Some air force pilot have been using VR goggles for a while (like in those high-tech stealth choppers) but pilots are a different breed of people.
This is why I think the windowless plane cannot work. The visual contact with outside world is crucial when most people get nervous. Even if it's just the idea of being able to look outside, it's needed.
No. This has nothing to do with citations (this is not wikipedia), this has to do with you being unable to understand the difference between full-face helmet worn by bikers and VR devices in suits like TALOS, even in the context of a discussion about windowless airplanes.
Slashdot Mirror
This is one of the most irritating thing in IT. People think they can figure out law, accounting, fiscality, politics, marketing or diplomacy by using what they perceive as "common sense".
Here is the thing. All those disciplines are a gray area by nature, and the right answer is largely a matter of professional interpretation. Can you put that number in that column? Can you consider that such or such situation has caused actual damage to someone? There's no compiler to tell you if this is right or not, there's just people navigating a fuzzy field armed with their experience and knowledge. They live in a world where two people can have opposite opinions and be both right at the same time.
Anyone with a background in applied disciplines like IT or engineering is trained to look at things with a problem-solving angle. That's a great attitude, but unfortunately it sometimes make people overestimate their grasp of concepts that are outside of their area of expertise. It's a lot like those artists who have it all figured out (war, terrorism, pollution, crime, poverty). Case in point: this "enlightened" feedback from Ben Affleck during Bill Maher show: http://www.youtube.com/watch?v...
Don't be that guy.
I'm sure there is a vast middle ground between the Rainbow Coalition and the KKK, but for some reason "tolerant people" appear not to see it that way.
Stop pretending that you are not a phony liberal, put your iPod earbuds back on, and go back to listening to MSNBC.
This reminds me of the anarchist scare in the 20s. The communist scare in the 50s. The nuclear holocaust in the 60s. Then the "Japan invasion" in the 80s. Then the death of the American manufacturing economy in the 90s (which is still the world's largest, believe it or not). Then the IT outsourcing to India in the 2000s. Etc.Etc.
The only constant in this culture is people who claim it's about to collapse.
Fouad, is that you?
http://familyguy.wikia.com/wik...
That's why Linux is so dangerous and is never used for mission-critical systems.
You obviously have no experience working in the public sector. "The government" is not an organized entity with a secret agenda. It's a tapestry of independent organizations with conflicting interests managed by people with little or no incentive to implement the short term policy established by whoever is temporarily in charge as dictated by the random lobbies that got them elected.
The fact that you mention GCHQ leads me to believe that you are from the UK, because nobody outside that tiny island gives a shit about your local, watered-down version of an intelligence service. I wasn't even sure about the right order of the letters in that acronym, I had to double-check your post. That should tell you how meaningless they are. If it was not for James Bond movies nobody in the world would even know that you have spies. It's like if some dude from Italy was to come here and start spewing paranoid garbage about AISE hiring people to brag about spaghetti on Yahoo Answers. (Yeah, I had to google "italy intelligence agency" to find the name for that one).
In any event, I guess believing that "the government" is posting on Slashdot to shape public opinion is a security blanket for you. So keep up denouncing random people as shills of The System if that makes you happy. In the meantime I'll definitely look up that other conversation you mention because that's immensely fascinating; if you don't see me replying in that thread it will be because your points are too strong and convincing.
If you really think that people who disagree with you are paid by a mysterious "employer", your life must be full of suspense and mystery. I envy you.
I'd actually say that I consider the MapReduce only focus as a limitation of Hadoop, but the fact that so many other tools have been built on top and so many things integrate is definitely a huge asset in its favor.
Most of the tools built on top of Hadoop use HDFS (the Hadoop filesystem) and no Map Reduce at all. I think you are a textbook example of someone who learned Hadoop by using HortonWorks and therefore has no idea what are the various underlying moving parts.
In SSIS (the ETL tool that comes with SQL Server), the default isolation level is serializable. People often use SSIS to stage data and/or feed a denormalized data warehouse.
Someone claiming that an analytics tool is causing locks in SQL Server does not know what they are talking about. The most recent BI engine from Microsoft (Tabular) does everything in-memory, and with the older one, which is OLAP-based, data is typicalled moved out of SQL Server and into a SSAS cube.
There's the possible scenario of someone deciding to use ROLAP; feeding a cube from a live production database. But if someone took pains to setup that kind of thing and yet used a locking isolation level, then he should not complain about it on Slashdot, he should RTFM.
I've seen it lock tables even on only reads causing other processes to be terminated.
That's because someone who does not understand how the product works has configured a serializable transaction isolation level. I would suggest to RTFM but maybe you need to start with the basics: http://en.wikipedia.org/wiki/I...
Because that kind of setup works mostly for highly specialized requirements, such as processing ad clicks or log files. That's totally different from a data warehouse, where you store a lot of data with the idea that users can do a bit of exploration and analysis on their own using client tools like Excel, Tableau or MicroStrategy.
There's 3 kinds of setup for Big Data:
1) Massively parallel processing, such as AWS Redshift or Google Big Query (or IBM Netezza if you have money). Those are regular databases on steroids and they let you query data on your own. Redshift is basically a huge multi-tenants Postgres cluster.
2) MapReduce, such as AWS EMR. This is more or less a clunky kind of ETL where you need to code every single question to which you want an answer. It scales well on the volume side (because of Hadoop distributed file system) but it is extremely tedious to implement and offers zero self-service capabilities for data analysts beyond what is hard-coded in your setup. The ETL language from Apache, Pig, is very basic - for just about everything you need to fire up Eclipse and write Java code. There are a few SQL frameworks that can sit on top of Hadoop, but none are blazing fast or immensely reliable, and for the most part with those SQL solutions it ends up being a cheapskate alternative to a proper DW.
3) Machine learning, such as Spark or Mahout (also based on Hadoop file system). Those also require extensive programming and typically won't offer clear answers, they are mostly useful to find trends or patterns. It's all the rage right now with "data scientist", just like MR was all the rage 3 years ago and did not really stick because it's too clunky. Again this is a scenario where you know what you are looking for, because you have to "train" your system for specific tasks.
HortonWorks is an all-inclusive Hadoop setup that includes most of what is needed for #2 or #3, but since AWS and Azure offer for pennies a totally scalable Hadoop environment, in my experience HortonWorks is for companies who want nothing to do with the cloud or for total newbies who want to see what is that Hadoop thing. But it does not offer the benefits of letting you learn what are the moving pieces because it comes all configured.
So unless you have a very specific set of reports of indicators and a shitload of data, the only serious answer is to keep doing what BI people have been doing for decades: build data warehouses and use a decent front-end that includes a flexible reporting platform and self-service capabilities (such as OLAP). And only if you have tons of data should you even bother with Big Data products, as none of those are cheap. Redshift is in the $1000-$5000/TB/year range. For a large organization that's nothing, but for some guy trying to start a vague BI initiative that's expensive.
When it comes to non-Big Data BI (i.e. something to setup on a few servers at most), the options are the following:
1) SQL Server and its built-in BI suite, or Oracle and its built-in BI suite. A bit expensive but very flexible. Not ideal for self-service unless you have experienced DBAs.
2) Any RDBMS + IBM Cognos or + SAP BusinessObjects. Expensive but you can define data universe then let users build their own reports. Ideal for self-service and for situations where you don't have a full time DBA who can write queries or build OLAP cubes.
3) A patchwork of FOSS: MySQL, Mondrian, Jasper, Talend, etc. Free but not integrated so it requires a bit of work.
Big Data != BI. It just means that you have more data that you could process on a regular database cluster. Even with social networks, ads and blogs, I haven't seen that many situations where this is truly needed.
Suicide-murder would be a lot more impressive than murder-suicide.
This is not a horrible legacy. Smokey and the Bandit Part 3 was a horrible legacy.
Seriously, is it because of your upbringing, your religion, a fear of castration that you never got over, your politics, hidden worries about your own identity (that last is a frequent issue).
Pretty rich coming from a guy who pretends to be a girl on internet.
Absolutely this. "Oh, boo hoo. I'm such an activist, but I can't take the heat when the feds do a little tough talk."
Mitnick, Manning, and Snowden piss on this crybaby from great height.
Those other individuals you mention are an anarchist and two people who published confidential information that they stole from their employer - and one of those individuals conveniently discovered "her" true nature after being sent to military prison. I don't know what great height your refer to.
Anyways as an AC your opinion as to who can take heat or not is beyond ludicrous. Why don't you go back to jerking off on 4chan animated gifs and pwning Facebook accounts of 14 years old girls.
If I could just get to the point where someone would actually TALK to me and find out what I can do and just how good I am at writing code, I might have a chance...
Funny story about that.
A few years ago I was contacted for a DBA job. I went in for a technical interview; it was actually a written test, and the interviewer warned me that it was "very difficult". So I started answering the written questions and I was a bit puzzled because besides basic SQL questions there was a lot of .Net stuff (also very easy questions).
The next day the hiring manager called me and said that I had been given the wrong test: it was their test for senior .Net developers, and apparently I had the highest score they ever saw on their test. He said the job was mine if I wanted it. I declined, and they were really pissed so I figured I would not become their DBA either.
So here's the conclusion: if you want to get hired, apply for a totally different position and hope they make a mistake...
OK. How?
Lots of stalking
Seriously, I've just given up trying to go to events. If it's advertised and doesn't have a huge entrance fee and/or absurdly niche audience it will be a madhouse.
Like those rave parties, when one had to bring a blue sock to a specific parking attendant to get the address of the convenience store behind which a midget dressed like Mickey Mouse sold a map to the event that could only be seen under uv light.
I think the establishment looks at the top grossing apps on the various app stores and figures that the people buying that kind of product don't require clever lies and properly fabricated evidences to be manipulated.
As I said to the OP you're (correctly rebutting...) replying to, what is showing on a "television screen" is not a real good indicator of the actual time.
It's "an" indicator, but you have to believe two things that are kinda common today : that she's not lying, and that she doesn't have a DVR.
What kind of DVR can playback tv shows from the future? Is that a MythTv plugin?
The only one deleting actual data in the video is her, herself.
It's the fight club syndrome!
Believe it or not, not all straight women like to do it either
If that's what women tell you, maybe you should consider showering more often. Or buy a bigger car.
I think you are just trolling, I can tell because your subject line is becoming more and more whiny, but if you are indeed interested in this topic get the latest summer issue of the Army Technology Magazine.
This is truly fascinating. The army tried for years to build those exoskeletal kits but field testing always came back with the same issue of soldiers removing their headgear under stress. So they switched to a new model that focus on augmented reality instead of VR. It's a simple helmet with a flip-top device that they can easily get out of the way as needed. Still full face but it's a transparent window and it works better for regular soldiers.
Some air force pilot have been using VR goggles for a while (like in those high-tech stealth choppers) but pilots are a different breed of people.
This is why I think the windowless plane cannot work. The visual contact with outside world is crucial when most people get nervous. Even if it's just the idea of being able to look outside, it's needed.
No. This has nothing to do with citations (this is not wikipedia), this has to do with you being unable to understand the difference between full-face helmet worn by bikers and VR devices in suits like TALOS, even in the context of a discussion about windowless airplanes.
On a suspended VM you cou;d patch Windows with VI without rebooting...