I love R and Python. However, both of them choke on big data sets. What they need is an in-built mechanism to store data on disk rather than in-memory. There are some really convoluted ways of doing this..but then dont always work with modeling packages that weren't written with the convoluted approach you are taking, in mind. So, if the base language has the ability to store object on disk, say with a simple flag, and its transparent to the rest of the system, most downstream libraries/packages would still work.
ff package in R is a good approach..maybe that should be adopted as the memory model for R.
I hate to say this but maybe R/Python can learn something from SAS here.
Or what are your interests? CS is a huge field and you probably like something specific to bother going for a Masters.
Also, almost every large company out there working on X (X being their area of specialization) needs CS people these days in R&D (and not just IT). So don't limit your search to Tech companies. Look at Financial Services, Healthcare, Media, Marketing etc. Since it's your first job, pick up the Fortune 500 list of companies and see if something excites you. A good majority of them have R&D depts.
And I really hope you are prepared to move and aren't stuck to one place geographically. If you want to solve interesting problems and not do mind-numbing work, use your CS degree to it's fullest. Don't go for IT career.
well..M&A deals are usually not all that they are touted about anyways. The only parties that actually benefits from M&As are the investment banks and the lawyers. Everyone else loses. Including the 2 merging/acq firms. So, if high testosterone in CEOs causes the M&A deals to fall through, so be it.
Production side: I would agree. However statistical differential equations? SAS is good for predefined "statistical analysis", not for solving partial differential equations. Almost all mechanical problems in aerospace (read fluids, solids, thermal, electro) are expressed as partial differential equations. solutions of these (baring a few special cases) require numerical methods. The most common of these methods are finite element, finite difference and finite volume. And each one of these has it numerous "schemes" for solving a particular class of PDE. The choice of scheme/method depends on the problem at hand. You can use a prepackaged tool like Fluent/Gambit. But that limits you to the limitations of those packages. Need anything cutting edge, or applicable to a special case, you need to program it yourself (c/c++/fortran). Most design houses have tons of legacy code that they build upon and add modules to deal with their specific problem. A lot of these run on linux clusters or unix big irons. I don't think they use gcc though. For performance sake most use proprietary compilers (eg pgc, icc etc). But no SAS.
Now, on the control systems side, most researchers use matlab, but most of the implementation is done using imbeded C or ADA.
As for SAS, they do now support freeware aka Linux. I have personally notice a sense of unease when SAS employees are asked about R. They are quick to dismiss it claiming the usual FUD and then change the topic. It is quite amusing actually. Happens everytime.
FTA "I think it addresses a niche market for high-end data analysts that want free, readily available code," said Anne H. Milley, director of technology product marketing at SAS. She adds, "We have customers who build engines for aircraft. I am happy they are not using freeware when I get on a jet.""
Seriously, does this person know what she is talking about?
1. Yes, CFD and Structural Analysis software is increasingly written using open source tools and run on open source OS (Linux running on clusters)
2. SAS is not used to design any part of the aircraft.
I have noticed SAS uses the same kind of FUD to counter R as M$ uses to counter Linux.
I had looked at ther work month ago when researching on writing my own N-body code.
So, basically this is an implementation of Fast multipole Method (used in N-body computaion). Tradationaly (or rather in it's naive form) N-body codes are of the order N^2. Fast multipole algorithm (and Barnes-Hut and multitudes of their derivatives) does this at NLogN or better. You can have various kinds physical phenomenon occuring between two bodies/particles/points (graviational, electromagnetic etc) and this problem solves the physics for millions (or billions of such particles making up a supernovae) The entire 3d space is broken down into a oct-tree. You can traverse down to a group of particles (or one particle in Barnes-Hut), and traverse up calculating the force. The basic idea is to make a group of particles a large distance act like a single particle when calculating it's potential on another particle. Mind you the particle here is really a loose definition. It's really the most granular subdivion of space you could afford to calculate. Hence the need for bigger computers for better accuracy.
The parallelism is MPI based. It's simpler to handle parallelism for nbody stuff compared to eulerian grid type problems.
I like darkslategrey background and wheat foreground. It used to be the default in emacs-x11 years ago. I have since adopted that for most of my text editors. Also, for terminal I prefer phosphorus green on black background. Both of these are pretty easy on my eyes.
Equally important for me is the terminal fort and the text editor font. After years of experimentation, I have settled on the Proggy programming fonts. They are perfect for me.
How did this turn into an OS debate? oh wait, this is slashdot. For that matter Powerpoint doesn't run on linux/bsd either. yeah yeah there is crossover/wine...but in essesnce it is still win32 binary.
The powerpoint I am forced to use at work doesn't export to pdf...I dont know what version/add you use.
I've been using keynote since I had to present my masters thesis and I've never looked at powerpoint again. Powerpoint is no where near keynote when it comes to ease of making slides, features, less cluttered look that lets you do your work. powerpoint does have it's advantage at being pretty much ubiquitous. But, I've fund keynotes import-export feature quite adequate. Oh and you can export slides to pdf, flash or quicktime as well.
a lot of people don't even know what 32 bit and 64 bit means. The concept of different binaries compiled against different cpu architectures is pretty hard to explain to someone with just a basic knowledge of point and shoot internet browsing and email.
the math is actually different... unless you have an idea of 3d vectors/direction cosines/direction angles...you will be lost trying to figure all the 3d stuff based on the knowledge of 2d geometry. similarly when you move to spherical trigonometry, all your knowledge of 2d geometry is pretty much useless.
there is limit on new h1bs (65000+20000). it is that simple. that doesn't mean that at any time there will be only 65000 h1bs working in the US. and l1s are an altogether differnet matter from h1bs...and so irrelevant to the ongoing discussion.
Those are not new H1bs. Thosee numbers include reapplications/renewals that H1bs have to do after first 3 years and then every year at the end of six years while their green cards are being processed. Plus you have to figure in all the post-docs/professors/research staff being hired by universities.
Even though I am an engineer, I'll disagree with you. Intel hires a lot of physics majors(MS/PhD). Besides,a lot of seminal work in microprocessors and semiconductors was done by physicists.
for eg. intel's first microprocessor (intel 4004) had 3 inventors.
Stanley Mazor (Senior Member, IEEE) studied mathematics at San Francisco State College
Federico Faggin, received a Laurea Degree in physics, summa cum laude, at the University of Padua, Italy
Dr. Marcian "Ted" Hoff, Ph.D. in Electrical Engineering from Stanford
so there you go.. you have an engineer, a mathematician and a physicist
The guy said that it is like a ford taurus hitting the target at 380 mph. Take this terminal stage energy and use it to calculate the terminal velocity of the projectile. It comes out to be nearly mach 10.8. Thats fast. A lot of ammo used against tank armor these days of this high energy/ no payload kind (for eg. Sabot rounds used by tank cannons and anti tank guns on aircrafts which have depleted uranium cores). These are definitely not as fast but are destructive non-the-less.
A weapon that relies on kinetic energy for destruction of target would have to be a ballistic kind, specially at close ranges where the time to reach target is a few seconds. control surfaces have to be very precise at hypersonic speeds or else like some one said earlier, one could miss by a few blocks. guided weapons are manuverable and rely on payloads for achieving objectives. A weapon like this rail gun is more effective against targets that are slightly over the horizon. That way it doesn't need guidance and it still has a lot of energy remaining (after wave/pressure/skin drag take into account) for it to be of any use.
You are forgetting that there are a ton of US companies doing business and selling their products to other countries. India pays a lot of money to buy US made industrial tools and soon it'll be buying US made millitary hardware that will keep some boeing/lockheed plant in US in operation. And then it'll pay boat loads of money to US techies to help them get the system running. Such is the nature of trade. Give and Take.
Another thing people don't realise is that it is not India which has trade surplus. Like US it is a net importer of goods and services. So what if it trying hard to keep that deficit down?
you may not realise this, but other countries want to develop and raise their stand of living too. We'll see who wins who loses and who put up against the wall and shot. meanwhile the sofware industry and now biotechnology and engineering services industry is doing pretty well and providing services to not only their countrymen but to rest of the world too.
India knows that knowledge is its best resource and it is exploiting it as best as it can.
too bad, the communists lose.
Dell or any other multinational company in India is not Incorporated in US/other country. They are usually, independent companies in which the parent company has majority stake. Rest could be traded or joint ownership with an Indian partner.
Slashdot Mirror
I love R and Python. However, both of them choke on big data sets. What they need is an in-built mechanism to store data on disk rather than in-memory. There are some really convoluted ways of doing this..but then dont always work with modeling packages that weren't written with the convoluted approach you are taking, in mind. So, if the base language has the ability to store object on disk, say with a simple flag, and its transparent to the rest of the system, most downstream libraries/packages would still work.
ff package in R is a good approach..maybe that should be adopted as the memory model for R.
I hate to say this but maybe R/Python can learn something from SAS here.
Apache Mahout is based on a Machine Learning using MapReduce paper by Andrew Ng (Stanford)
Or what are your interests? CS is a huge field and you probably like something specific to bother going for a Masters.
Also, almost every large company out there working on X (X being their area of specialization) needs CS people these days in R&D (and not just IT). So don't limit your search to Tech companies. Look at Financial Services, Healthcare, Media, Marketing etc. Since it's your first job, pick up the Fortune 500 list of companies and see if something excites you. A good majority of them have R&D depts.
And I really hope you are prepared to move and aren't stuck to one place geographically. If you want to solve interesting problems and not do mind-numbing work, use your CS degree to it's fullest. Don't go for IT career.
Or it might be a semi-april fools joke...you know we are six month out and six month in from fools day :)
well..M&A deals are usually not all that they are touted about anyways. The only parties that actually benefits from M&As are the investment banks and the lawyers. Everyone else loses. Including the 2 merging/acq firms. So, if high testosterone in CEOs causes the M&A deals to fall through, so be it.
Production side: I would agree. However statistical differential equations? SAS is good for predefined "statistical analysis", not for solving partial differential equations. Almost all mechanical problems in aerospace (read fluids, solids, thermal, electro) are expressed as partial differential equations. solutions of these (baring a few special cases) require numerical methods. The most common of these methods are finite element, finite difference and finite volume.
And each one of these has it numerous "schemes" for solving a particular class of PDE. The choice of scheme/method depends on the problem at hand. You can use a prepackaged tool like Fluent/Gambit. But that limits you to the limitations of those packages. Need anything cutting edge, or applicable to a special case, you need to program it yourself (c/c++/fortran). Most design houses have tons of legacy code that they build upon and add modules to deal with their specific problem. A lot of these run on linux clusters or unix big irons. I don't think they use gcc though. For performance sake most use proprietary compilers (eg pgc, icc etc). But no SAS.
Now, on the control systems side, most researchers use matlab, but most of the implementation is done using imbeded C or ADA.
As for SAS, they do now support freeware aka Linux.
I have personally notice a sense of unease when SAS employees are asked about R. They are quick to dismiss it claiming the usual FUD and then change the topic. It is quite amusing actually. Happens everytime.
FTA
"I think it addresses a niche market for high-end data analysts that want free, readily available code," said Anne H. Milley, director of technology product marketing at SAS. She adds, "We have customers who build engines for aircraft. I am happy they are not using freeware when I get on a jet.""
Seriously, does this person know what she is talking about?
1. Yes, CFD and Structural Analysis software is increasingly written using open source tools and run on open source OS (Linux running on clusters)
2. SAS is not used to design any part of the aircraft.
I have noticed SAS uses the same kind of FUD to counter R as M$ uses to counter Linux.
you obviously didn't go to an IIT.
I had looked at ther work month ago when researching on writing my own N-body code. So, basically this is an implementation of Fast multipole Method (used in N-body computaion). Tradationaly (or rather in it's naive form) N-body codes are of the order N^2. Fast multipole algorithm (and Barnes-Hut and multitudes of their derivatives) does this at NLogN or better. You can have various kinds physical phenomenon occuring between two bodies/particles/points (graviational, electromagnetic etc) and this problem solves the physics for millions (or billions of such particles making up a supernovae) The entire 3d space is broken down into a oct-tree. You can traverse down to a group of particles (or one particle in Barnes-Hut), and traverse up calculating the force. The basic idea is to make a group of particles a large distance act like a single particle when calculating it's potential on another particle. Mind you the particle here is really a loose definition. It's really the most granular subdivion of space you could afford to calculate. Hence the need for bigger computers for better accuracy. The parallelism is MPI based. It's simpler to handle parallelism for nbody stuff compared to eulerian grid type problems.
I like darkslategrey background and wheat foreground. It used to be the default in emacs-x11 years ago. I have since adopted that for most of my text editors. Also, for terminal I prefer phosphorus green on black background. Both of these are pretty easy on my eyes. Equally important for me is the terminal fort and the text editor font. After years of experimentation, I have settled on the Proggy programming fonts. They are perfect for me.
How did this turn into an OS debate? oh wait, this is slashdot. For that matter Powerpoint doesn't run on linux/bsd either. yeah yeah there is crossover/wine...but in essesnce it is still win32 binary. The powerpoint I am forced to use at work doesn't export to pdf...I dont know what version/add you use.
I've been using keynote since I had to present my masters thesis and I've never looked at powerpoint again. Powerpoint is no where near keynote when it comes to ease of making slides, features, less cluttered look that lets you do your work. powerpoint does have it's advantage at being pretty much ubiquitous. But, I've fund keynotes import-export feature quite adequate. Oh and you can export slides to pdf, flash or quicktime as well.
Thats exactly what I thought.....this isn't a new feature in FF3. it was a new feature in FF2.
a lot of people don't even know what 32 bit and 64 bit means. The concept of different binaries compiled against different cpu architectures is pretty hard to explain to someone with just a basic knowledge of point and shoot internet browsing and email.
the math is actually different... unless you have an idea of 3d vectors/direction cosines/direction angles...you will be lost trying to figure all the 3d stuff based on the knowledge of 2d geometry. similarly when you move to spherical trigonometry, all your knowledge of 2d geometry is pretty much useless.
there is limit on new h1bs (65000+20000). it is that simple. that doesn't mean that at any time there will be only 65000 h1bs working in the US. and l1s are an altogether differnet matter from h1bs...and so irrelevant to the ongoing discussion.
Those are not new H1bs. Thosee numbers include reapplications/renewals that H1bs have to do after first 3 years and then every year at the end of six years while their green cards are being processed. Plus you have to figure in all the post-docs/professors/research staff being hired by universities.
The completely free market will move the development shop entirely overseas. It is happening now although to a lesser degree.
for eg. intel's first microprocessor (intel 4004) had 3 inventors.
Stanley Mazor (Senior Member, IEEE) studied mathematics at San Francisco State College
Federico Faggin, received a Laurea Degree in physics, summa cum laude, at the University of Padua, Italy
Dr. Marcian "Ted" Hoff, Ph.D. in Electrical Engineering from Stanford
so there you go.. you have an engineer, a mathematician and a physicist
that explosion is a chemical reaction. all it does it make a lot gas really fast. what you hear is still the sonic boom.
The guy said that it is like a ford taurus hitting the target at 380 mph. Take this terminal stage energy and use it to calculate the terminal velocity of the projectile. It comes out to be nearly mach 10.8. Thats fast. A lot of ammo used against tank armor these days of this high energy/ no payload kind (for eg. Sabot rounds used by tank cannons and anti tank guns on aircrafts which have depleted uranium cores). These are definitely not as fast but are destructive non-the-less. A weapon that relies on kinetic energy for destruction of target would have to be a ballistic kind, specially at close ranges where the time to reach target is a few seconds. control surfaces have to be very precise at hypersonic speeds or else like some one said earlier, one could miss by a few blocks. guided weapons are manuverable and rely on payloads for achieving objectives. A weapon like this rail gun is more effective against targets that are slightly over the horizon. That way it doesn't need guidance and it still has a lot of energy remaining (after wave/pressure/skin drag take into account) for it to be of any use.
so things are improving afterall. seems like offshoring isn't that bad.
You are forgetting that there are a ton of US companies doing business and selling their products to other countries. India pays a lot of money to buy US made industrial tools and soon it'll be buying US made millitary hardware that will keep some boeing/lockheed plant in US in operation. And then it'll pay boat loads of money to US techies to help them get the system running. Such is the nature of trade. Give and Take. Another thing people don't realise is that it is not India which has trade surplus. Like US it is a net importer of goods and services. So what if it trying hard to keep that deficit down?
you may not realise this, but other countries want to develop and raise their stand of living too. We'll see who wins who loses and who put up against the wall and shot. meanwhile the sofware industry and now biotechnology and engineering services industry is doing pretty well and providing services to not only their countrymen but to rest of the world too. India knows that knowledge is its best resource and it is exploiting it as best as it can. too bad, the communists lose.
Dell or any other multinational company in India is not Incorporated in US/other country. They are usually, independent companies in which the parent company has majority stake. Rest could be traded or joint ownership with an Indian partner.