I'm sick of talking about this... who cares what it is? Potential Possibilities:
A). Malware--Another piece of malware on a windows system... who cares... they deserve it if they use windows (and by that I mean it's only a matter of time until they caught something else anyways)
B). Virus -- a yet unidentified virus etc. Once again, who cares, there are millions of these things out there.
C). Symantec Rootkit -- once again, who cares, people have got to be snorting something if you don't think feds have surveillance code in windows to start with... it's just one more group monitoring us; big deal.
Either way, I'm just tired of reading about it on all the websites I frequent and I'm looking forward to laughing about this later when someone does figure out which of the above it was (the solution to which also does not affect me).
It sounds to me like you need to better define the criteria which require a NAS. Whenever looking into new equipment it's always helpful to define the ideal situation in which your new equipment would function... for me based on what you mentioned I would say the ideal would be:
-0 wait time for transfer
-Portability of data
At no point did you mention other people needing the data while you're running the tests. Based on those criteria I would shy away from a NAS. Unless you're willing to shell out a grand for a Linux solution, a 1 TB external drive with an eSata connection will be ~$900 cheaper and possibly perform better to those criteria above. When you're not doing the testing you can simply plug it into an idle machine for people access the data over the network and to perform backups.
I'm a big fan of home-brewed Linux Raid NAS solutions, I setup and maintain a few myself for several different organizations and I regularly transfer 100+ gig dumps of files... however I would avoid doing all of this if I could. Keep it simple... it's much easier to just carry the data with you from machine to machine if your files are exceedingly large... after all HD's are cheap now-a-days.
On another note if you do insist on a NAS, one thing I've noticed is that Filesizes can easily affect transfer rates. The smaller the average filesize, the larger the individual overhead is in comparison to the file. In other words if you're transferring 100meg files and the overhead is a theoretical 1kb then the majority of time is spent moving the file but if you're transferring 1kb files and the overhead is still 1kb then you spend just as much time on the overhead as on the files themselves.
One trick I've learned to speed large transfers of small files along is to turn your files into a storage-level-compression tarball on the fly with a blowfish cipher and pipe the output over ssh to the other machine, where it is disassembled on the fly as well. This means that you're only transferring one file across the pipe and there is less overhead to the total transfer. This trick keeps the transfer rate on my machines steady at around 10-20mb/s as opposed to 6-7mb/s and those numbers are on a standard configuration with no special hd's or raid implemented. I can only expect the numbers to be better with raid. Just things to think about.
I knew there must have been a command for that, and I use CD soooo much... I wish I would have known that one... I wonder how many seconds I've wasted throughout my life typing previous file trees.
After having read the Ubuntu forums I was flat out disgusted at how Foxconn responded to the customer. I have never received a response so rude from tech support. They outright told him to stop sending them e-mail because they did not want to address his problem. Nevermind their poor products... how about their customer service? That is pitiful and they fully deserve whatever comes their way.
Interesting analysis. You've nailed it on the head I feel.
As the open-source movement takes a deeper integration into our economy the natural order of business will be to "follow the buck"-- if there's no money in producing software there's another revenue stream created as a result. It just merely takes a clever business to spot it; most American businesses are slow to change and do not know their customers (as can be evidenced by the American automobile industry's horrible market position currently as well as the plethora of consumer electronics firms releasing products in asia before America). Americans it seems have made a name for themselves as stubborn in the business world. They want something that is "tried and true" in all situations often times ignoring new advances in product lines just to stick with what they know. It is of no surprise to me that certain software developers are complaining about the open source movement. The movement for them-- has and will continue to strip them of their jobs. Until they get creative they will continue to be cattle. The realization of an open-source software market is the realization (in the business world) of a shift in software development from a product-oriented business framework to that of a SERVICE-oriented business framework. Product-support and accessorizing become the bottom line when the products are free. It comes back to the end-user at this point. Open-source software is beneficial to the end-user because it puts the power in the hands of the people. Business just need to catch up and realize that open-source is here to stay and modify their business plans accordingly.
Slashdot Mirror
begin::apathy
/apathy
I'm sick of talking about this... who cares what it is? Potential Possibilities:
A). Malware--Another piece of malware on a windows system... who cares... they deserve it if they use windows (and by that I mean it's only a matter of time until they caught something else anyways)
B). Virus -- a yet unidentified virus etc. Once again, who cares, there are millions of these things out there.
C). Symantec Rootkit -- once again, who cares, people have got to be snorting something if you don't think feds have surveillance code in windows to start with... it's just one more group monitoring us; big deal.
Either way, I'm just tired of reading about it on all the websites I frequent and I'm looking forward to laughing about this later when someone does figure out which of the above it was (the solution to which also does not affect me).
It sounds to me like you need to better define the criteria which require a NAS. Whenever looking into new equipment it's always helpful to define the ideal situation in which your new equipment would function... for me based on what you mentioned I would say the ideal would be:
-0 wait time for transfer
-Portability of data
At no point did you mention other people needing the data while you're running the tests. Based on those criteria I would shy away from a NAS. Unless you're willing to shell out a grand for a Linux solution, a 1 TB external drive with an eSata connection will be ~$900 cheaper and possibly perform better to those criteria above. When you're not doing the testing you can simply plug it into an idle machine for people access the data over the network and to perform backups.
I'm a big fan of home-brewed Linux Raid NAS solutions, I setup and maintain a few myself for several different organizations and I regularly transfer 100+ gig dumps of files... however I would avoid doing all of this if I could. Keep it simple... it's much easier to just carry the data with you from machine to machine if your files are exceedingly large... after all HD's are cheap now-a-days.
On another note if you do insist on a NAS, one thing I've noticed is that Filesizes can easily affect transfer rates. The smaller the average filesize, the larger the individual overhead is in comparison to the file. In other words if you're transferring 100meg files and the overhead is a theoretical 1kb then the majority of time is spent moving the file but if you're transferring 1kb files and the overhead is still 1kb then you spend just as much time on the overhead as on the files themselves.
One trick I've learned to speed large transfers of small files along is to turn your files into a storage-level-compression tarball on the fly with a blowfish cipher and pipe the output over ssh to the other machine, where it is disassembled on the fly as well. This means that you're only transferring one file across the pipe and there is less overhead to the total transfer. This trick keeps the transfer rate on my machines steady at around 10-20mb/s as opposed to 6-7mb/s and those numbers are on a standard configuration with no special hd's or raid implemented. I can only expect the numbers to be better with raid. Just things to think about.
I knew there must have been a command for that, and I use CD soooo much... I wish I would have known that one... I wonder how many seconds I've wasted throughout my life typing previous file trees.
After having read the Ubuntu forums I was flat out disgusted at how Foxconn responded to the customer. I have never received a response so rude from tech support. They outright told him to stop sending them e-mail because they did not want to address his problem. Nevermind their poor products... how about their customer service? That is pitiful and they fully deserve whatever comes their way.
Interesting analysis. You've nailed it on the head I feel. As the open-source movement takes a deeper integration into our economy the natural order of business will be to "follow the buck"-- if there's no money in producing software there's another revenue stream created as a result. It just merely takes a clever business to spot it; most American businesses are slow to change and do not know their customers (as can be evidenced by the American automobile industry's horrible market position currently as well as the plethora of consumer electronics firms releasing products in asia before America). Americans it seems have made a name for themselves as stubborn in the business world. They want something that is "tried and true" in all situations often times ignoring new advances in product lines just to stick with what they know. It is of no surprise to me that certain software developers are complaining about the open source movement. The movement for them-- has and will continue to strip them of their jobs. Until they get creative they will continue to be cattle. The realization of an open-source software market is the realization (in the business world) of a shift in software development from a product-oriented business framework to that of a SERVICE-oriented business framework. Product-support and accessorizing become the bottom line when the products are free. It comes back to the end-user at this point. Open-source software is beneficial to the end-user because it puts the power in the hands of the people. Business just need to catch up and realize that open-source is here to stay and modify their business plans accordingly.