Slashdot Mirror
Domain: monash.com
Stories and comments across the archive that link to monash.com.
Stories · 6
-
Web Analytics Databases Get Even Larger
CurtMonash writes "Web analytics databases are getting even larger. eBay now has a 6 1/2 petabyte warehouse running on Greenplum — user data — to go with its more established 2 1/2 petabyte Teradata system. Between the two databases, the metrics are enormous — 17 trillion rows, 150 billion new rows per day, millions of queries per day, and so on. Meanwhile, Facebook has 2 1/2 petabytes managed by Hadoop, not running on a conventional DBMS at all, Yahoo has over a petabyte (on a homegrown system), and Fox/MySpace has two different multi-hundred terabyte systems (Greenplum and Aster Data nCluster). eBay and Fox are the two Greenplum customers I wrote in about last August, when they both seemed to be headed to the petabyte range in a hurry. These are basically all web log/clickstream databases, except that network event data is even more voluminous than the pure clickstream stuff." -
EHR Privacy Debate Heats Up
CurtMonash writes "The New York Times reports on President-Elect Obama's continued commitment to electronic health records (EHRs), which on the whole are a great idea. The article cites a number of legislative initiatives to deal with the privacy risks of EHRs. That's where things start to go astray. The proposals seem to focus on simply controlling the flow of information, but from a defense-in-depth standpoint, that's not enough. Medical care is full of information waivers, much like EULAs, only with your health at stake. What's more, any information control regime has to have exceptions for medical emergencies — but where legitimate emergencies are routine, socially-engineered fake emergencies can blast security to smithereens. So medical information privacy will never be adequate unless there are strong usage-control rules as well, in areas such as discrimination, marketing, or tabloid-press publication. I've provided some ideas as to how and why that could work well." -
Solving Obama's BlackBerry Dilemma
CurtMonash writes "Much is being made of the deliberations as to whether President Obama will be able to keep using his beloved "BarackBerry." As the NYTimes details, there are two major sets of objections: infosecurity and legal/records retention. Deven Coldeway of CrunchGear does a good job of showing that the technological infosecurity problems can be solved. And as I've noted elsewhere, the 'Omigod, he left his Blackberry behind at dinner' issue is absurd. Presidents are surrounded by attendants, Secret Service and otherwise. Somebody just has to be given the job of keeping track of the president's personal communication device. As for the legal question of whether the president can afford to put things in writing that will likely be exposed by courts and archivists later — the answer to that surely depends on the subject matter or recipient. Email to his Chicago friends — why not? Anything he'd write to them would be necessarily non-secret anyway. Email to the Secretary of Defense? That might be a different matter." -
Should the United States' New CTO Really Be a CIO?
CurtMonash writes "Barack Obama promised to appoint the United States' first Chief Technology Officer. Naturally, the blogosphere is full of discussion as to who that should be. I favor American Management Systems founder and former IRS Commissioner Charles Rossotti. Richard Koman thinks it should be one of the better state CTOs. John Doerr, going in a different direction, thinks it should be his partner Bill Joy. We can bandy names back and forth all month, but first a more fundamental question needs to be answered: What do we need most — a get-things-done CIO (Chief Information Officer), or a more visionary true CTO? I think it's a CIO, and based on his campaign statements it appears Obama agrees. Management of government IT is a huge, generally unsolved problem, and we need somebody deeply experienced to have a fighting chance. Of course, that doesn't preclude recruiting a visionary CTO in addition, but the highest priority is a CIO. What do you think?" -
eBay Makes Huge Gains In Parallel Efficiency
CurtMonash writes "Parallel Efficiency is a simple metric that divides the actual work your parallel CPUs do by the sum of their total capacity. If you can get your parallel efficiency up, it's like getting free servers, free floor space, and some free power as well. eBay reports that it amazed even itself by increasing overall PE from 50% to 80% in about 6 months — across tens of thousands of servers. The secret sauce was data warehouse-based analytics. I.e., eBay instrumented its own network to do minute-by-minute status checks, then crunched the resulting data to find bottlenecks that needed removing. Obviously, savings are in the many millions of dollars. eBay has been offering some glimpses into its analytic efforts this year, and the PE savings are one of the most concrete examples they're offering to validate all this analytic cleverness." -
Enterprise Software Sales Dried Up In September
CurtMonash writes "As I predicted a week ago, it looks as if the third quarter was ugly for software vendors, due to the economic crisis. SAP said 'The market developments of the past several weeks have been dramatic and worrying to many businesses. These concerns triggered a very sudden and unexpected drop in business activity at the end of the quarter.' My old acquaintance John Treadway, who used to work in Sybase's financial services vertical unit, reports that things are even worse than that in the financial services industry, Wall Street and retail banks alike. So now what? Well, IT is a huge part of capital spending, and at enterprises that have to cut back capital spending, IT is going to get hurt. On the other hand, high-growth companies — Web businesses, analytic services providers, etc. — may try to power through the downturn. And the more directly an IT project affects near-term profits, the more likely it is to survive."