Slashdot Mirror


Wall St. Trading Servers To Power Off-Hour Clouds?

miller60 writes "As cloud computing gains traction, some Wall Street firms running armadas of servers to power high-frequency trading operations are contemplating leasing out their excess computing capacity after the trading day ends at 4 p.m. 'Once 4:30 rolls around, we don't need those machines,' said one CTO of a market data firm. 'There may be an opportunity there.' A similar revelation led to the creation of the cloud computing operation at Amazon.com, which built its infrastructure to handle peak Christmas-season loads that lasted just a few weeks each year."

44 of 208 comments (clear)

  1. Is This Secure? by WrongSizeGlass · · Score: 5, Interesting

    I wonder if this poses any security concerns or problems? Is letting 'cloud users' access the servers that run out financial markets really a good idea?

    1. Re:Is This Secure? by DJoffe · · Score: 2, Interesting

      Is letting 'cloud users' access the servers that run out financial markets really a good idea?

      No.

    2. Re:Is This Secure? by LostCluster · · Score: 2, Informative

      We've already got Virutal Machine tech and several other ways of saying "Don't cross this line!" so unless it's implemented by an idiot I'd say we'll be okay.

    3. Re:Is This Secure? by Anonymous Coward · · Score: 2, Insightful

      I wonder if this poses any security concerns or problems? Is letting 'cloud users' access the servers that run out financial markets really a good idea?

      You pose a good question. The answer is: It's all in the implementation.

      a. What do these wall-street computers do? Seriously. Do these servers store data about stocks? Are they merely high throughput, low latency information distribution machines? In order to figure out if it's a security threat, we need these answers

      If no data is being stored on these machines, then I see no reason why they can't wipe the VM and let it load up some default image. From there, it can do tons of cloud computing stuff.

      But in the same regard, there have been articles on Slashdot about compromising a VM. I'm sure that it's low risk, but it would have to be a very targeted attack against a firm.

      We need more data.

    4. Re:Is This Secure? by sopssa · · Score: 5, Insightful

      But Virtual Machine's are only as good as they're designed. Even the most known and biggest vendor VMWare has had serious bug and exploits in their software. For one example see this, which let an exe running in the guest OS exploit a vulnerability in the VM code to get code run in the host OS. A serious security risk, especially when were talking about Wall Street. Even getting an access to their internal network opens new possibilities.

      Just because of this I think it's a stupid idea. Even more so because the gain is not really that much, but it can be really destructive. Someone will find a way to exploit it.

    5. Re:Is This Secure? by Huh? · · Score: 4, Insightful

      I could see this being useful as some sort of "private" cloud during off hours (i.e. selling time to banks for batch and accrual operations...etc), but allowing the unwashed masses access to the underlying infrastructure of something as important as financial trading just seems like a recipe for a security disaster.

    6. Re:Is This Secure? by toastar · · Score: 2, Informative

      Is letting 'cloud users' access the servers that run out financial markets really a good idea?

      No.

      Citation needed.

      The NAS and compute cores just need to be separate systems

    7. Re:Is This Secure? by c0d3g33k · · Score: 2, Informative

      Is letting 'cloud users' access the servers that run out financial markets really a good idea?

      No.

      Citation needed.

      http://www.answers.com/topic/common-sense

    8. Re:Is This Secure? by icebraining · · Score: 2, Interesting

      IANASA*, but wouldn't putting the data servers (DB servers?) in separate machines and physically disconnecting the power before allowing access to the other machines be enough?

      * I Am Not A Sys Admin

    9. Re:Is This Secure? by Hooya · · Score: 3, Insightful

      You could have the exploit install something into the host OS and have it run when the regular stuff is back on and connected.

    10. Re:Is This Secure? by davester666 · · Score: 2, Insightful

      You are making the argument that they should go ahead with this because it is possible they COULD implement [and maintain] some kind of cloud setup while keeping their core financial setup completely secure and functional, ready to go each day at 8:30 am or whenever.

      Yes, they COULD do it. It is theoretically possible.

      Experience, history, bone-crushingly stupid decisions by the financial industry [hello, welcome to the recession, would you mind giving us $100 billion just to tide us over for the next year or so] say no, they don't have permission to do this. And it seems we need someone more powerful than any of the 3 branches of the US gov't to make sure they don't do it.

      And by "bone-crushingly stupid decisions", I mean making decisions that result in the entire world going into financial difficulty. Of course, these same decisions made a whole lot of individuals incredibly wealthy, with evidently no significant downside for them.

      --
      Sleep your way to a whiter smile...date a dentist!
  2. Security nightmare by UndyingShadow · · Score: 3, Insightful

    This seems like a security nightmare waiting to happen. I understand everything would likely be virtualized, but it just makes me nervous that you would be able to rent time on servers that interact with the stock market, especially considering how panicky the market can be, and how badly everyone suffers when it does panic.

    1. Re:Security nightmare by Tanktalus · · Score: 2, Insightful

      There is no such thing as perfectly-secure. They could already be hacked today, this isn't changing that. It merely introduces a new attack vector: the VM sandbox.

      If the ROI is there, this can be mitigated. If they create a cloud using their existing hardware, and move their own apps into a priority cloud on that hardware, and sell the excess CPU time, then not only does an attacker need to figure out what VM they are in, and what, if any, vulnerabilities there are in that VM that they can exploit, they have to cause the parent virtual machine (let's face it, there's no reason why a virtual cloud needs to be sitting on physical hardware directly - and, for this purpose, AIX, Sun, and the mainframe are already on virtual machines anyway) to run arbitrary code that would then go and find other virtual machines, find the one of interest, and then cause THAT virtual machine to give up information.

      Breaking IN to a virtual machine might prove more difficult than breaking OUT of a virtual machine. And you may need to break in to all of them just to find the one you need.

      Security by obscurity isn't the same as no security. It's not perfect, but it does reduce the exposure.

      And, besides, maybe they only sell CPU time to other corporations where they can better track who has access to what, with passworded VPNs that only go directly to the cloud that the password given grants access to.

      It's all about ROI, and whether they can make it work while improving their overall financial picture. I bet they can. I'm not betting whether they do or not.

  3. Not a new idea... by LostCluster · · Score: 5, Interesting

    Compuserve was founded by a life insurance company to make a consumer service run on their business systems with the expectation that the consumers would use it during non-working hours.

    When it comes down to it, nobody needs their clock cycles 24/7 at even load, even though that's what computers are designed to do. Shared services for the win!

    1. Re:Not a new idea... by geekoid · · Score: 2, Informative

      " nobody needs their clock cycles 24/7"
      What about computers the service cloud computing?

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
  4. heh...yeah. by Pojut · · Score: 4, Funny

    $20 says this idea was cooked up by someone who heard about "cloud computing" on the radio while in his cushy office, signing official looking papers and making a big fuss about "revenue".

  5. Wow by dachshund · · Score: 3, Insightful

    I sure hope Wall Street is utterly confident in the security of their operating systems, VMs, low-level peripheral firmware, etc. Because if they're not absolutely confident, they should treat all of those machines as potentially untrusted from the moment they open them up to the world. This holds even if they constantly re-image.

    When you're talking about the kind of money Wall Street stands to lose from a clever security breach, no amount of paranoia is too ridiculous.

  6. Get rid of them entirely by TubeSteak · · Score: 4, Insightful

    Not to derail the conversation, but high frequency trading doesn't contribute much to the stock market's ability to set optimal prices.

    What actually happens is that high frequency traders squeeze in while prices are moving and they siphon off money. Neither the original seller, nor the original buyer gets the best price, and the high frequency traders make a mint.

    --
    [Fuck Beta]
    o0t!
    1. Re:Get rid of them entirely by wjousts · · Score: 3, Interesting

      Exactly this. High frequency trading really perverts what the markets are for. Make a law that you have to hold a stock for at least a day (maybe even just an hour would work) and you might restore some sanity to the market as well as giving those traders who don't have server farms running advanced trading algorithms a fighting chance.

    2. Re:Get rid of them entirely by LostCluster · · Score: 2, Insightful

      Yep. Market regulations are all about a "level playing field"... no using information others can't get yet for trades. Just ask Martha Stewart.

      I really think a rate limit that makes high-frequency trading impossible is a good idea. Just like the TV ad goes, why do you want to sell something you just bought in an auction? Everybody in the room already said they wouldn't pay what you paid.

    3. Re:Get rid of them entirely by Anonymous Coward · · Score: 2, Interesting

      Not really. Someone has to quote a bid and an ask all day long, quickly so you get your shares when you want. And with competition between high frequency players trying to extract a spread or rebate, you get some pretty tight spreads giving you a good execution price without you having to pay the hidden cost of the spread. Most heavy volume stocks are a penny wide.

      Second, no one can "siphon off" money without taking a risk. Prices moving don't imply "free money" for the taking and there is substantial risk involved. No one in the market gets compensated for zero risk. It's like any other business where people take risks with their capital to provide you with a service. In this case, that service is providing you with liquidity.

    4. Re:Get rid of them entirely by TubeSteak · · Score: 4, Interesting

      Exactly this. High frequency trading really perverts what the markets are for. Make a law that you have to hold a stock for at least a day (maybe even just an hour would work) and you might restore some sanity to the market as well as giving those traders who don't have server farms running advanced trading algorithms a fighting chance.

      You'd only have to slow them down by a second (literally 1 second) to completely bring their business model to a halt.

      HFTs buy zero second data feeds from an exchange and some exchanges actually sell pre-zero-sec access.
      Meaning that the HFTs can see trades a few hundred milliseconds before they post, allowing the trader to sneak in and buy/sell.
      The SEC is looking to ban the practice, but hasn't gotten around to doing so yet.

      --
      [Fuck Beta]
      o0t!
    5. Re:Get rid of them entirely by jackchance · · Score: 2, Interesting

      Make a law that you have to hold a stock for at least a day

      That's an interesting idea. But it's obviously flawed. Let's say i buy some pharma stock at 9am. At 12 pm the FDA announces that they have found that pharma's main product to be dangerous. Should I not be allowed to sell?

      I would argue that derivative speculation and complicated leveraging packages are what make the market insane.
      Other people have made similar comments.

      --
      1 1 2 3 5 8 13 21 34 55 89 144 233 377 610 987 1597 2584 4181 6765
    6. Re:Get rid of them entirely by afidel · · Score: 2, Informative

      Because the entire idea of the SEC is that all information is to be known by all parties at roughly the same time, it's why insider trading is illegal for instance.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
  7. "Once 4:30 rolls around..." by mcmonkey · · Score: 4, Insightful

    Said the CTO who is now looking for a job.

    NYSE closes at 4:30. But there are other markets. And the data flows 24/7.

    There is no reason for these systems to have spare cycles.

    1. Re:"Once 4:30 rolls around..." by keithpreston · · Score: 3, Informative

      Location is the reason these system have spare cycles. They build data centers across the street from the market so that they have the lowest latency access to the market (it matters for high frequency trading). A data center on Wall Street is useless for other markets.

    2. Re:"Once 4:30 rolls around..." by eastlight_jim · · Score: 5, Interesting

      Believe it or not, trading by computer has now become so quick that companies vie for server space closer and closer to the place where trades are taking place. This article" even goes as far as suggesting that a 1 millisecond advantage in trading applications can be worth $100 million a year to a major brokerage firm with such low-latency trading becoming more common.

      I think the ping to Asia may be a bit more than that!

    3. Re:"Once 4:30 rolls around..." by mystik · · Score: 3, Informative

      These High-Frequency trading systems require sub-second responses from the market servers. They're usually collocated in the same structure as the marketing servers, and firms pay handsomely for that kind of space and network access.

      When that market closes, you don't want these machines trading overseas, the latency to reach those servers would negate the entire purpose of these machines.

      --
      Why aren't you encrypting your e-mail?
    4. Re:"Once 4:30 rolls around..." by NeumannCons · · Score: 2, Insightful

      It's my understanding that the high frequency traders need machines that are physically near to the market they're trading stocks on to minimize hops, lag, etc. and to chronologically beat everyone else who's trying to do the same. Everything is built to make transactions that can be executed almost immediately to take advantage of stocks going up or down before everyone else does thereby altering prices.

      I'm going to guess that trying to play that game for servers overseas where lag can be measured in seconds won't work when your competition has servers located in the same building the market is in.

  8. Cost to Society by Oxford_Comma_Lover · · Score: 3, Insightful

    Yes. If Amazon went down tomorrow and never came back, society would be fine. If the stock exchange were taken over by malicious but hidden computer software for months, and then finally was taken down, the damage to society would be MUCH more severe. It's not just a way of exchanging everything, it's a way of establishing who owns what. If suddenly nobody knows who really owns every stock that's traded in the last six months, we've got a major frikkin problem. We shouldn't, maybe, but we do because money is an illusion.

    --
    -- IANAL, this isn't legal advice, and definitely isn't legal advice for you. Also, Squee!
    1. Re:Cost to Society by LostCluster · · Score: 2, Insightful

      A stock-trading unauthorized program is the nightmare of financial IT so there's frequent checks to make sure that doesn't happen. If a financial company doesn't know what it owns, it doesn't know much at all.

      If something is being artificially inflated or deflated there will be people asking "Why?". A human rogue trader, trading with money that isn't his and doing something other than what the money's owner has authorized him to do is an international story when one happens. A software rogue trader wouldn't last very long.

    2. Re:Cost to Society by BitZtream · · Score: 2, Insightful

      the damage to society would be MUCH more severe

      Only if someone told society that it was gone. The stock market effects a few select people drastically, but really has little influence on our daily lives in and of itself.

      The panic and fear generated as a result of a market failure as people start hording for no reason other than CNN or FOX said the world was coming to an end are what causes problems.

      If it simply ceased to exist the world would change very little. Stocks are based on what someone thinks a stock is worth, its precieved value.

      Lets face it, I own more than a few shares of Apple, but until I sell them they are barely useful for starting a fire. If the stock market ceased to exist, their actual value would be identical to what it is now.

      --
      Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
    3. Re:Cost to Society by DigiShaman · · Score: 2, Informative

      The stock market effects a few select people drastically, but really has little influence on our daily lives in and of itself.

      Your wrong. The stock market has a profound impact on everyone's lives throughout the world. While it doesn't impact us directly, it does through many other financial abstract layers. Everything from your IRA, savings, to corporate reinvesting which including hiring of new employees to expand a business.

      Have none of you learned from the Great Depression. Take away the stock market and watch what happens!

      --
      Life is not for the lazy.
  9. I wonder if he bothered to by geekoid · · Score: 3, Funny

    consult with his technical people.

    What am I thinking, Of course not.

    --
    The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
  10. Re:So what they are saying is by ottothecow · · Score: 4, Interesting
    It can run 24/7...we just don't want it to.

    In fact, with after hours trading and foreign markets, it really does run 24/7, just not on the floor of the NYSE (and not as liquid).

    I would posit that a good reason for this might be that the stock market is already panicky enough and being closed for most of the 24 hour day gives people a little more time to thing about what is going on. A perfect example is companies that release earnings and other important news after the closing bell. It gives people time to process the information rather than giving the fastest guy a chance to make a quick profit. For the *real* purpose of the stock exchange, it does not need to be open. If your goal is to raise capital for a business (or invest in one) rather than speculate and day-trade, the current market hours are just fine.

    --
    Bottles.
  11. destroy them by roman_mir · · Score: 5, Interesting

    I dream that this entire high frequency scam is declared illegal and all involved are placed where they belong with all of their property confiscated.

    Here is what happens when HFT is done: 2 parties agree on a price, the HFT meddles with in a way, that takes out money from the transaction, so the buyer sells lower and the seller buys higher. That little bit of difference is stolen by HFT.

    These are thieves, we are discussing here, understand that. So they found a way to make some profit on their infrastructure? Well, great for them. 4,000,000 transactions per second they are talking about for one shop. That's 4,000,000 thefts per second.

    1. Re:destroy them by roman_mir · · Score: 3, Interesting

      so the buyer sells lower and the seller buys higher.

      - a typo obviously. Buyer buys higher and seller sells lower than anticipated. The HFT transaction takes the edges. There is no value for economy other than the bank account of the HFT transaction owner becomes bigger. They didn't care about what was bought, what was sold, they have no idea what is happening with what is bought/sold, they are taking money from participants who may, in theory, have done something productive with it. Of-course that's not what happens. Just understand, that many people who own mutual funds and other investments are the suckers in this game of stealing the penny from the 'tray for everyone', to put in Office Space terms, so that /. would understand.

    2. Re:destroy them by Anonymous Coward · · Score: 2, Informative

      As a former developer from a very successful HF trading firm, I can tell you that's not how it works. You are forgetting one crucial item, which is that there is a spread in the market. At any time, the price at which people are willing to sell, and which other people are willing to buy, is different. I'm willing to sell a share for $3, but you only want to pay $2 to buy it. (This spread is unrealistically wide to make it easier to illustrate the point). Unless one of us changes our mind and is willing to sell for less or buy for more, there's no transactions going on.

      There are many ways of doing high frequency trading, but here's one common way. The high frequency trader, call him T, steps in and says that he willing to sell it for $2.75 and buy it for $2.25. I think, hmm, I would really like to get $3 for my share, but unless I can sell it, I'm not making any money. $2.25 is better than $2, so I'll sell to T for $2.25 instead of to you for $2. Two things have happened here: Now I'm able to sell my share, and I wasn't able to before because $2 was just too low. Also, I got a better price than if I bought from you.

      T now owns 1 share, and offers to sell it for $2.75. You decide that you really need to buy a share. At least $2.75 is a better price than $3. It is not as good as the $2 price you really wanted, but you can't always get the price you want, so you buy the share for $2.75. You got a better price from T than you would have gotten from me.

      T gets $0.50 for his trouble. It is not risk free, but I'll get to that later.

      One way of looking at this is that T is a parasite. After all, you could have been willing to buy for $2.25 and made the transaction. But the point is that you weren't willing to do it. You were free to offer 2.25, but you didn't do it. I was free to sell for $2.75, but I didn't do it. Without T's intervention, you and I could have stared at each other for days without buying or selling.

      Thus, the other way of looking at it is that T made the market more liquid, and decreased the spread between bid and ask. I made more than I would have without T, and you paid less than you would have without T.

      T's transaction is not without risk. For instance, the market may move the wrong way, leaving T to take a loss. I may sell my share to T for $2.25, but then the market drops, and no one wants to buy it for $2.75. T drops his price to $2.65. Still no takers. He drops it to $2.55. Still can't sell. At this point, he can either chase the price down bit by bit, which is dangerous because it can lead to a huge loss, or give up now and sell at whatever price buyers name, which is probably more like $1.80 at this point. Instead of a $0.50 gain, he takes a $0.45 loss. There are other ways to loose money, too.

      Also, T is not alone in the market. Other people are doing this, too. Someone will see T's juicy profits, and offer to buy for $2.30 and sell for $2.70, taking less profit, but getting the business instead of T. But someone else will offer to buy for $2.40 and sell for $2.60. The high frequency traders pile on, and the spread shrinks until it is so small that only the most efficient traders can make any money, and they usually make only fractions of a cent per share. As a retail investor, this is great. With more competition, I can sell for more and buy for less than without these guys.

    3. Re:destroy them by martin-boundary · · Score: 2, Informative
      This sounds good, but you're making a number of economic mistakes:

      1) The trader T is virtually alone in the pre 1 second market, when compared with the size of the original market. Thus the original market has been split into two markets, one market for a small number of privileged players and one market for everybody (privileged and unprivileged players). That always leads to suboptimal prices. To get optimal prices in the market, it's necessary to coalesce these two markets.

      2) The idea that making an extra sale is always better than not making a sale is wrong. In the market, the nonexistence of a transaction is just as important as the existence of a transaction, so by facilitating a deal the trader T is biasing the natural outcome, which again results in suboptimal price movements.

      3) You are implicitly treating T as a regular market player, when you describe T's profit and risk strategies. Regular players are good for the market, but T is not a regular player, instead T is a player in two markets, which cannot interact until we find out how to do time travel. The interaction is only one-way. The actions of T in the 1 second market lead to certain advantages in the initial portfolio of T when viewed in the later market. These advantages would not exist if T did not have the 1 second privilege, due to all the other (privileged and unprivileged) players in the market. But these other players cannot act, as they are not part of the first market. T therefore plays the role of a middle man which cannot be routed around.

      4) The total costs of joining the high frequency trading markets are nontrivial, and as such represent an inefficiency in the market that results in suboptimal outcomes for the market as a whole (eg pre and post 1 second). Since it is physically impossible for everybody's servers to be collocated, the only way to fix this inefficiency is to allow nobody to perform high frequency trading.

      5) The privileged (1 second) market is necessarily automated. This leads to a market in which all players are algorithms. From the economic perspective, this is again inefficient, as the algorithms are not the players, the companies are. An algorithm (especially one that needs to be fast) is only a limited representation of an economic preference function.

  12. Re:So what they are saying is by LostCluster · · Score: 2, Informative

    All trading instructions, no matter how technologically implemented, come from people. Somebody has to write and fund the program that says "Buy XXXX when its price reaches $Y" even if they're not attending it at the time it happens.

    Just look at what a mess after-hours markets are. Sometimes they're offering tomorrow's price today, but sometimes they get bent out of shape. Don't you dare buy a stock Jim Cramer promotes on Mad Money in after hours... somebody who owns that stock would love to jack up the price on you. Worse yet, somebody can short that stock and likely have a profit by 9:30am the next business morning.

    If you want 24/7 markets, try currency trading. The US Dollar is up for trades at nearly all hours of the day.

  13. What goes around comes around...call it GEnie. by Quarters · · Score: 3, Insightful

    I guess if an idea is 20+ years old the statute of limitations has run out and someone can use it again as NEW and EXCITING.

  14. Re:EC2 is because of christmas servers? by Anonymous Coward · · Score: 2, Interesting

    Can someone post a source for the claim that Amazon did EC2 because of Christmas time servers that are no longer in use during the year?

    You'll probably get sources, as Amazon said so initially. Of course that's best forgotten now as it has become an inconvenient fact.
    Notice how every Christmas their servers go down due to mysterious "hackers" poisoning their DNS server or what not. Every year - a different excuse, and every time - around Christmas.

    Basically, don't use Amazon if you have mission critical processing around Christmas, or even worse, if you expect a peak around Christmas.

  15. It Depends... by FrozenGeek · · Score: 2, Interesting

    It could be secure, given the following constraints:
    1. The computers contain NO mass storage at all.
    2. The mass storage is external to the computer and is disconnected from the computer during cloud computing.
    3. The computer is rebooted from CD (or DVD) before and after cloud computing.
    Of course, the odds on those constraints being met are pretty low if non-technical types are involved.

    --
    linquendum tondere
  16. Re:Microsoft Office Clouds by Doc+Ruby · · Score: 2, Informative

    Well, I'm in the business too, and I'm not going to break my NDAs and specify whose MS software I service. But I do write and maintain apps for some pretty big traders (and directly related financial businesses). There's lots of MS platforms in their core business ops. Lots of Windows server farms, particularly running SQL Server and business objects. Tremendous horsepower, both in-house, and colo at telco hotels for low latency to exchanges - and at leasable datacenters. And starting to move some services to clouds. They're interested in Azure, and waiting to see what it's like when it's ready for prime time.

    But their biggest obstacle is letting their data and algorithms, or anything in their critical path, live at Microsoft. If they had an Azure cloud distributed among the locations they control themselves, they might be closer to moving their apps to that model.

    And if they could make money off their sunk hardware costs while it's "sleeping" (except for some hefty datamining and OLAP procs), they would. They'd sell their grandmother if it had a chance at a profit. And computing services rarely sell for less than the power and other ops costs to run them.

    So there's probably a future in this. I wonder who else has seen more of it than I have yet. So far, only people who haven't have chimed in here.

    --

    --
    make install -not war