Slashdot Mirror
Mysterious Algorithm Was 4% of Trading Activity Last Week
concealment sends this excerpt from CNBC:
"A single mysterious computer program that placed orders — and then subsequently canceled them — made up 4 percent of all quote traffic in the U.S. stock market last week, according to the top tracker of high-frequency trading activity. The motive of the algorithm is still unclear. The program placed orders in 25-millisecond bursts involving about 500 stocks, according to Nanex, a market data firm. The algorithm never executed a single trade, and it abruptly ended at about 10:30 a.m. ET Friday."
I think we are taking significant risks with the stock market and automated trading. It is now a complex system of interracting algorithms that nobody understands or can understand. I have heard it said that the fluctuation patterns we are similar to fluctuations in chaotic systems before a state change. It is entirely possible that the markets could lose most of their value in a matter of minutes, before anyone knows what's happening - and the unforeseen interaction of algorithms could put a whole generation into poverty
"The motive of the algorithm is still unclear."
Oh what a load of bullshit.
It's obviously an experiment in painting the tape. Make bids, cancel them. Walk stocks up and down with the bid price. Head-fake other HFT corps that track bid prices in their algorithms.
It went badly because it was detected. It needs tweaking to be not so obvious next time. And yes, there will be a next time.
It's a casino now. It's been a casino for a while, and if you're not part of the house, you're the mark.
--
BMO
Guys, think of it. Our stock exchange, i.e. your pension or if you are unlucky also your mortgage is depending on this kind of software these days... And this is not the first time this year that stock trading software is in the news. This has nothing to do anymore with owning a share of an organization in the hope the organization will make a profit and pay you dividend. This is total craziness.
It is allowed. They operate within the rules.
Considering it's basically a license to print money, nobody is particularly concerned with "fixing" the problem. That's why you see all this astroturfing bullshit about how good HFT is -- it is all they really have to delay public opinion turning against them.
1) If I were to do something like this with amazon.com (add things in my shopping cart and then remove them rapidly) wouldn't the headline be "hacker attempts to take down amazon site" with jail time? Why does this receive such a neutral headline like "mysterious algorithm?"
2) I pay $25 to execute a trade. How much money does it cost these people to put a bid or ask up and pull it? Shouldn't there be some sort of punitive cost for doing this?
I find it a bit strange that these trading systems don't seem to use some kind of identification (like signed certificates). How is it possible that some system did these things and the stock exchange doesn't immediately know whose system this was? This sounds like a disaster waiting to happen.
Kinda puts a spotlight on who is in bed with whom doesn't it?
No, HFTs certainly skim off the top of genuine traders and investors. If they were just transferring money from each other, the practice would never have become so pervasive.
They do it by spending millions on computers, programmers, interconnects, and physical proximity and connectivity to exchanges. This gives them a fundamental and practically (for a small time player) unbeatable advantage over other users of the system, which is utterly against the spirit of a free market.
What they are doing is consuming the service to the detriment of other users, and extracting a tax with their unfair advantage over other users, while contributing exactly nothing back.
Or Skynet is gradually acquiring conscience
Conscience: an aptitude, faculty, intuition or judgment of the intellect that distinguishes right from wrong
Consciousness: the quality or state of being aware of an external object or something within oneself.
If SkyNET developed a conscience, it would cancel third world debt and cut spending from pork-barrel programs, and would also be vegetarian.
Just FYI; It's an important distinction. No need to mod.
Finally had enough. Come see us over at https://soylentnews.org/
HFTs certainly skim off the top of genuine traders and investors
Yes, those are the other players in the market that I mentioned. "Players" is the people involved, not just HFTs.
What they are doing is consuming the service to the detriment of other users, and extracting a tax with their unfair advantage over other users, while contributing exactly nothing back.
Which is why I said the other players (the non-HT traders) have an incentive to end that behavior, which is why it doesn't make sense that "nobody is particularly concerned with "fixing" the problem". They should be.
Dilbert RSS feed
You can bid ridiculously low prices, or ask ridiculously high prices, and no trades will be made, but this won't affect the stock prices. Stock prices are set based on trades that do occur. It's like selling a house - some bozo can offer you half what it's worth, but the net effect on the house price statistics for your area is precisely zero.
With automated trading systems this probably isn't entirely true anymore, since automated systems are likely take these bids into account when making their trading decisions. You could use this to trick your competitors into buying or selling a certain stock.
Finally what if you hold positions in a "flash crash" or "melt up" depending on what your position is and if you have any cash on hand it might be an INCREDIBLE opportunity for you. You might have a shot out buying or selling at 1000 times the margin you otherwise hoped to get.
And then they roll back the day's trading, because we can't have little old you profiting from the cascading algorithmic panic of big money.
Non-Linux Penguins ?
so its basically a d.o.s?
If anyone is having trouble following the details of the above, or more likely having trouble believing what they are reading, just remember this:
The stock exchange is based on rules. If anyone is making money through exploitation or gaming of the existing rules, then they will spend that money in an effort to ensure that the rules remain in their favour. When history is written, the story of electronic stock exchanges in the 2000s will be one of patronage, lobbying, connections and bribery on a wide scale. Retail investors will be the marks who lose out.
May the Maths Be with you!
it's like saying that fouls are in spirit of sports, link farms are in spirit of search engines and bombing the shit out of brown people is in spirit of paying taxes to fund the state. Using the properties of the system outside the explicit rules of the game may be the rational thing to do, but is never in spirit of the game.
From what I understand, such practices are completely in the spirit of the free market. These traders have created and exploited an advantage for profit. There is not altruistic component of capitalism that demands "contributing something back."
You fail to see the bigger picture. The only reason we have a "free capitalist market" or a "stock market" at all is precisely because the population thinks these are useful items to have. The population has the vote, they elect lawmakers to allow the useful and disallow what is not in their interest. And if HFT becomes a problem, it might very well get outlawed. Or the stock exchanges might avoid regulation by setting a frequency cap so that geographical location don't matter. A few ms for in-city trading, or a few 100ms for nationvide trade.
The market is neither free nor is the playing field level - unless there is some regulation. Without law, the biggest gun wins.
From what I understand, such practices are completely in the spirit of the free market. These traders have created and exploited an advantage for profit. There is not altruistic component of capitalism that demands "contributing something back."
Following your logic, a mugger is good example of a free market capitalist - he exploits the advantage he has over other people (big posture, a knife in his pocket) for profit, whilst contributing nothing back. You're right in saying that capitalism is not about altruism, but it's also not about exploiting the weaknesses of the system, and certainly isn't about using that advantage to curtail the efforts of others.
In the "bad old days," I could track an investment on a day to day basis without much worry of what has happened in the last 5 minutes. In other words, if I bought a mutual fund, it wouldn't go up, or down, by much more than a fraction of a percent between the time I placed the order and when it executed.
Since the advent of widespread HFT, even well diversified funds can fluctuate 5% per day, get unlucky on entry and exit and you've lost 2 years of typical gains - similarly, get lucky on entry and exit and you've got an extra 10% in your pocket. We've already got Las Vegas if we want to gamble, I'm looking for a little more predictability out of Wall Street, instead we are getting less and less.
The main problem, not with high frequency trading per se, but with all the fake bids that are put into the system and then cancelled, is that it prevents proper price discovery in the market, because you can't tell who the real willing buyers and willing sellers are from all the noise.
Put down the crack pipe, Limbaugh. This "printing press" inflationista crap is getting old.
The source of funds to pay off (currently zero-interest) debt is growth. There will be no growth until there is demand. We don't have a supply-side problem - businesses are flush with cash and manufacturing capacity, but no-one is buying anything, because they are still suffering from a massive deleveraging hangover. Businesses don't need some kind of mythical 'confidence' - they need customers.
The problem isn't government borrowing today, it's government borrowing yesterday. Today, the government should be borrowing on a massive scale to stimulate growth. If you want to scare people about debt and deficits, then you should be really pissed at the people who went on a massive government borrowing spree WHEN IT WASN'T NECESSARY to pay for shit like unnecessary wars and tax cuts for rich people - not at the people who are trying to fix the damage.
When the economy is depressed, and interests rates are zero, the government should borrow like crazy. When the economy is growing, and interest rates start to go up, government borrowing (and spending) should go down. Instead we do the opposite, and the crazies come out with ex-post-facto idiot economic theories about how our current problems are the result of current policy, as if the number one world economy turns on a government dime. Wake the fuck up.
Much of the rest of the world is doing better than the US these days? Wow. We certainly have our problems, and we're not number one at absolutely everything, but what the hell are you talking about? That's completely ridiculous.
It's undisputed at this point that HFT played a significant role in the 2010 Flash Crash. Even though the intention is not to move prices, accelerating price moves can be an unintended side-effect of them at play, via things like adding to market congestion. It won't take many of these "4% of trading activity" bots to seize things up so that prices could go bonkers. There are plenty of bots executing real trades based on market activity around to serve as the other side of a bad feedback loop.
I was using a personal example to demonstrate how short-term crashes can result in an unrecoverable bad situation even if prices come back later. But the source of the price crash doesn't have to be identical to mine to run into the same class of problem.
No impact? Do you really expect us to believe those flash crashes never happened?
I've read about 12 studies now [...] they all conclude the HFT is overall beneficial to the market as a whole.
That's funny. I've read studies which say otherwise, and I can even cite them.
How High Frequency Trading Harms Even Long Term Investors
- Investors are warned against using market orders and stops because HFT can and will suddenly withdraw their quotes. This alone should tell you something is rotten at the core.
- Some universities, such as Georgetown, can no longer afford to buy TAQ market data for their professors or students to analyze. This will lead to less academic oversight, guidance and involvement, as well as students who are less prepared for careers on Wall Street. Data has become prohibitively expensive because of all the excessive quotes generated by HFT.
- Quote spreads are much wider and less stable during market open, which causes many micro flash crashes in individual stocks.
- Misleading price quotes interferes with price discovery, one of the core functions of a stock exchange.
- Mis-allocation of resources, both human and technological.
- If left unchecked by regulators, traders who want to process quotes, will soon need super-computers, 10 gigabit connections and their own engineering staff to have the same basic level of trading information they needed in 2006.
- HFT generated so much Quote Spam in the flash crash, that it took 5 months for the SEC to assemble the data.
- During the flash crash, excessive quotes from HFTs overloaded quote data feeds, causing severe delays: stock quotes from some exchanges were behind over 30 seconds during the height of the flash crash.
But I'm sure these are all good things, and help keep the markets healthy. I must just misunderstand how awesome they are.
How does the HFT magically know what you were willing to pay? It's really hard to have a reasoned debate when people are attributing ridiculous feats to HFT.
Imagine two genuine traders, GT1 and GT2. There's an item that GT1 wants to sell and GT2 wants to buy. GT1 is prepared to sell for as little as 21.10, and GT2 is prepared to pay up to 21.20. Past trades have been at 21.17, so GT2 offers 21.15, and the sale occurs. Now add a high frequency trader, HFT.
Rinse and repeat to find the maximum that GT2 is prepared to pay. Buy from GT1 at their minimum price, and/or sell to GT2 at their maximum, pocket the difference. GT1 has made less than they would have without high frequency trading, and GT2 has spent more that they would have. And GT1 and GT2 are probably your pension funds.
Red to red, black to black. Switch it on, but stand well back.
Nope. Or more specifically, HFT guys get a big discount. That's why you get so much screaming and kicking over "transaction tax" proposed in EU right now. It wouldn't do anything meaningful to actual investors, but it would kill HFT because its profits are based on huge volume of trades executed with razor thin margins as they are skimming the top of the market. And with it, the profits of major players who run their own HFTs as well as profits of stock markets would go down, while reliability of market would go back to the levels 1990s when most diversified portfolios didn't really fluctuate much on daily basis as they do now.
Until major financial players are banned from lobbying politicians as effectively as they can do today and stock market rules stay lax, HFT will continue to destabilize the stock market. That is the reality of today.
As far I know in most cases they cannot cancel fast enough, so one of the key areas of research in HFT algorithms is how to determine the lowest sell/highest buy rate of the "genuine traders" in the shortest time frame with lowest possible buys at too high rates. So you get "buy a small amount of stock at price x, buy at slightly less then x, even lesser then that" until you hit the "no sale" at which point you buy everything at lowest price all while doing the same for the buyer in the opposite direction.
That is why speed matters. This needs to be done before GT1 and GT2 find each other and execute the trade as it would have happened without HFT. Even fractions of milliseconds matter. And that is why HFT adds zero liquidity to the market - HFT algorithms will not make trades that don't have a profitable buyer and a seller found. They make trades before buyer and seller find each other.