VALYNOXSTRATEGY RESEARCH TECHNOLOGY
AlphaPrimeAlphaPrime
ACADEMY / Trading costs and execution

High-frequency trading vs retail algo trading: what differs

High-frequency trading earns tiny amounts per trade from speed and queue position, a race retail traders cannot win. Retail algo traders do better testing strategies on minute to daily bars, where each trade's edge can be large enough to pay costs.

By · Published · updated · Editorial policy

Contents
  1. What is high-frequency algo trading?
  2. How does a high-frequency trading algorithm make money?
  3. Can a retail trader compete with HFT on speed?
  4. What can a bar-based backtest tell you about fills?
  5. How much do slippage and costs limit short-horizon strategies?
  6. Which bar lengths make sense for a retail algo trader?
  7. Frequently asked questions
  8. References

What is high-frequency algo trading?

High-frequency algo trading is automated trading where firms earn tiny amounts per trade by reacting in microseconds, usually as market makers with servers next to the exchange. A retail futures trader cannot win that speed race. The realistic path is slower algorithmic strategies on minute to daily bars, where each trade's edge can be large enough to pay costs.

High-frequency trading (HFT) is a form of algorithmic trading in which computers send, change and cancel orders in fractions of a millisecond and usually hold positions for seconds or less. Algorithmic trading is the wider term. It covers any trading where fixed rules decide entries and exits and a computer executes them. All HFT is algorithmic trading, but most algorithmic trading is not high frequency.

AspectHFT firmRetail algo trader
Typical holding timeSeconds or lessMinutes to weeks
Source of the edgeBeing first, earning the spread, small price differences between marketsPrice behaviour over many bars: trends, reversals, session patterns
What decides the resultSpeed and place in the order queueWhether the average trade is larger than its costs
InfrastructureServers in the exchange data centre, direct market data feedsA computer, a broker connection, a trading platform
Data needed to testEvery order book messageBar data, from one minute to one day
How it is testedSimulation of the order book and the queueBar-based backtest with costs, then out-of-sample checks
HFT firms hold for seconds and win on speed; retail algo traders hold for minutes to weeks and win only if the average trade is larger than its cost Speed vs edge over cost HFT firm vs retail algo trader Holding time Wins by HFT Seconds Speed Retail Minutes–weeks Edge > cost Retail can't win the speed race. So: hold long enough to beat costs.
HFT holds for seconds or less and wins on speed; a retail algo holds for minutes to weeks and wins only if the average trade beats its costs.

How does a high-frequency trading algorithm make money?

Most HFT profit comes from many very small gains, and each one depends on being faster and earlier in line than other traders.

Latency is the time between an event, such as a price change, and the moment your reaction reaches the exchange. HFT firms measure latency in microseconds, which are millionths of a second.

Co-location is renting space for your servers inside or next to the exchange's data centre, so the cable to the matching engine is as short as possible. The matching engine is the exchange computer that pairs buy and sell orders.

Market making is quoting a buy price and a sell price at the same time and earning the difference between them, the spread, when both sides trade. In liquid index futures the spread is often a single tick, the smallest price step the contract allows. The futures contract calculator shows what one tick is worth in your contract.

Queue position is your place in the line of orders that wait at the same price. Many futures markets fill orders at one price in the order they arrived. This rule is called price-time priority. An order at the front of the line gets filled first.

A market maker's main risk is getting filled just before the price moves against the quote. Speed solves this in two ways. A fast firm reaches the front of the queue, so its orders fill on normal trading flow. A fast firm also cancels old quotes before slower traders can trade against them. For more on how such firms are set up, see how quantitative trading firms work and what retail traders can copy.

A market maker quotes a sell price and a buy price one tick apart; at each price the fastest firm sits first in the queue and slower orders wait behind it Speed wins the queue Market maker quotes both sides Fastest Slower Sell Buy 1 tick The fastest firm fills first. So: don't compete for queue spots.
A market maker quotes both sides one tick apart; the fastest firm sits first in the queue at each price and cancels its quotes before slower traders can trade against them.

Can a retail trader compete with HFT on speed?

No. A retail order passes through several delays that a co-located firm has already removed. Picture people buying the last tickets for a concert. Some stand at the ticket window. You send your request by post. Your request may be well written, but the tickets are gone before it arrives.

  1. The market data you see on screen has already travelled from the exchange to your broker or data vendor, and then to you.
  2. Your platform needs time to calculate the signal and create the order.
  3. The order travels over the internet to the broker.
  4. The broker runs risk checks and sends the order on to the exchange.

A rented server near the exchange makes some of these steps shorter. It does not move you to the front of the queue, and it does not let you cancel quotes as fast as a firm that works next to the matching engine. Any strategy that profits from reacting to a price change before others react will be taken by traders who are already faster.

A co-located server reaches the exchange in microseconds, while a retail order passes four delays first: market data, signal calculation, the internet and the broker Retail orders arrive late Delay from signal to exchange Co-located Microseconds Retail 1 2 3 4 Data · signal · internet · broker Faster firms act before you arrive. So: don't trade on reaction speed.
A co-located server sits next to the matching engine. A retail order passes several steps first, and each step adds delay.

Retail traders have other advantages. You can hold a trade for hours or days, so a delay of milliseconds does not matter. With small size, a market order in a liquid contract usually fills close to the quoted price. You also do not need to trade all day to cover the cost of servers and staff.

What can a bar-based backtest tell you about fills?

A bar-based backtest models fills well when the strategy decides on completed bars and trades on the next bar. It cannot model queue position or the order of price moves inside a bar. A bar-based backtest is a simulation that only knows the open, high, low and close of each bar, and often the volume. It does not see the individual orders that traded inside that bar.

SituationWhat bar data can modelWhat bar data cannot model
Market order after a signal at the bar closeA fill at the next bar's open plus a fixed slippageThe actual spread at that moment
Limit order at a priceWhether price reached that levelWhether your order was far enough forward in the queue to be filled
Stop and target inside the same barThat both levels were touchedWhich level was touched first
Large orderA fixed cost per contractHow far your own order moves the price
Holds of a few secondsLittle of useThe effect of latency on every fill

The limit order row matters most. Think of a queue at a bakery counter. The shop sells bread at your price, but it runs out before your turn. A bar backtest only sees that bread was sold at your price, so it records that you got some. In real trading, price often touches your limit, fills the orders ahead of yours and then turns away.

Hypothetical limit order: the bar backtest records a fill because price touched the limit, but in live trading only the orders ahead in the queue fill and yours does not Touched is not filled Hypothetical limit order, one price Backtest Filled Live Yours Not filled Ahead A touch is not a fill. So: count fills a tick through.
Hypothetical example: price touches the limit, but only the first orders in the queue fill. A bar backtest records a fill that would not have happened.

Use these rules to keep a bar-based backtest close to what you could actually trade:

  1. Decide on the close of a bar and execute on the next bar. This is called next-bar execution.
  2. Count a limit order as filled only when price trades through the limit by at least one tick.
  3. When the stop and the target both fall inside one bar, assume the stop filled first.
  4. Choose a bar length at which a typical trade lasts many bars, so moves inside a single bar decide few results.

How much do slippage and costs limit short-horizon strategies?

The shorter the holding time, the smaller the average move per trade, while the cost per trade stays the same. Costs therefore take a larger share of a short-horizon strategy's result. Slippage is the difference between the price your backtest assumed and the price you actually get.

The check needs one subtraction:

net average trade = gross average trade − round-trip cost

The gross average trade is the average result per trade before costs. The round-trip cost is commission and exchange fees for the entry and the exit, plus slippage on both sides. Express both values in the same unit, for example ticks. The trade list in the performance report of AlphaPrime (Valynox) gives the result of each trade, so you can set the average trade against the round-trip cost in the same ticks.

Hypothetical example

Two strategies trade the same contract. The round-trip cost is 2.5 ticks: commission and fees equal to 0.5 tick, plus 1 tick of slippage on each side. Strategy A uses 1-minute bars and has a gross average trade of 3 ticks. Strategy B uses 60-minute bars and has a gross average trade of 20 ticks. After costs, A keeps 0.5 tick per trade, so costs take more than 80% of its gross result. B keeps 17.5 ticks, so costs take 12.5%. Now double the slippage to 2 ticks per side. The round-trip cost becomes 4.5 ticks. A now loses 1.5 ticks per trade. B still keeps 15.5 ticks.

Hypothetical example in ticks: a 2.5 tick round-trip cost takes 83 percent of a 1-minute strategy's 3 tick gross trade but only 12.5 percent of a 60-minute strategy's 20 tick gross trade Same cost, different share Hypothetical, ticks per trade Cost 2.5 Net 1-min 83% to costs 60-min 12.5% to costs Costs eat the short trade's edge. So: rerun with double slippage.
Hypothetical example: the same cost per trade takes most of the short-horizon strategy's gross result and a small part of the slower one's.

Tick sizes, tick values and exchange fees are set by the exchange, and they can change. The exchange's contract page is the final word on these values. Check it and your broker's fee schedule before you set costs in a backtest. For a full method of modelling commission and slippage, see trading costs in backtests and the average trade test.

Which bar lengths make sense for a retail algo trader?

Bars from one minute to one day give a practical range for a retail futures trader. The longer end of this range leaves more room between the average move and the cost. For each bar length, check the item in the last column before you trust the result.

Bar lengthTypical holding timeCost as a share of the average tradeWhat to check
1 minuteMinutesHighFills inside bars, limit order assumptions, results with double slippage
5 to 15 minutesUnder an hour to one sessionModerateSession open and close, news times
30 to 60 minutesHours to daysLowerOvernight gaps, enough trades per test window
DailyDays to weeksLowFewer trades, so a longer history is needed
Illustration: from 1-minute to daily bars the average move per trade grows while the cost per trade stays the same, so the cost takes a smaller share Longer bars dilute costs Illustration: same cost per trade Cost Net move 1 min 5–15 min 30–60 min Daily Longer bars leave room for costs. So: let trades last many bars.
As bars get longer, the average move per trade grows while the cost per trade stays the same, so costs take a smaller share.

Short bars produce many trades, and many trades look like strong evidence. They also give a search more noise to fit. If you test many rule variants and keep the best one, its backtest is usually better than its future results (Bailey, Borwein, López de Prado and Zhu, 2014). Judge a strategy on data it did not see during the search. Walk-forward analysis does this by tuning on one window and testing on the next one. AlphaPrime runs these checks in its strategy validation with Basic, Standard and Extensive levels.

Put realistic costs into the search from the first run. AlphaPrime's backtesting evaluates each candidate with fees, slippage and next-bar execution, within the trading sessions you choose. As a result, the ranking already reflects the fills a bar-based test can model honestly.

What this means if you use AlphaPrime: search on bar lengths at which a typical trade lasts many bars, set costs before the first run (next-bar execution is a fixed rule), and judge candidates on their out-of-sample results. The speed race belongs to HFT firms. Your research time goes further on strategies whose edge can survive costs.

Frequently asked questions

Can retail traders do high-frequency trading?

Retail traders can trade often, but they cannot do high-frequency trading in the professional sense. HFT depends on co-located servers, direct data feeds and a place at the front of the order queue. A retail order passes through the internet and a broker first, so faster firms take the opportunities before it arrives.

What is the difference between algorithmic trading and high-frequency trading?

Algorithmic trading is any trading where fixed rules decide entries and exits and a computer executes them. High-frequency trading is one type of algorithmic trading that holds positions for seconds or less and earns its edge from speed. A strategy on 15-minute or daily bars is algorithmic trading, but it is not high frequency.

Is scalping on 1-minute bars the same as HFT?

No. Scalping on 1-minute bars holds trades for minutes and does not depend on microsecond reactions. It shares one problem with HFT, though: the average move per trade is small, so commission and slippage take a large share of it. Test it with realistic costs and with double slippage before you trust the result.

Can you backtest an HFT strategy with minute bars?

No. Minute bars do not show the order queue, the spread at each moment or the order of price moves inside the bar. An HFT strategy needs a simulation built on every order book message. Minute bars suit strategies that decide on completed bars and trade on the next bar.

References

  • Bailey, D. H., Borwein, J., López de Prado, M., & Zhu, Q. J. (2014). Pseudo-Mathematics and Financial Charlatanism: The Effects of Backtest Overfitting on Out-of-Sample Performance. Notices of the American Mathematical Society, 61(5), 458–471.