David Jenyns - The Secret Art of Backtesting

If you're new here, you may want to subscribe to our RSS feed. Thanks for visiting!

Here’s a great article on back testing from our good friend David Jenyns, author of the MetaStock Programming Study Guide, available for purchase at: www.metastock.ca/training/metastock-programming.aspx

+-+-+-

Original Article: www.makeupblog.cn/real-estate/the-secret-art-of-backtesting.html

The Secret Art of Backtesting

If you have not back tested your trading system, you might as well trade with your eyes close.

In fact, whatever technical analysis criterion you use to trade with, be it moving averages, candle sticks, volatility breakouts, fibonacci retracements or any other trading system you have devised you’re going to need to back test your trading system thoroughly and objectively in order to remove any possible doubt about it’s capability.

To remove any self-doubt you need to thoroughly back test or simulate your trading system in such away that it matches the conditions under which it will be traded. Once you have established that you have a reliable and robust trading system only then will you be confident in trading your system.

When trading what is the question in most traders’ mind?

To answer this question I shall quote the introduction from Chapter 8 Back Testing of Mark Jurik’s book Computerized Trading:

Will my trading strategy be profitable? After having gone through the arduous process of crafting a trading strategy, these are the questions you must ask yourself. The ability to answer these questions are the great promises that back testing holds out for all traders. A successful back testing procedure will greatly reduce the probability that you will begin trading with either an unprofitable strategy or one that does not meet your expectations. By adopting a sound and rigorous back testing approach, you will:

  • Pinpoint which approaches to the market that are likely to be successful and which ones are not.
  • Generate good estimates of future performance for each trading strategy you test.
  • Create a record of your trading strategy’s historical trading performance.
  • Produce data necessary for other components of your trading approach such as your asset allocation strategy.

Important Trading System Criteria

Profitability is not the only criteria by which a trading system should be evaluated. Drawdown and stress should equally be considered as well… for example, before you open a trading account:

  • Are you satisfied that your system is reliably profitable?
  • Will draw downs wipe out your account?
  • Is your system trading in a way you can tolerate?
  • Can you tolerate long periods of no trading or too much trading?
  • Can you tolerate a large string of losses?

The only way to answer these questions is to subject your trading system to extensive back testing.

Lack of Confidence

Lack of confidence usually forces traders to question their own trading systems. They give into the temptation to modify their trading plan with devastating consequences. This temptation spawns on by a string of losing trades or an opportunity to replace their trading system with a whiz-bang indicator that is usually talked about in traders chat forums.

Anything that sounds to good to be true will attract the attention of a trader who is not satisfied with their own trading system simply because they have not properly tested their system in the first place. In addition, they have not built up the necessary confidence needed to successfully trade the system developed.

In the end these negative subconscious thoughts will only hinder and destroy your ability to trade successfully. To improve your confidence in your trading system you need to thoroughly and objectively back test it - simple as that! Only then will you be confident enough to commit time and money to it!

The Traders Dilemma

How can you test how a trading system will perform over a period of time when trading an arbitrary group of securities?

— To truly evaluate the past performance of a trading system you need a trading simulator, which mimics the day-to-day trading activities of a typical trader. Until now this kind of software has been out of the reach of most traders. In fact, there has been some great headway in back testing software. Personally, I use TradeSim with MetaStock.

TradeSim is the first realistic true trading simulator/analyzer for Metastock that can quickly back-test and evaluate a trading system across a portfolio of securities. With its powerful data processing capabilities, TradeSim can evaluate the historic performance of a given trading system within a matter of minutes and do it with a realistic representation of a real-life trading scenario. Whether a single security or a multiple security portfolio, TradeSim answers the simple question:

“What would of happened if this system had of been traded in the past using an arbitrary portfolio of securities?”

Sounds simple - but is extremely complex if not impossible to do with Metastock as it stands alone. However, with TradeSim it is just a simple matter of running a Metastock exploration on a portfolio of securities using your own set of indicators. When the exploration has finished you just simply run TradeSim and analyse the resulting trade data.

Your system may look good with an expert overlayed on a single chart.

“But what about it’s real world trading performance?”

Typically, your system will consist of entry and exit triggers, prices as well as an initial stop loss. These five parameters basically define a framework for a trading system. The trouble with trying to back test a trading system is that the system tester built into Metastock is only extremely limited. As a result, this can give a very distorted view of your potential trading system performance. TradeSim addresses all of these issues whilst exploring new ground in technical analysis and uncovering new issues that have not been addressed by current software technologies.

Remember, no matter what back tester you go for, anything that sounds too good to be true will attract the attention of a trader who is not satisfied with their own trading system. This due to the fact that they have not properly tested their system in the first place and have not built up the necessary confidence needed to successfully trade it.

In the end, these negative subconscious thoughts will only hinder and destroy your ability to trade successfully. To improve your confidence in your trading system you need to thoroughly and objectively back test it - simple as that! Only then will you be confident enough to commit time and money to it! By testing your system, you have just put yourself into the top 1% of traders.

Further Reading On Backtesting:

  • Practice vs Funded Trading vs Backtesting
  • - BACKTESTING - for me, this is not done real time and these are more drills for me. Often I will go through a lot of data in a very short amount of time, also trading using my trading strategy. For example, I could trade 6 months worth …

  • Economics : Back-testing for Oil
  • - As a trader I like to do back-testing product that I trade in. The process of testing trading strategy in previous periods. Instead of applying a strategy ahead of time, which could take years, a trader can make a simulation of his or …

  • Forex Strategies Are Developed Through Backtesting
  • - For anyone looking to t…

  • Back testing
  • - I stumbled on a pretty good entry tactic, one I have seen I guess but I couldn’t trade on my own it’s too weird. I have been testing this along with different types of exits on the stocks that appear on my trade ideas scans, …

  • Wanted: Forex Back Testing Resources
  • - If anyone out there knows of automated back testing resources for Forex trading, please let me know of them. Today I was kicking around some ideas I’ve had for my Forex trading and I came up with something that I really want to try. …

  • Secret Art of Back Testing
  • - Back testing is the process of testing a trading strategy over historical data to determine how well it would have performed over that set of data. Interpreting these results then provides the trader with sufficient information to …

  • Backtesting Metatrader History Data for FAPS, Tracer and Bogie
  • - Remark: Despite having the full historical data, I was only able to generate backtest results from April 07 and I wondered why. I am really keen to find out how it faired with FAPS in 2005. (Has anyone seen its results?) …

  • Back Testing for Better Trading Results
  • - In today’s guest blog post I asked Ingela Troha to talk about something that has plagued me, and millions of traders each and every year…it’s back testing! Please read the full article, and put the info to good use! …

  • Back-testing a forex trading system
  • - While it is true that past performance does not indicate the future, the only reliable information we have is about the past. A few important things make a difference between unbiased trading-system testing and self-delusion. …

  • BackTesting and Assessing Strategy Performance.
  • - I’m developing a solution which will allow me more flexibility in backtesting and more especially live testing of my trading activity. Essentially it uses three components: 1) A spreadsheet for all trade information …

  • The Secret Art of Backtesting
  • - The ability to answer these questions are the great promises that back testing holds out for all traders. A successful back testing procedure will greatly reduce the probability that you will begin trading with either an unprofitable …

Popularity: 100% [?]

Technorati Tags: , , , , , , , ,

There Are 2 Responses So Far. »

  1. Great article!

    Ever since I read Marcel Link’s book High Probability trading I understood the importance of backtesting trading systems. Specially when testing what is the best stop for a particular system. However, backtesting can also give you a false sense of confidence.

    For example, a system that trades long will perform great in an uptrending market but might not work on a downtrending market. I believe that a system should be tested using as many stocks as possible and as much daily data as possible(data that includes a bull market and a bear market). It also needs to be sampled to see why some of the trades worked and did not worked. You should alo ask yourself; would you have taken the trade that the backtested system took? Maybe yes, maybe not.

    Another important concept of backtesting is the drawdowns of the system. Can you stomach huge drawdowns and not tinker with your system?

    Backtesting is great, but it does not predict individual investors psychology.

    World worst stock picker.

  2. Learn how to trade the forex market for free
    at the forex learning center.

Post a Response

  • Search

    Tags

    Archives

  • Recent Comments

    • Learn how to trade the forex market for free at the forex learning center.
      Harold | 25Nov08 | More
    • USE BROKERS CHARTS AS THEY ONLY PAY OUt on them, but tried Barrys strategies and turned my trading around
      paul | 15Nov08 | More
    • Thanks for writing this.
      Amena | 29Oct08 | More
    • Great article! Ever since I read Marcel Link's book High Probability trading I understood the importance of backtesting trading systems. Specially ...
      WorldWorstStockPicker | 27Aug08 | More
    • Nice writing style. Looking forward to reading more from you. Chris Moran
      Chris Moran | 13Aug08 | More
  • Our Twitter Feed

  • RSS MetaStock Buyer's Guide Updates

  • RSS Featured Financial Coach: David Jenyns

  • RSS Investorwords Term of the Day

  • RSS Reuters: Business News

  • RSS The Globe and Mail: Your Money News

  • RSS Your DailyFX

  • RSS Fool.com: The Motley Fool

  • RSS Yahoo! Finance: Tech Ticker

  • RSS MarketClub Trader's Blog

  • RSS The Economic Populist

  • RSS Top Dog Trading