• 
• 
• 

• Performance
• Services
• Company
• Learn About
• My Attain

Attain's Semi-Annual 'Top Fifteen System Rankings'

July 17, 2006

 

We release our rankings twice a year to give investors a concise summary of the systems we believe have the best chance for success moving forward. We are not content to merely show you the best performing systems this year or a list of the top performers of all time, however; as the best system for one investor may be anything but best for a second investor. For this reason, our rankings have developed over the years into a comprehensive tool which ranks systems across 8 different statistical categories.

It seems no matter how hard system developers and brokers try and tell you there is no "holy grail" system - the harder the investing public searches for one. Many investors are in search of a "holy grail" system which has low risk, high average returns, a multi-year track record, and of course - impressive recent gains, and this eternal search for trading's "holy grail" leads investors to quickly weed through hundreds of trading systems by asking every developer, broker, or investor knowledgeable about trading systems to show them their BEST system. But what are you really asking when putting this question to these "experts"? What is BEST supposed to mean, anyway? Best this month, this year? Best for all time? Best risk adjusted return? Best in terms of lowest Drawdowns?

Aren't we being short sighted when asking to see the BEST system in one category or another? The real question should probably be more along the lines of: "What system is consistently among the top systems across all of the different statistical measures important to this type of investment?"

This is exactly what our rankings have been designed to do: See which trading systems are the BEST in each of 8 categories, then see which systems are consistently among those on each list - and therefore the BEST overall.

We begin by looking at which systems are the BEST by returns so far this year. This is unfortunately the measure most investors use to determine what system is best for them, and the reason the year's hot system is usually regarded as the BEST system. The downside to this analysis, of course, is that it ignores risk. A high return is nice, but at what cost. The BEST performers so far this year are:

THE FOLLOWING TABLES SHOW PERFORMANCE STATISTICS OF HYPOTHETICAL MODEL ACCOUNTS COMPILED USING ACTUAL CLIENT BUY AND SELL PRICES. ALL NUMBERS ARE INCLUSIVE OF COMMISSIONS AND THE COST OF THE SYSTEM. PLEASE SEE IMPORTANT RISK DISCLAIMER BELOW.

While Delphi eRL and the Bounce systems appear to be very much the BEST this year, a simple change to looking at total return over the life of the system quickly inserts two other system into the top 5 list - Compass SP and Axiom eMD (despite losses of -23% in '06 for Compass). The newer Bounce eMD and Spartan ES drop out of the top 5 altogether, due to not enough history to build up a significant track record. The BEST systems by Total Return have been the following:

Its easy to play devil's advocate when looking at the total return table and say how it unfairly treats newer systems. It admittedly takes a while to build up significant total return numbers, and for that reason looking at the average annualized rate of return (ROR) can make more sense. This measure is more of a "what to expect" than a "what has happened" measure. And sure enough, you will see that the Best by Avg Ann. ROR contains several newer systems that have come out of the gate swinging.

But what if we think of BEST not as the one that surpasses all others, but rather look for that system which is most suitable. The question in that case should not be, "What is your BEST system?" The question should be: "What is MY BEST system?", or in a more grammatically correct form: "What is the best system for me?"

To find what system is the BEST for you, a little soul searching is required. Are you interested in the absolute highest return? Lowest drawdown? Best mixture of the two, perhaps? Or perhaps you think the best system is the one which has been around the longest. There is surely something to be said for longevity. You will quickly find that different systems head many of these lists, showing that the BEST system is an elusive target indeed.

To begin to filter things down, we must incorporate the riskiness of each system. Many investors look at Drawdown to get a feeling of the risk involved. But concentrating solely on drawdown is just as bad as looking only at return. For starters, a system could have a very low drawdown because it has only been trading for a few months (note the Rayo Plus DAX system has only been tracked with actual fills for 4 months) The BEST system for 'lowest' maximum drawdown have been:

But as nice as it is too see a low drawdown, low risk doesn't really help if there is also no return. We can always invest in treasury bills if we want zero risk. The next logical step, therefore, is to evaluate which systems have the BEST return per unit of risk. . This is accomplished through the use of several risk adjusted ratios. The first of these is the Sharpe ratio, which measures returns divided by risk (as measured by the standard deviation of returns, or volatility). The formula actually uses the amount of return over the risk free rate. Attain uses 2% as the risk free rate of return in its calculations. The systems with the BEST Sharpe ratios have been:

One of the problems with using the Sharpe ratio is that it punishes trading systems for having a high upside volatility profile. For example, the Compass system had a one month gain of +74% in 2002, which caused the volatility reading for the system to skyrocket. But it can be argued that upside volatility is of no concern, as that means large positive monthly gains in the distribution of returns. Does it mean an investment is more risky if it has a huge monthly GAIN? Usually not - we think a huge monthly loss is much more important when measuring risk. There is a risk measure which eliminates the upside volatility skew from the Sharpe ratio by using the volatility of negative returns only. This measure is called the Sortino ratio. The BEST systems by Sortino ratio have been:

The Sharpe and Sortino ratios have a flaw, however, in that they view the volatility of returns as the main ingredient of risk. This speaks nothing of what sort of drawdown had to be encountered to get the return. As many trading system investors can attest to, it is the drawdown period which represent the most risky part of the investment, not the volatility of returns. The Sterling ratio measures returns divided by risk (as measured by drawdown). The BEST systems by Sterling Ratio have been:

One last piece if information it is important to take into consideration is the length of track record. The above tables have looked at systems with at least four months of actual trading data, but measures such as the Sharpe ratio are usually computed on at least 3 years of data. The shorter the length of a track period, the greater the margin of error in the statistics. Thus a system such as Spartan ES or SC Forex, which look very nice atop many of the BEST tables above, could have a very large margin of error given their relatively short track records. The BEST systems for length of track record are:

So what system is the best overall? It again depends on what you are looking for, but the overall picture does have some clues. Our rankings define the BEST system mathematically by using a simple formula for scoring systems based on their ranking among all 42 systems we track with actual customer fills. For each of the above eight categories, we ranked each system 1 through 42, with a BEST in category equaling 1 point on down to a worst ranking of 42. The sum of all scores was computed to get the following standings for the Top Fifteen BEST systems at Attain:

Best Overall? Attain's Top Fifteen
Overall	System Name	YTD	Avg. Ann ROR	Total ROR	Max DD	Sharpe Ratio	Sortino Ratio	Sterling Ratio	Data (mos)	Init Cap (000's)
1	Delphi ERL	45.8%	55.4%	46.2%	53.8%	3.79	8.69	1.10	10	$15
2	AXIOM Index eMD	-6.6%	44.8%	89.6%	65.2%	3.64	8.36	1.05	24	$15
3	Compass SP	-22.6%	37.9%	243.2%	64.9%	2.38	7.57	0.83	77	$30
4	Spartan ES	31.1%	74.6%	31.1%	10.3%	15.82	99.00	3.67	5	$8
5	Bounce ERL	32.7%	33.1%	52.4%	9.3%	3.17	11.76	1.83	19	$10
6	Delphi EMD	19.7%	29.9%	24.9%	48.1%	2.66	4.16	0.71	10	$15
7	SC Forex GBPUSD	20.2%	60.6%	20.2%	20.6%	5.39	18.75	1.98	4	$20
8	Bounce EMD Swing	38.9%	22.5%	35.6%	16.7%	1.95	4.62	0.88	19	$10
9	TZAR eRL	10.7%	15.9%	38.4%	43.7%	1.63	2.93	0.39	29	$30
10	Rayo Plus DAX	19.7%	59.1%	19.7%	5.3%	8.30	66.01	3.87	4	$30
11	Impetus eRL	28.7%	10.9%	27.2%	27.9%	1.43	2.18	0.42	30	$10
12	Phi Plus DAX	16.6%	49.9%	16.6%	22.7%	2.01	15.19	1.53	4	$33
13	Bounce ERL Swing	8.3%	17.9%	28.3%	10.7%	2.77	6.95	0.94	19	$10
14	Beta DAX v2	11.9%	28.6%	11.9%	6.7%	3.48	21.11	1.71	5	$42
15	Ping Systems	11.3%	19.4%	11.3%	59.0%	0.89	1.96	0.26	7	$30