Bill, I will answer your points, one by one.
Could you explain why you think this is a good test and provide a bit of theoretical justification? If we were to run random data through APS I would hope that APS would not come up with any tradeable patterns. I think that this would be especially true for a very large sample. Previously, I used an illustration of roulette. The roulette wheel can be regarded as a random number generator. If that asumption is true, a roulette wheel is not predictable, not even using APS. I am not suggesting that the securities that we trade are wholly random. Perhaps they are mostly random but sometimes not random.
AFAIK, one can find all kinds of patterns in random data. Suppose APS finds patterns in random data. Do you conclude that: Bill, I do not understand your abbreviation "AFAIK". You will have to explain that to me.
(1) The market data is also random if APS finds patterns there. Not at all! The fact that APS finds patterns in any data (whether random or not) would not prove anything to me. Anyway, in your statement in the previous paragraph you said that "suppose that APS finds patterns in random data" and then you went on in this point to ask whether "the market data is also random if APS find patterns there". You already asked me to assume that the data is random. Therefore, whether APS found any patterns or not would be irrelevant to deciding whether the data is random. It already is random, according to you!
(2) The patterns in market data will not stay profitable in the future Once again, you have already asked me to assume that the data in question is random. Therefore, I would conclude that if APS did find some patterns in random data, the patterns would not last and therefore would not be profitable into the future. I would love APS to be able to find profitable patterns in the outcomes of roulette spins, for example. If so, I would take a (small) computer with me (with APS loaded in it) to the casino and clean up!
or if APS does not find patterns in random data do you conclude that:
(3) The market data is not random if patterns are found Once again, you question is nonsensical. You asked me to assume that the data is random and then you ask me whether I would think, if APS does not find some patterns in random data, that that would prove that the data is not random! Of course not.
(4) The patterns in market data are not random and will stay profitable I do not even understand this point of yours. You already stated that I should assume that the data is random so why would I conclude that the data is not random on the basis that APS did not find any patterns? You added "and will stay profitable". How will anything in this situation be profitable if APS did not find any patterns, as you stated above? To me, it would be excellent if APS does not find any patterns (or very few weak ones, at least) in random data. After all, random data by definition means that the outcomes are not predictable. They happen purely by chance. There is no guiding hand of god, fate, luck, fortune or karma to determine the outcome. As they say for roulette, "the wheel does not have a memory".
I think none of the above conclusions can be reached.I agree with you!
The only test that makes sense is actual trading and real P/L. I do not agree with this point, for the reason already stated above.
Bill