MethodologyALQA RESEARCH
We reject most strategies we test.That is what testing is for.
ALQA portfolios follow programmed rules that determine which funds to invest in, how much to allocate to each and when those allocations change.
How do we test these rules?
Before accepting a strategy, we test its performance and risks across different market conditions, accounting for trading costs and measuring the impact of delayed execution. We evaluate the results against acceptance criteria set before testing begins. We then test the strategies together within the portfolio. During operation, the rules are applied automatically and any change is documented in a new version.
Every test has a question.Every result has a prior criterion.
- Randomized versions each portfolio must outperformWe compare each portfolio with randomized versions of itself to test whether its rules add value beyond chance.
- 1,000
- Periods within the research sampleTo assess whether results hold across different periods, rather than depend on one favourable stretch.
- 4
- Evaluation outside the research sampleTo assess the frozen rules on data not used to develop them, without adjusting the rules after seeing the results.
- 1
- Trading-cost levelsThe strategy must remain viable at the highest tested cost level.
- 3
- Reference threshold for alphaA published reference for assessing the alpha t-statistic against the market model and a four-factor model.
- t > 3
- Restart drills per releaseEach release must pass eight drills to verify that the system resumes operation correctly after a restart.
- 8
- Consecutive trading sessions meeting reconciliation criteriaRequired on the automated execution platform, with two reconciliation checks per session and a maximum permitted difference of one share.
- 21
- Discretionary decisionsEvery decision follows a predefined rule and is executed automatically.
- Zero
- Documents with publicly verifiable timestamps16 rule files and 127 specifications, with publicly verifiable timestamps.
- 143
Every criterion and its numerical threshold is registered before the corresponding test runs. Amendments are dated in the specification.
View the registration recordsThe records identify prior calculations and amendments after results, and explain the limits of the recorded chronology.View documentation fingerprints · SHA-256
8849a3261342daee051371f1fe7d0f274a65e2d827af87957fe6102e7ee975385263b478c34dca1d0a455a7ac922de5211766ad11f41dea1ece33ac49ef9a901aad70330d4f37783632f83a26ab3c64e96a10b655abd044392710bccc2132430f3d2f3b4c5600e3f9e69638f051ec684b9efc1b577c3aea8de2cd9530199192eb7b378e54e14e512a9902862144650311faeafab09b270b76d3957833ae78746The research process
Discover how we test.
Choose a stage and try the idea yourself. Each example explains one part of the methodology.
Six connected stagesSwipe to explore →
Stage 01 / 06Before testing
We define the test before we see a result.
Rules, data, costs and acceptance criteria: we define them in advance, then save the specification and its digital fingerprint in the research record. Every later change is dated.
Change a detail. Watch the fingerprint.
Illustrative exampleSaved version fingerprint SHA-256
…Current version fingerprint
…Calculating the fingerprint…
Change the number of periods and compare the fingerprints. The example saves the version only within this page.
Where does a timestamp come in?
The fingerprint checks whether versions match. An external timestamp adds evidence that a version existed by a documented date. This example calculates a fingerprint only; it does not issue a timestamp.
The example data is illustrative. The fingerprint is calculated from the example in your browser.
Stage 02 / 06Test the timing
Does the timing of decisions add value?
We replay the trades on random days across 1,000 versions, keeping trade count and costs fixed. We then compare the original rule with these versions to understand what its timing adds.
The same trades. Different days.
Illustrative exampleOriginal example timing
6 trades- 01
- 02
- 03
- 04
- 05
- 06
- 07
- 08
- 09
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
- 21
- 22
- 23
- 24
- 25
- 26
- 27
- 28
- 29
- 30
Timing after shuffling days
6 trades- 01
- 02
- 03
- 04
- 05
- 06
- 07
- 08
- 09
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
- 21
- 22
- 23
- 24
- 25
- 26
- 27
- 28
- 29
- 30
Trade count fixedSame costs
Try a single shuffle
An illustration of the test, not strategy results. The circles represent hypothetical trading sessions.
Stage 03 / 06The final test
Years that played no part in development.
We divide the research period into four periods. We reserve the most recent years for evaluation after the rules are fixed: one test, with criteria set in advance, whose result is published whatever the outcome.
Open the reserved period.
Illustrative example- 01Period 1
- 02Period 2
- 03Period 3
- 04Period 4
Fix the portfolio rules first, then open the period that played no part in development.
This illustrates the separation of development and evaluation. It shows no market data or test result.
Stage 04 / 06Test our tools
Do our tools detect what they should?
We test our tools with deliberate errors and a known edge, and recalculate through a separate path. We then test higher costs, delay execution and review the strategy’s behaviour during crises.
Make the test conditions tougher.
Illustrative examplePassing the toughest cost level is a condition of acceptance.
Example conditions: Base costs, no additional execution delay.
The controls only change the example’s conditions. No returns or acceptance or rejection result are calculated here.
Stage 05 / 06Build the portfolio
The components together, in one portfolio.
We combine accepted strategies at fixed weights, alongside bonds, and test the whole portfolio through one engine and one account. We then review each component’s contribution and the chosen weights.
Compare weights and remove a component.
Illustrative exampleIllustrative allocation
100%- Strategy A30%
- Strategy B25%
- Strategy C25%
- Bonds20%
Weights alone do not answer the performance question. We need to test the components together.
Hypothetical weights and names illustrate the idea. The chart is not an offered portfolio or an investment recommendation.
Stage 06 / 06Operating controls
Every decision has rules. Every change has a version.
We test operations in a simulated account using live data and review decisions during operation. Research and operations are separate. Every design change receives a documented, approved version.
Add a change. Watch the operating version.
Illustrative exampleExample record
- 01Operating version v1.0Operating
Fixed rules in this example
Try adding a research change, then look at the operating version.
A hypothetical record explains change control. It does not show real versions or approvals.
PORTFOLIOS & CONSULTING
Explore our portfolios.Or take a closer look at yours.
Explore six portfolios built around defined rules, or work with ALQA to understand your portfolio’s allocation, risks and concentration.
Investing involves risk, including loss of capital. Historical test results are hypothetical and do not represent the performance of any actual account. Past or hypothetical results do not predict future results. Client results differ from model results because of differences in execution, timing, account size and costs.
