SentientEdge

Research letters · 6 November 2026

Research letter, 6 November 2026

This week

The most useful paper this week shows that watching shadow signals safely costs a lot of power. An anytime-valid promotion test cut false promotions from 94.5% to 0%, but it caught a 9.6%-a-year edge only 7.7% of the time. Two papers put LLM research agents on trial. Claude Opus 5.5 claimed predictability in 21% of worlds with no signal, and a one-line hint about "prior research" changed its verdicts. Separately, one LLM-proposed rule had Sharpe near 3 in discovery and validation and 0.26 on its single holdout look. The rest is about regimes: a "sticky" HMM follow-up to last week's paper that was tuned on its own test window, and a calibration result that should change how we score anything regime-dependent. All sources are arXiv. We could not verify any new SSRN or NBER papers from the past two weeks.

1. Can We Stop the Backtest Yet? Anytime-Valid Promotion Tests for Adaptive Financial Research Agents (PROMOTE)

Benhamou, Ohana, Guez, Setrouk, Saadi, Jacquot · 2 Nov 2026 · ICAIF 2026 · arXiv:2611.03384 · no public code (seeds and a hypothesis ledger are described as "accompanying the artifact")

Method.

What they tested and found.

Limitations.

Evidence vs speculation.

What we will do with it. Our daily shadow comparisons and short observation checklist are exactly the "watch until it crosses" pattern this paper models; our pre-registered one-shot studies don't have the problem, the ongoing watch does. We will replay PROMOTE on the 112 settled weekly books from our July regime-conditioning study, one stream per policy, with the paper's bet grid and scale rule fixed before running, and measure its power at our own effect size of about +0.15% a week by injecting that edge into sign-flipped nulls. If the median simulated time to promotion at that edge exceeds 3 years, PROMOTE is dropped as a candidate gate and only its bookkeeping is adopted: every shadow variant gets a ledger entry at creation, and nothing is refunded. Either way, no production change.

2. Evaluating LLM Research Agents as Tests of Return Predictability

Chang Liu · 2 Nov 2026, revised 8 Nov · arXiv:2611.04070 · replication package "planned"; available on request. (The first version carried the title "Are LLM Research Agents Reliable Judges of Predictability? Evidence from Planted-Signal Worlds".)

Method.

What they tested and found.

Limitations.

Evidence vs speculation.

What we will do with it. Much of our signal research is done with AI agent sessions. Our past kills worked because the decision rule sat outside the agent: matched nulls and placebos fixed in advance. This paper says to keep it that way, and to watch the wording of briefs. We will run a planted-signal audit of our own workflow: 20 synthetic worlds built on our real weekly price panel with returns permuted within each date, 10 pure null and 10 with one planted characteristic at a weekly rank IC of 0.02, each given to a fresh agent session under our standard brief, once with neutral wording and once with "early results look promising". If the agent's false-claim rate in null worlds exceeds 10%, or framing shifts the claim rate by more than 15 points, agent verdicts become advisory only and every promotion memo must cite a fixed external test the agent didn't choose.

3. Hard to Fool: A Bounded LLM Research Loop for Quantitative Finance, and What Two Dozen Campaigns Found

Henry Zhang · 4 Nov 2026 · arXiv:2611.06607 · code: github.com/henryzhangpku/autonomous-quant-researcher

Method.

What they tested and found.

Limitations.

Evidence vs speculation.

What we will do with it. Two ideas are directly usable: the holdout that can be opened only once, with a receipt, and the drift-neutral bootstrap. Our "net excess vs SPY" already removes drift for long-only books; any short-premium or market-timing idea would need the drift-neutral check explicitly. We will also run a trial-count audit from our own research records: reconstruct how many variants were actually tried for each signal family that currently survives in shadow, and recompute each survivor's deflated Sharpe with that count. Any survivor whose deflated Sharpe drops below 0.95 is downgraded to exploratory and needs a fresh one-shot holdout before promotion is discussed.

4. Mitigating Return Drag and Regime Whipsaws in Sector Rotation: An Asymmetric Downside-Aware Nested Clustered Optimization Framework

Supriadi · 3 Nov 2026 · arXiv:2611.05310 · code: github.com/obo-cloud/sp500-asymmetric-nco

This is a new paper, not a revision, by the author of the 30 October letter's item 1 (2610.27751). There, regime churn destroyed the regime-conditioned portfolio. This paper adds the persistence fix that was missing.

Method.

What they tested and found.

Limitations.

Evidence vs speculation.

What we will do with it. This strengthens the hysteresis experiment proposed on 30 October and adds a warning: choose the persistence setting before looking, once. Our July study found the regime layer works as a light-touch controller (cash only in stressed or severe states), so a dwell rule would mainly change how often we enter and leave cash. We will pre-register exactly one hysteresis rule for the regime labels that controller uses, enter stressed at the current threshold and exit only after two consecutive weekly formations out of stressed, with no grid, and replay it on the same 112 books. If 20-day net excess vs SPY is not at least as good as the version without hysteresis, or label flips don't fall by at least 30%, hysteresis is dropped and the classifier stays as it is. No second dwell length gets tried on this window.

5. Aggregate Calibration Can Mask Stress-State Undercoverage: Bounded-Memory Forecast Intervals under Recurrent Financial Stress

Ruihang Han, Li-Hsiang Lin · 3 Nov 2026 · arXiv:2611.04223 · code on request

Method.

What they tested and found.

Limitations.

Evidence vs speculation.

What we will do with it. Our regime classifier standardizes breadth and concentration over a 63-day window, which is a bounded, recent-only memory. When stress returns after a calm stretch, the window no longer contains the last stress episode, so the scores may understate how unusual today is. That is the paper's failure mode. We will recompute the classifier's combined score two ways on the existing history, the current 63-day window and an expanding window, and compare the label each produces at the start of the eight stressed or severe episodes in the July study. If the expanding window flags stress earlier in fewer than three of them, we close the question and keep 63 days; if three or more, we open a pre-registered controller replay with no threshold changes before then. One caution from a paper in Watching (2610.40366): with only eight stress weeks, any comparison on stress dates is a sample of eight. Treat the result as a description, not a test.

6. PanelGP: A Probabilistic Factor Model for Asset-Return Panels

Andrea Ruglioni, Damir Filipović · 2 Nov 2026 · arXiv:2611.04040 · code: github.com/Ruglio/PanelGP (data need WRDS)

Method.

What they tested and found.

Limitations.

Evidence vs speculation.

What we will do with it. The transferable finding is the split result: better ranking with worse R². Our scorer is a ranker, so rank IC is the right yardstick, and our fundamentals are neutralized, so we can't replicate a 137-characteristic model anyway. We will compute the weekly cross-sectional rank IC of our four momentum components individually and as the production linear blend, on replay history before 2024 that was never used for tuning, and add exactly one fixed nonlinearity, the rank of the component product. If its incremental IC over the linear blend is under 0.5 percentage points, or flips sign in more than one regime block, it is dropped, with no search over other interactions. We rank this last because the paper's own significance is weak.

Promising experiments

  1. Planted-signal audit of our own agent research (item 2). It's cheap, needs only synthetic worlds on real panels, and directly tests the process that produces most of our verdicts. The framing arm matters as much as the null arm.
  2. PROMOTE replay plus power check on the 112 books (item 1). Even if PROMOTE is too weak as a gate, it tells us how long our shadow watch would need to run to separate +0.15% a week from noise. That number should set observation windows, not a 5-day checklist.
  3. Honest trial-count deflated Sharpe (item 3). It's an afternoon of reading our own records and has no new-data risk. Run it before either regime experiment (items 4 and 5), since it may already downgrade the cash-in-stress policy.

Watching / not yet credible

Updates

Regime-NCO (2610.27751, covered 30 October) has a sequel, item 4 above, rather than a revision. The sequel's PBO of 0.85 reinforces the earlier reading that the regime overlay's problems were about selection as well as churn.

Nothing previously covered was materially revised.


This letter is drafted with AI research assistance and reviewed and signed by Bob Katz. It is research commentary, not investment advice. No result described here is a claim net of trading costs unless stated, and the experiments listed are planned tests of our own models, not findings.