Regime-Switching Slippage Model (Mixture-of-Experts) Playbook
Date: 2026-02-24 (KST)
TL;DR
A single global slippage model is usually too brittle for live execution. The desk sees multiple microstructure regimes (calm, stressed, toxic), and parameter drift is regime-dependent.
This playbook proposes a regime-switching mixture-of-experts (MoE) stack:
- Infer latent execution regime in real time (state filter)
- Keep separate slippage experts per regime
- Blend predictions with regime probabilities
- Map model output to urgency/POV/venue policy with explicit kill-switch thresholds
Goal: improve p95 slippage and reduce model surprise during liquidity shocks without sacrificing completion too aggressively.
1) Why This Matters in Production
Most desks already track spread, volatility, imbalance, and participation rate. The issue is not feature scarcity; it is state instability:
- same symbol + same child size can produce very different costs across time
- coefficients fitted in “normal” hours fail around open/close/news windows
- a model that wins on average may still lose the week in a few tail intervals
A regime-aware model prevents overconfidence from a single parameter set.
2) Problem Setup
Parent-order implementation shortfall (bps):
[ IS = \frac{\text{side}\cdot(P_{exec}^{VWAP}-P_{arrival})}{P_{arrival}}\times10^4 + fees ]
We model conditional quantiles (q50, q90, q95), not just mean:
[ \hat{IS}{q}(x_t) = \sum{k=1}^{K} \pi_{t,k}, f_{k,q}(x_t),\quad \sum_k \pi_{t,k}=1 ]
- (k): latent regime (e.g., calm / stressed / toxic)
- (\pi_{t,k}): online regime probability at time (t)
- (f_{k,q}): expert model for regime (k), quantile (q)
3) Regime Definition (Minimal but Useful)
Use 3-state default before adding complexity:
- R1 Calm: tight spread, stable depth refill, low toxicity
- R2 Stressed: wider spread, thinner near-touch depth, higher cancel intensity
- R3 Toxic: adverse markout slope, queue fragility, bursty price jumps
A practical state vector:
- spread z-score
- near-touch depth z-score
- cancel-to-add ratio
- short-horizon realized volatility
- OFI/imbalance extremes
- 5s/30s markout slope
- venue latency/reject burst indicators
4) Modeling Stack
4.1 State Filter (Gating)
Two robust options:
- HMM / switching state-space for interpretable latent states
- Discriminative gate (multinomial logistic / small GBDT) trained on pseudo-labels from clustering + event windows
Online update:
[ \pi_t \propto P(z_t\mid z_{t-1})\cdot P(y_t\mid z_t) ]
where (z_t) is latent regime and (y_t) is observed microstructure signal.
4.2 Expert Models (Per Regime)
Per regime (k), fit quantile models:
[ f_{k,q}(x)=\alpha_{k,q}+\beta_{k,q}\left(\frac{Q}{V}\right)^{\delta_k}+\gamma_{k,q},spread+\eta_{k,q},vol+\xi_{k,q},toxicity+\cdots ]
Notes:
- allow (\delta_k) to vary by regime (concavity changes under stress)
- hierarchical shrinkage by symbol-liquidity bucket to stabilize thin names
- maintain separate experts for buy/sell if asymmetry is material
4.3 Residual Tail Layer
Even regime experts underpredict in shock windows. Add residual tail uplift:
[ \hat{IS}{95}^{final}=\hat{IS}{95}^{MoE}+u(x_t) ]
with (u) trained on exceedance episodes only.
5) Policy Translation (Model -> Action)
Predictions are only useful if converted into deterministic desk actions.
Define remaining budget:
[ Headroom_t = B - (IS_{realized,t} + \lambda,\hat{IS}^{remaining}_{95,t}) ]
Policy map:
- Normal: (\max_k \pi_{t,k}<0.6) and headroom healthy -> baseline POV
- Caution: stressed state dominant or headroom tightening -> smaller clips, tighter venue filters
- Defensive: toxic state dominant and rapid budget burn -> lower POV, longer spacing, optional pause ladder
Always include hysteresis + minimum dwell time to prevent flip-flopping.
6) Validation Protocol (What to Trust)
6.1 Walk-forward structure
- rolling forward-only splits
- regime-stratified reporting (not just global metrics)
- separate scorecards for liquid/mid/thin symbols
6.2 Metrics
- pinball loss (q50/q90/q95)
- q95 coverage by regime
- exceedance magnitude (expected shortfall over q95)
- completion SLA impact
- net alpha after cost
Promotion condition should require tail improvement + acceptable completion.
7) Online Monitoring and Retraining Triggers
Track in real time:
- State occupancy drift (today’s regime mix vs baseline)
- Coverage drift by state (underestimation concentration)
- Gate confidence collapse (high entropy in (\pi_t) for long periods)
- Infrastructure confounding (latency/reject incidents misread as market regime)
Retrain triggers (example):
- q95 coverage miss > +4% for 3 consecutive days in any key regime
- toxic-state occupancy > 2x baseline for 5 sessions
- gate entropy > threshold for >30 minutes during active execution
8) Practical Rollout Plan (10 Trading Days)
- D1-D3 (Shadow): compute (\pi_t), MoE forecasts, no control impact
- D4-D6 (Soft control): apply policy map on low-risk symbol bucket only
- D7-D10 (Guardrailed scale): widen universe with intervention caps + manual override
Stop rollout immediately if completion degradation exceeds preset SLA tolerance.
9) Common Failure Modes
- too many latent states (overfit, unstable filtering)
- gate trained with leaked post-trade features
- no separation between venue outages and true toxicity
- global retrain cadence that ignores state-specific drift
- improving mean cost while tail risk worsens
10) Implementation Checklist
- strict feature timestamp contract (decision-time only)
- regime gate with live posterior logging
- per-regime quantile experts + shrinkage
- tail uplift module for exceedance clusters
- deterministic policy map with hysteresis
- dashboards: occupancy, coverage, exceedance, SLA
- incident labels (infra vs market) wired into postmortems
References
- Almgren, R., & Chriss, N. (2000). Optimal Execution of Portfolio Transactions.
- Gatheral, J. (2010). No-Dynamic-Arbitrage and Market Impact. Quantitative Finance. DOI: 10.1080/14697680903373692
- Obizhaeva, A., & Wang, J. (2013). Optimal Trading Strategy and Supply/Demand Dynamics. Journal of Financial Markets. DOI: 10.1016/j.finmar.2012.09.001
- Huang, W., Lehalle, C.-A., & Rosenbaum, M. (2014). Simulating and analyzing order book data: The queue-reactive model. arXiv:1312.0563
- Taranto, D. E., et al. (2016). Linear models for the impact of order flow on prices I: Propagators. arXiv:1602.02735
- Szymanski, G., et al. (2023). The two square root laws of market impact and the role of sophisticated market participants. arXiv:2311.18283
Closing Note
In live execution, “one-model-fits-all” is usually hidden regime overfitting.
Treat regime as a first-class variable, blend experts online, and tie predictions to explicit control states. That is how slippage modeling becomes an operational risk system, not just a backtest chart.