Overview
Results use six public benchmarks and a private commercial set. Improvements vs a strong MoE baseline are consistent, ablations identify key contributors (pretraining, FTC, RevIN). No code or public NEV-sales provided, which limits immediate replication.
Citations0
Evidence Strength0.70
Confidence0.75
Risk Signals8
Trust Signals
Findings with numeric evidence: 2/5
Findings with evidence refs: 5/5
Results with explicit delta: 4/5
Reproducibility
Status: Partial assets available
Open source: Partial
At A Glance
Cost impact: 60%
Production readiness: 70%
Novelty: 65%
Why It Matters For Business
Better short-to-long forecasting where periodic patterns exist. The model lowers error vs a leading MoE baseline and keeps inference costs similar, so operational forecasting (store traffic, sales, energy) can be more accurate without extra latency.
Who Should Care
Summary TLDR
MoFE-Time adds a Frequency-Time Cell (FTC) inside Mixture-of-Experts (MoE) blocks and uses pretraining → fine-tuning to learn both periodic (frequency) and temporal features. On six public benchmarks and a proprietary NEV-sales dataset it reduces MSE/MAE vs. Time‑MoE (the main baseline) and keeps inference speed comparable.
Problem Statement
Current large time-series models either ignore intrinsic frequency (periodic) structure or convert signals to frequency space outside the model. That leads to suboptimal forecasts and poor cross-dataset transfer when series have varying periodicity and non-stationarity.
Main Contribution
MoFE-Time: integrate a Frequency-Time Cell (FTC) inside each MoE expert to learn frequency and time features jointly.
Adopt a pretraining → fine-tuning workflow (use Time-300B for pretraining) to transfer prior pattern knowledge across datasets.
Key Findings
MoFE-Time improves average forecast error on six public benchmarks compared to Time‑MoE.
On the proprietary NEV-sales commercial dataset, MoFE-Time outperforms Time‑MoE.
Results
| Metric | Value | Baseline | Delta | Split / Dataset | Evidence | Evidence Ref |
|---|---|---|---|---|---|---|
| Average MSE (public benchmarks) | 0.2755 (MoFE-Time) | 0.2961 (Time‑MoE reported as next best) | MSE reduction 6.95% vs Time‑MoE | Average across six public datasets | Experiments §4.2; Abstract | Table 2 |
| Average MAE (public benchmarks) | 0.3226 (MoFE-Time) | 0.3433 (Time‑MoE) | MAE reduction 6.02% vs Time‑MoE | Average across six public datasets | Experiments §4.2; Abstract | Table 2 |
What To Try In 7 Days
If you use a transformer MoE baseline: add a frequency-aware expert block (FTC) and test on a holdout set.
Apply RevIN at input to reduce non-stationarity before training or fine-tuning.
If you have cross-domain series, pretrain on diverse time-series or fine-tune a large pre-trained checkpoint to capture prior patterns.
Agent Features
Memory
Architectures
Optimization Features
Model Optimization
Training Optimization
Inference Optimization
Reproducibility
Risks & Boundaries
Limitations
NEV-sales is proprietary; gains on that dataset may not generalize to other commercial series.
Paper reports no public code or hyperparameters for full replication beyond optimizer basics.
When Not To Use
When series have no clear periodic components or when FFT-style spectral features are irrelevant.
When you cannot pretrain or lack diverse time-series data for transfer learning.
Failure Modes
Spectral leakage or poor harmonic separation on short or highly irregular sequences.
Reduced benefit on datasets with unstable, non-periodic signals (authors note Exchange-rate is unstable).