MONAQ: Multi-Objective Neural Architecture Querying for Time-Series Analysis on Resource-Constrained Devices
About
The growing use of smartphones and IoT devices necessitates efficient time-series analysis on resource-constrained hardware, which is critical for sensing applications such as human activity recognition and air quality prediction. Recent efforts in hardware-aware neural architecture search (NAS) automate architecture discovery for specific platforms; however, none focus on general time-series analysis with edge deployment. Leveraging the problem-solving and reasoning capabilities of large language models (LLM), we propose MONAQ, a novel framework that reformulates NAS into Multi-Objective Neural Architecture Querying tasks. MONAQ is equipped with multimodal query generation for processing multimodal time-series inputs and hardware constraints, alongside an LLM agent-based multi-objective search to achieve deployment-ready models via code generation. By integrating numerical data, time-series images, and textual descriptions, MONAQ improves an LLM's understanding of time-series data. Experiments on fifteen datasets demonstrate that MONAQ-discovered models outperform both handcrafted models and NAS baselines while being more efficient.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Time-series classification | PAMAP2 | Accuracy91.2 | 60 | |
| Time Series Regression | BIDMC32SpO2 (test) | RMSE4.67 | 14 | |
| Time Series Regression | LiveFuelMoistureContent (test) | RMSE39.369 | 14 | |
| Time-series classification | Cricket | Accuracy62.5 | 14 | |
| Time-series classification | FaultDetectionA | Accuracy100 | 14 | |
| Time-series classification | UCI-HAR | Accuracy90.8 | 14 | |
| Time-series classification | P19 | Accuracy97.6 | 14 | |
| Time Series Regression | HouseholdPowerConsumption 1 | RMSE152.5 | 14 | |
| Time Series Regression | AppliancesEnergy (test) | RMSE3.607 | 14 | |
| Time Series Regression | HouseholdPowerConsumption 2 | RMSE52.349 | 14 |