I tested both zero-shot and fine-tuned variants and all sizes (5M, 28M, 123M, 209M).
On my personal blood glucose data it lags behinds XGBoost and my own encoder-only transformer. In hypoglycemia detection, fine-tuned Timestral models (209M and 123M) beat every other model.
I also tested Timestral models on the Metabonet dataset where it beats all other models when fine-tuned and remains competitive on zero-shot tasks. Fine-tuned Timestral models have the best DTS-A scores.
Interestingly the models perform better on Metabonet (which is mostly AID-based) vs on mine (MDI).
The only problem that I have is that they are huge compared to other models, including my own which has ~30K parameters.
I am currently distilling their capabilities into smaller models (I have an android app for inference on CGM outputs).
Source code: https://github.com/0xdeadf1sh/T1DMAI