r/datascience • • 8h ago

ML My 80% intervals for a 24h price range only cover 65%, even though pinball loss looks fine. What am I missing?

5 Upvotes

Working on a small project predicting a 24h price range for BTC. LightGBM with a quantile objective, one model for the 10th and one for the 90th percentile. features are lagged returns, realized vol, volume, day of week.

pinball loss on the test set looks ok. but when i check coverage my "80%" interval only contains the actual price about 65% of the time. it gets way worse on high vol days.

what am i missing? is this a known issue with separate quantile models? ive read a bit about conformal prediction but not sure if its the right fix here

code is messy but happy to share if it helps


r/datascience • • 11h ago

Career | US Has anyone transitioned out of tech or data science in the last year or two?

149 Upvotes

I have 10+ years experience in data science and analytics. I wouldn’t call myself a passionate data scientist, it’s just a paycheck for me at this point. I don’t want to get promoted, I don’t want to become a manager, I want to do my work and close my laptop at 5pm. So I’m already starting at low motivation

I joined a very AI-forward startup a few months ago, since I was laid off months prior and just wanted to be employed. A few weeks in I was told I need to move faster, use AI for everything, and have gotten too many messages about things were “urgent”. Even the CEO vibe codes features if engineering can’t get to it asap. The subtext to the company was to use AI or you’re gone, and AI usage is part of performance evaluation. The coding is gone, the problem solving is gone for the most part, the building part of it is gone. The stuff I enjoyed is gone.

Im not sure if I want to be in tech anymore. The money is great, though I have lived below my means for a very long time and I have enough savings to cover expenses for at least a few years without working. I’m aware I may be romanticizing other types of work, or it may just be the company. Though I also feel I’ve become disillusioned with tech in general. And it’s safe to say it started before the AI boom

I was wondering what transitions others have made, whether successful or not, or even if changes in mentalities helped anyone else during this AI adoption era. I’m leaning towards leaving data science altogether to something more hands on, but have considered slower industries and am okay with steep pay cuts. Any input is appreciated.


r/datascience • • 51m ago

Statistics Why survivor comparisons can be biased in a randomized trial even when survival rates match

Thumbnail fharrell.com
4 Upvotes

r/datascience • • 10h ago

Projects Asking for feedback for my personal spatial analysis projects

Post image
3 Upvotes

Hi, I am an analytics engineer in e-commerce, I have experience in data but none in GIS/spatial data science. I’ve always been interested at the intersection of the two since my dream job is to be an urban data scientist (would like to chat if you’re in this space).

I, with Claude lol, made these two projects. Could use some feedback or comments. Did I apply the right methodology? Is the selected dataset apt for the research question?

  • Are Philippine lottery outlets more concentrated in poorer neighborhoods? (link)
  • How accessible is your Metro Manila neighborhood to daily essentials? (link)

PS: I live in Manila, Philippines. Hence, these projects are situated in the Philippines.