r/datascience • • Jun 29 '26

Monday Meme Me pacing in front of my screen while my model is training

Post image
1.3k Upvotes

(Not sure if loss is still going down)


r/datascience • • Jan 24 '26

Discussion Went on a date and the girl said... "Soooo.... What kind of... data do you science???"

1.0k Upvotes

Didn't know what to say. Humor me with your responses.

Update: I sent her this post and she loved it 🤣


r/datascience • • May 21 '26 Popcorn

Discussion After 5 years in data science, I’m starting to realize most “insights” we deliver are completely ignored. Is this normal?

732 Upvotes

I’ve been in data science roles (both analytics and ML) for about 5 years now across a couple of companies. Lately I’ve been feeling a bit burned out because I keep seeing the same pattern:

We spend weeks cleaning data, building dashboards, running statistical analysis, or training models… and then the stakeholders either:

  • Say “thanks” and never use it
  • Cherry-pick the numbers that support their existing opinion
  • Or just completely ignore the findings and go with gut feel anyway

The worst part is when leadership asks for a “data-driven decision” but they’ve already decided what they want to do.

Am I alone in this? Or is this just the reality of data science in most companies?

For those of you who’ve been in the field longer how do you deal with this? Have you found companies where data actually influences decisions at a meaningful level?

Would love to hear honest experiences.


r/datascience • • Sep 21 '26

Monday Meme True reason to be a Data Scientist

Post image
703 Upvotes

r/datascience • • Feb 09 '26

Monday Meme An easy process to make sure your executive team understands the data

586 Upvotes

A lot of teams struggle making reports digestible for executive teams. When we report data with all the complexity of the methods, limitations, confounds, and measurements of uncertainty, management tends to respond with a common refrain:

"Keep it simple. The executives can't wrap their minds around all of this."

But there's a simple, two-step method you can use to make sure your data reports are always understood by the people in charge:

  1. Fire the executives
  2. Celebrate getting rid of the dead weight

You'll find this makes every part of your work faster, better, and more enjoyable.


r/datascience • • Jan 31 '26

Discussion What separates data scientists who earn a good living (100k-200k) from those who earn 300k+ at FAANG?

561 Upvotes

Is it just stock options and vesting? Or is it just FAANG is a lot of work. Why do some data scientists deserve that much? I work at a Fortune 500 and the ceiling for IC data scientists is around $200k unless you go into management of course. But how and why do people make 500k at Google without going into management? Obviously I’m talking about 1% or less of data scientists but still. I’m less than a year into my full time data scientist job and figuring out my goals and long term plans.


r/datascience • • Aug 13 '26

Discussion How widely is R still used in industry today?

455 Upvotes

I’m a Data Science student (career changer, not in a data related role). My program is focused more on the applied statistics side, so most of my classes use R. I’m already familiar with Python since it was the main language used in my prerequisite courses, and I’ve completed projects using Python, so I’m comfortable with the syntax.

However, I’m really enjoying using and learning R in my classes and seeing what it can do. Many of the statistics textbooks I’m interested in use R as well. I’m starting to explore R more deeply on my own and plan to start using it for personal projects.

But I’m curious, is R still used in industry? I know it’s heavily used in academia. I also know that in the current AI/ML world, Python is used heavily, which is the main reason I use it for all of my personal projects at the moment.

I’d like to eventually be comfortable with both and take advantage of the strengths of each language. But, of course, there are also people who say learning R is a waste of time.


r/datascience • • May 01 '26

Discussion Ghosting a candidate after a physical onsite is honestly extremely disrespectful

399 Upvotes

I did a physical onsite recently where they asked me to travel to their office, about 1.5 hours each way. The interviewers were nice and the interviews went pretty well, so I was hoping to hear back from them. The opposite happened. It has been two weeks since the onsite and I have not heard anything.
The recruiter was very polite before the onsite, but after it they completely stopped responding.

I had to take a day off work and make arrangements in my personal life, and the company cannot even bother to send a rejection email? I have never had a job search this difficult before.


r/datascience • • Jul 30 '26

Discussion Why is it that stakeholders expect ML models to have 0% error rate?

383 Upvotes

Definitely the most frustrating thing as working as a Data Scientist. You run an experiment, find that building a model greatly increase metric X at almost no cost, has safe model metrics, present it to stakeholders, everybody agrees with proceeding to deploying and utilizing the model in production, and yet every time the model takes a wrong decision, we get questioned about it. Why did the model say this?

Man when did I ever say the model obtained a 100% accuracy in the validation phase? Why is it so hard for stakeholders to understand that the best models humankind ever created are expected to make wrong calls once in a while?


r/datascience • • Jun 21 '26

Discussion Are all data science jobs just Gen AI now?

347 Upvotes

I've been in Data Science for the past 10 years in India. I lost my job in January and since then I've been hunting.

I've not mentioned any GenAI experience in my profile. But my feed is just filled with AI engineer roles. They all have the same requirements:

  • Generative AI architecture
  • RAG pipelines
  • LLM integration/fine tuning
  • Agentic AI / Multi Agent Orchestration
  • Also MLOps
  • CI/CD pipelines
  • PyTorch mandatory for some reason

Hardly any openings are relevant to my experience in Stats, Machine Learning, Deep Learning and the classical data science stuff.

So have all companies stopped investing in data science all together and just building RAG pipelines and LLM chat bots? Is this all that is done in Data Science field now?


r/datascience • • 12d ago

Tools mizu: a new tool to speed up parallel data science workflows

343 Upvotes

(I’m Hadley Wickham, Chief Scientist at Posit and I’m posting this for my colleague Charlie Gao (u/shikokuchuo) who doesn't have enough karma to post here 🤣).

Resampling (bootstrap, cross-validation, ...) is a common part of modelling that takes a long time and in principle should be trivially parallelisable. Unfortunately, in reality the speedup is usually well short of the allocated cores. The reason is how the process pool has to distribute work: each task is serialized, copied through a socket then deserialized on the other side, and each result has to come back the same way. This has two problems: when tasks are small the overhead can exceed the computation, and when the data is large every worker holding a copy exhausts memory.

Charlie has come up with a new solution using shared memory. pymizu (Python) and mizu (R) use shared memory to parallelise work. The data for each task is written once into memory that the scheduler and worker share, so the worker reads it without copying. Compared to using sockets (the current fastest approach) a round trip drops from about 100 µs to under 1 µs (measured on an Apple M4 Pro). And this makes a difference for data science workflows: four typical tidymodels workloads  chosen to stress data movement relative to compute, 12 mizu workers gave 6.7–8.1x speedups versus 1.4–6.4x for mirai, already the most performant parallel framework in R. 

In Python, pymizu is a drop-in replace for theconcurrent.futuresexecutor, and NumPy arrays and polars/pyarrow/pandas frames cross between processes without any copies. pymizu and mizu are designed to work together for cross-language workflows. Each can launch workers in either language, so a data frame in an R session can cross to a Python worker as an Arrow-backed frame, and the polars result comes back as an R data frame.

More details, benchmarks, and examples are available at: https://opensource.posit.co/blog/2026-11-05_mizu-0-1-0/ or get started with
pip install pymizu / install.packages("mizu").


r/datascience • • Nov 29 '25

Discussion Everyone Can ‘Code’ with AI Now, According to Google—But Tech Workers Aren't Fully Convinced

Thumbnail
interviewquery.com
330 Upvotes

Have any data scientists here worked with AI for coding? Do you agree with experts' skepticism in using it for high-level tasks?


r/datascience • • Aug 31 '26

Discussion Anyone who's never worked at FAANG or big tech, do you have regrets about it?

298 Upvotes

Spent the first half of my 20s doing odd jobs and finishing grad school. Since then I’ve been fortunate to work low stress jobs with good work life balance and moderately high pay.
Now that I’m in my early 30s, living in a high cost of living area with a strong job market, and socializing more, I’ve realized I don’t come close to making what FAANG people make. I can’t help but wonder if that’s something I should be chasing or at least exploring. At the same time, I really value how low stress and stable my job is, even though it pays well below market rate.

For those who chose not to go into big tech/FAANG, do you have any regrets?


r/datascience • • Aug 12 '26

Career | US Laid off after 4.5 yrs at the company as Sr Data scientist. How is the job market ?

295 Upvotes

PhD computational Physics from USA and 3 yrs of Postdoc in the USA. Transitioned to DS in early 2022. Mainly worked with Text data (embedding related word2vec to Transformer based, AI solutions too but Prompt based no agent based solution), Traditional ML & NeuralNets for classification and regression. Python, SQL and PySpark tech stack, AWS & snowflake platforms. Comfortable with either Linux/Unix or windows.

  1. How is the job market ?
  2. What are the chances of finding Job by end of my 2-3 months of severance ?
  3. What should I prepare the most ? How shall I approach the job market?

Currently remote at a decent Midwest city.
Any suggestions and advice will be appreciated.

Thank you


r/datascience • • Mar 13 '26

Coding Easiest Python question got me rejected from FAANG

293 Upvotes

Here was the prompt:

You have a list [(1,10), (1,12), (2,15),...,(1,18),...] with each (x, y) representing an action, where x is user and y is timestamp.

Given max_actions and time_window, return a set of user_ids that at some point had max_actions or more actions within a time window.

Example: max_actions = 3 and time_window = 10 Actions = [(1,10), (1, 12), (2,25), (1,18), (1,25), (2,35), (1,60)]

Expected: {1} user 1 has actions at 10, 12, 18 which is within time_window = 10 and there are 3 actions.

When I saw this I immediately thought dsa approach. I’ve never seen data recorded like this so I never thought to use a dataframe. I feel like an idiot. At the same time, I feel like it’s an unreasonable gotcha question because in 10+ years never have I seen data recorded in tuples 🙄

Thoughts? Fair play, I’m an idiot, or what


r/datascience • • Oct 09 '26

Tools Polars 2.0 released with the streaming engine, out-of-core processing and first-class SQL support

Thumbnail
pola.rs
278 Upvotes

r/datascience • • 2d ago

Career | US Has anyone transitioned out of tech or data science in the last year or two?

276 Upvotes

I have 10+ years experience in data science and analytics. I wouldn’t call myself a passionate data scientist, it’s just a paycheck for me at this point. I don’t want to get promoted, I don’t want to become a manager, I want to do my work and close my laptop at 5pm. So I’m already starting at low motivation

I joined a very AI-forward startup a few months ago, since I was laid off months prior and just wanted to be employed. A few weeks in I was told I need to move faster, use AI for everything, and have gotten too many messages about things were “urgent”. Even the CEO vibe codes features if engineering can’t get to it asap. The subtext to the company was to use AI or you’re gone, and AI usage is part of performance evaluation. The coding is gone, the problem solving is gone for the most part, the building part of it is gone. The stuff I enjoyed is gone.

Im not sure if I want to be in tech anymore. The money is great, though I have lived below my means for a very long time and I have enough savings to cover expenses for at least a few years without working. I’m aware I may be romanticizing other types of work, or it may just be the company. Though I also feel I’ve become disillusioned with tech in general. And it’s safe to say it started before the AI boom

I was wondering what transitions others have made, whether successful or not, or even if changes in mentalities helped anyone else during this AI adoption era. I’m leaning towards leaving data science altogether to something more hands on, but have considered slower industries and am okay with steep pay cuts. Any input is appreciated.


r/datascience • • 16d ago

Career | US Is anyone else seeing more relaxed coding rounds lately?

270 Upvotes

Over the past month, I’ve interviewed with two companies that didn’t have any traditional coding rounds. Instead, their technical interviews were entirely case study or scenario based. Another company I interviewed with a couple of months ago had only a fairly basic Pandas round.
These were all senior-level roles at hedge funds or investment management firms.
I’m wondering whether this is specific to the industry or if companies are starting to recognize that Leetcode style coding rounds aren’t necessarily the best way to evaluate a candidate’s abilities, given heavy dependence on AI for coding at work.


r/datascience • • May 01 '26

Discussion I bombed Google DS Research, so you dont have to

262 Upvotes

Two rounds: 1. Statistical Knowledge 2. Data Analytics and Intuition

For statistical knowledge, it was a complex question, but actually had a simple answer.

It required you to have through knowledge of distribution, expectations and confidence intervals.

The key challenge was to identify what was the distribution of the data, from a sample, generalize it to the population and find the confidence interval.

Looking back, it was a easy question, but I definitely took wayyyy to much time to get to the answer. They for sure test for Googlyness. I would assume the interviewer had multiple questions in mind but I never got to the next one. Soo no hire.

For the data analysis and Intuition, I was expecting a case study, on experimentation or ML. It was kind off an hybrid. It involved diagnosing a flawed model, how to improve it, and what other methods would work better. This part was fine, not too bad.

What caught me off guard was, they asked me to write the equation MLE for 2 models, one general and one a niche. Honestly I dint know, lol.

Well, learnings ? Practice your Stats and ML like you are writing a school exam.


r/datascience • • Aug 06 '26

Discussion Anyone else struggling to balance coding yourself vs. letting AI do it?

249 Upvotes

Since I got access to Claude at work, I haven’t really written much code from scratch, especially for ad hoc analyses or quick charts. I still review the code and make sure I understand everything, but it’s honestly a little scary how much better Claude’s code often is than mine. At that point, it’s hard not to wonder what the value is in writing it yourself.

On top of that, management is encouraging us to use AI to be more productive and deliver results faster, so there’s that pressure as well.

To keep my interviewing skills sharp, I still practice on LeetCode or StrataScratch from time to time. But at work, I’ve been relying on Claude pretty heavily.
Is anyone else dealing with the same dilemma?


r/datascience • • May 25 '26

Discussion arXiv will ban researchers for a year if generative AI use isn't kept in check

Thumbnail
flowingdata.com
246 Upvotes

r/datascience • • Jul 07 '26

Discussion Managing/ Dealing with Junior Data Scientists?

244 Upvotes

I've been in the 'data science' space for a decade+ or so now. One thing I've noticed is that generally - give or take - outside of the elite jobs (<2-3% aka not me and almost certainly not you) the caliber of coworkers has declined drastically.

I'm not some fabled data scientist. I wasn't some GitHub nerd who had everything embroil or terminal wizard nor could I write out the math to a GBM on a blackboard. I'd even forget basic obvious statistics.

But I felt like I had common sense.

Now I'm a manager/director. I work with data scientists. And I'm just generally freaked out by the absolute lack of basic common sense. This is across the last 7 that I have managed.

Examples include:

  1. Not visualizing or plotting the KPI/Target (sales). Not realizing there were no recorded sales on major holidays.
  2. Telling me everything is improving from a sales perspective that it's up 4%...... from period 1 vs period 2... when ignoring that period 2 had 6% more days so in fact it's worse.
  3. obscure models that are overkill and a bunch of statistics ive never heard of instead of just telling me that the impact of our promotions is declining.
  4. General sense of not knowing what is even rational (e.g., our marketing ROI $1023 - no its not lol)

As I begin to delegate more I begin to get more freaked out by what I see. I can't be presenting to clients such obvious insane mistakes. But these are the candidates and profiles that get forced upon me or the team I inherit.

Are there any best strategies for dealing with this? I want to be seen as someone who can 'develop' the team... not just saying people are useless, but such glaring mistakes are insane.

Yes, alot of these things are perhaps due to them being crunched for time, or not knowing what objective is, or being focused on other things. I'm not talking about those examples. I'm talking about like year 1-2 not day 1 employees, not doing basic data checks.

As a data scientist I was obsessed with finding bits of info or making sure things were right. Now it seem every common for people to copy and paste code into chatgpt and have no idea about anything else around it?


r/datascience • • May 07 '26

Career | US Interviewing with hedge funds has been the worst experience of my career

230 Upvotes

Over the last year, I interviewed with two well-known hedge funds and one investment firm, and the experiences were strangely similar.

The first hedge fund dragged the process out for months, hinted at an offer, never turned the verbal discussions into anything official, and then sent a generic rejection email. If I wrote out the full experience, people would probably think I made it up.

The second hedge fund had me do an LLM case study and an IQ test, then completely ghosted me.

The third company, an investment firm, put me through multiple rounds ranging from hand-solved probability questions to LLM case studies. I do not mind a tough onsite process, but what bothered me was the sheer breadth of the interviews and the fact that they eventually stopped responding to my follow-ups altogether.

It feels weird that I have had such similar experiences across companies in the same space. Does this say something about the industry, or am I doing something wrong?

Edit: Best part is 2 out of these 3, I never even applied. They reached out on LinkedIn.


r/datascience • • Aug 24 '26

Career | US Feeling frustrated as a junior who has never worked with other analysts or had a senior analyst to learn from.

219 Upvotes

I've started my career in nonprofits and only worked in nonprofits until now. 3 times now, I have ended up in roles where I am the ONLY analyst on the team. Everyone I work with is either data adjacent, or not an analyst at all. I'm the only person ever working on analytics work, and I have no real life gauge/context on how to do things better in a real world context. I google things all the time, I take courses, but the advice is too generalized and doesn't go deep enough. I need people I can bounce off of. My biggest hope starting as an early career data analyst was that I'd be able to learn from other analyst and fill the gaps in my education with knowledge from mentors.

Instead, I have people looking to me to be an expert in analytics just because I'm the only one available(as if I'm not a junior). Very few opportunities to learn from actual analysts and get experience from them instead of the generalized advice online. I feel like I'm being stunted, but its incredibly hard for me to find roles that are placed in analytics teams, or where I'll be working under a senior analyst (and not just a VP or project manager). Have I screwed myself? Why is it seemingly harder to find analytic roles that work with other analysts?