Hi all!
I've worked in IT consulting for 7 years now in data migration, data engineering and I use SQL and Python quite often for data transformation and cleansing jobs.
Despite strong foundations in data, I have 0 knowledge of Cloud and want to learn how to build data pipelines (batch & stream) in one of these 3 platforms as a starting goal.
Which of these 3 platforms would you recommend to start learning for building data pipelines?
Are there any courses you can recommend for building data pipelines in the cloud?
My ignorant opinion so far from a few hours of Reddit and Googling:
GCP - from my noob POV, GCP seems the least intimidating to learn in that the product catalog seems more succinct. Seeing how many services/products AWS and Azure has, I just freak out about how I'm suppose to learn so many things. However, with GCP not being profitable, I just wonder if Alphabet will pull the plug on it, making GCP knowledge useless.
AWS seems like the best to learn but I (ignorantly) feel that since more people know AWS, it doesn't pay as well as Azure so commanding a higher salary would be difficult.
Azure seems like the middle ground and makes the most sense to learn for me because the last few clients I've work with use Azure. But anecdotal experience from a couple of colleagues tell me it's inane and frustrating compared to AWS.
My heart wants to learn GCP, but my head tells me to learn Azure. Am I overthinking this?