S3-sync sidecar to continuously deploy DAGs for Airflow running on KubernetesSummaryJul 19, 2023Jul 19, 2023
How to add multiple Python custom modules to Spark jobThere are several ways to add additional custom Python modules that will be used for your Spark application. In this article, I will show…Aug 31, 20216Aug 31, 20216
Key Skills For Data Engineer And Resources for LearningTwo years ago, I found the Data Science field and fell it love with it. Coming from an analytical and financial background, I initially…Feb 25, 2021Feb 25, 2021
Finding the motivation for the Data Science journeyThis is the first article that I wrote for my data science journey. I want to document and share the paths, steps and projects, which I am…Jul 18, 2019Jul 18, 2019