With over a decade of experience as a Data Engineering Professional, I specialize in Python & SQL for Data Pipeline Development and its Optimization with expertise in GCP and AWS. I have honed my skills in Airflow for batch data pipelines and dbt for data modelling, and I am proficient in Python-based development. I have working experience in Spark/Pyspark running in GCP dataproc. I possess rich hands-on experience in streaming technologies like Kafka, pub-sub, and AWS Kinesis, and am well-versed in containerisation using Docker and deploying it to Kubernetes clusters such as GKE/EKS. My skills extend to building test frameworks, CI/CD pipelines, and working with relational and NoSQL databases, with extensive experience in the Hadoop 2.0(Cloudera) framework.