Amit Kumar

Built and maintained scalable data pipelines using Azure Data Factory and Azure Databricks (PySpark), managing 500+ workflows for daily ingestion, transformation, and integration of student analytics data across multiple storage layers (bronze/silver/gold) in a Lakehouse architecture. Delivered data engineering solutions for the AskOU GenAI application, integrating Azure Cosmos DB for vectorized metadata storage and Redis Cache for low-latency data access, enabling real-time question-answering capabilities with conversational AI. Led infrastructure automation and data governance by implementing Bicep templates, Azure DevOps pipelines, Databricks CLI/SDK, and Unity Catalog, while securing data access through Azure Managed Identities and RBAC, and ensuring observability with custom logging and Power BI dashboards.

Led data engineering team for Optum Rx Specialty Shipping operations, delivering scalable data solutions across franchise, sales, and finance domains by modernizing legacy ETL workflows and aligning with cloud-first strategies. Modernized and automated data pipelines by migrating from Oracle and Netezza to Databricks (PySpark/SQL) and Snowflake, integrating tools like SSIS and Alteryx to optimize performance, reduce manual intervention, and achieve operational cost savings. Delivered analytics-ready data and BI solutions through end-to-end pipeline automation and development of 20+ Tableau dashboards, while driving Agile delivery using Rally for sprint planning, backlog grooming, and cross-functional collaboration.

Led cloud migration of Verizon IVR-OBVP data platforms to AWS, architecting scalable solutions with Aurora PostgreSQL, AWS SCT, DMS, and EC2, demonstrating AWS Solution Architect expertise. Modernized legacy ETL and reporting systems, migrating MSBI to Talend, SSRS to Tableau, and SQL Server to PostgreSQL for cloud-native scalability and performance. Automated workflows and CI/CD pipelines using Windows Task Scheduler and Jenkins, while managing project tasks, documentation, and sprint delivery via Atlassian JIRA and Confluence, ensuring smooth cross-team collaboration and timely deployments.