About Shaurya
- Designing and implementing microservices and APIs (Python, JVM-based stacks)
- Event-driven and asynchronous systems using Kafka, queues, and streaming architectures
- Service-to-service communication
- Performance optimization, fault tolerance
- Production readiness: logging, metrics, tracing, and alerting
- End-to-end data pipelines (batch and streaming) from ingestion to analytics
- Data lake / lakehouse architectures using open table formats (Iceberg, Delta Lake, Hudi)
- Data modeling for analytics, metrics layers, and downstream consumption
- Orchestration and workflow design (Airflow, custom schedulers)
- Data quality, observability, and governance built into pipelines
- Infrastructure design with scalability and cost efficiency in mind
- CI/CD pipelines, automated testing, and deployment workflows
- Operating systems in production with a focus on reliability
- The system is already in production and needs hardening, refactoring, or scaling
- Data platforms need to move from ad-hoc pipelines to well-architected, maintainable systems
- Engineering teams need help with architecture decisions, not just implementation
English
Native or bilingual
Experience
- RatepayPrincipal Software EngineerDecember 2025 - Today (6 months)GermanyOwn the end-to-end architecture and strategy for Ratepay's engineering, analytics and reporting platform, spanning Microservices, AWS, Kafka, Snowflake, and downstream BI and regulatory systems. Lead the redesign of data ingestion and transformation pipelines (streaming + batch), improving reliability, scalability, and cost efficiency across high-volume financial and transactional data. Drive standardization of data modeling, orchestration, and transformation practices (dbt, Snowflake tasks, Airflow), reducing fragmentation and operational overhead across teams. Partner closely with Risk, Finance, AML, and Product domains to deliver compliant, auditable, and business-critical data products supporting regulatory reporting and decision-making. Provide technical leadership and mentorship to senior engineers, setting engineering standards, reviewing designs, and influencing long-term platform and tooling decisions.
- HelloFreshSenior/Staff Software Engineer - DataE-COMMERCEJune 2024 - December 2025 (1 year and 6 months)GermanyEnhance and maintain a critical high throughput service that manages customers preferences across all channels(Python, Kafka, AWS RDS Postgres) Primary contributor to the design and architecture of a mobile, data and backend initiative to unblock mobile reachable audience for the company (CVA impact > €24 mio) Enhance and maintain a critical high throughput(>10k rps) analytics service driving events analytics for mobile communication channels (Python, Kafka, AWS RDS Postgres) Maintain a medallion data lake on Amazon S3 using the Glue data catalog and Databricks Photon as the query engine, pipelines written in Spark and deployed on AWS EMR. Led the design and implementation of data contracts for all critical data pipelines and assets for the communications domain
- New Work SESenior Software Engineer - Data and ML PlatformDIGITAL AND ITMarch 2022 - June 2024 (2 years and 3 months)Berlin, GermanyWorked on a company-wide Machine learning platform solution deployed on AWS (>70% adoption in the company). Personal Contributions include a core library to access training data agnostic of the query engine, model deployment and model versioning(registry). Led the deployment of a company-wide data lake solution on AWS. Included a solution to migrate data from on-premise HDFS clusters to S3(GitOps, Glue, Spark, EMR, Hudi, Kafka) Maintained multiple backend Scala services like Recent searches(Akka, Kafka, Cassandra) and a legacy Recommendations service(Akka, Shapeless, ElasticSearch). Data pipelines leveraging Kafka streams, Kafka connect, Akka streams, Spark and Oozie workflows Led the deployment of a Vector database platform(Qdrant) on AWS EKS to enable generative AI applications (Terraform, Terragrunt, GitOps) Sole contributor to a high performance service for nearest neighbour searches on the Vector database. Implemented caching and basic auth on top ofthe existing DB endpoint (Rust, AWS EKS, Redis)
Recommendations
Be the first to recommend Shaurya
Help this freelancer shine by sharing your experience working together.
These freelancer profiles also match your criteria
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Education
- PhDTechnical University of Madrid2020PhD
- Masters in Big DataIE University2017Masters in Big Data