Senior Big Data Engineer

Transforming raw data into actionable insights with 4.5+ years of expertise in AWS, Spark, and scalable data architectures.

Professional Portrait

About Me

Passionate about turning data into insights

Senior Big Data Engineer

Seasoned Sr. Big Data Engineer with 4.5+ years of experience in developing robust big data solutions, ETL workflows, and cloud-native applications. Proficient in Java, Scala, Python and Spark with expertise in AWS services.

Adept at designing scalable architectures, implementing data pipelines, and delivering actionable insights through advanced BI tools. Currently working as a freelance consultant, helping organizations leverage their data for strategic decision-making.

Data Engineering Workspace

Technical Skills

Expertise across the modern data engineering stack

Programming Languages

Python 90%
Scala 85%
Java 80%

Big Data Technologies

Apache Spark 95%
Hadoop 80%
Kafka 75%

AWS Services

EMR, Glue, S3 90%
Lambda, Redshift 85%
DynamoDB, IAM 80%

Databases & BI Tools

MongoDB, MySQL 85%
Power BI, QuickSight 80%
Elasticsearch 75%

Experience

My professional journey in data engineering

Senior Big Data Consultant

Freelance Services
April 2025 - Present

Designed and implemented cloud-native data architectures leveraging AWS services such as Glue, Redshift, Amplify and Lambda for scalable and cost-effective data processing.

  • Built robust ETL/ELT pipelines using AWS Glue and State machine
  • Optimized data lake and warehouse performance with S3, Lake Formation
  • Ensured security and compliance through IAM, CloudTrail, and CloudWatch

Senior Big Data Engineer

Rydot Intuit Pvt. Ltd.
November 2020 - April 2025

Engineered and optimized ETL pipelines using Spark, Scala, and AWS services to process multi-terabyte datasets for enterprise-level applications.

  • Designed cloud-native applications using EMR, Lambda, and Step Functions
  • Implemented data visualization dashboards using QuickSight & Power BI
  • Developed secure APIs using Spring Boot with OAuth2 integration

Key Projects

Showcasing impactful data engineering solutions

Cloud Computing

BookMyShow Migration

Migrated 10+ TB data to S3 and Redshift with automated pipelines using EMR and Glue. Created QuickSight dashboards for operational insights.

Spark Scala Redshift S3 Lambda Glue
Data Analytics

Revel Informatics

Built dynamic ETL pipelines for structured and semi-structured data sources. Designed custom analytics dashboards with global filters and Spring Boot microservices.

Spark Scala Java Spring Boot MongoDB Elasticsearch
Cloud Platform

Swayam Cloud Platform

Developed AWS Cloud APIs for resource auditing and BOM processing. Created comprehensive QuickSight dashboards for operational insights.

Java API Gateway Redshift S3 Lambda DynamoDB
Mobile App

Adama Farmer App

Designed backend for web CMS and mobile application using Scala Play framework. Integrated weather APIs and campaign management modules.

Scala-SBT Scala Play MongoDB Weather APIs

Education

Bachelor of Engineering in Computer Science

Government Engineering College, Modasa
2016 - 2020

Gujarat Technological University (GTU)

Achievements

Technical Blogging

AWS services blogs

Published multiple technical blogs on AWS solutions at awspcube.blogspot.com

Get In Touch

Let's discuss your next data engineering project