About
Highly dedicated Data Engineer with 0.5 years of experience, specializing in end-to-end ETL pipeline development and deployment, leveraging AWS services including S3, RDS, Glue, and Athena. Proven ability to design and implement scalable data solutions, contributing to data-driven decision-making and operational efficiency. Eager to apply expertise in Data Engineering and Cloud to build robust, high-performance data infrastructures.
Work
USM's Shriram Mantri Vidyanidhi Info Tech Academy (VITA)
|Big Data Trainee
Prayagraj, Uttar Pradesh, India
→
Summary
Led a team of 8 in a big data project, developing a CI/CD pipeline and utilizing OLAP tools to deliver critical insights for law enforcement and community safety.
Highlights
Directed a team of 8 trainees to develop a comprehensive big data project, focusing on the analysis of UK crime data to derive actionable insights.
Engineered and deployed a CI/CD pipeline, automating data processing workflows to enhance efficiency and ensure consistent project delivery.
Leveraged OLAP tools, including Tableau, to conduct in-depth analysis of crime data, generating critical insights that informed law enforcement strategies and community safety initiatives.
Education
CDAC
PG Diploma
Big Data Analytics
Dr. Ram Manohar Lohia Awadh University (IET)
→
B.tech
Computer Science and Engineering
Certificates
Data Science
Issued By
Internshala
Skills
Big Data Technologies
PySpark, Hadoop, MapReduce, Kafka, Hive, Sqoop, Data Warehousing, ETL.
Cloud & CI/CD
AWS S3, AWS RDS, AWS Glue, AWS Athena, AWS VPC, AWS SNS, AWS Lambda, AWS EC2, AWS EMR, CloudFormation, GitHub Actions, CI/CD Pipelines, Data Lake, Data Pipeline Development.
Programming Languages
Python, Pandas, NumPy, SciPy, Airflow, SQL.
Data Science & Machine Learning
Machine Learning (Classification, Regression, Clustering), Deep Learning (ANN, CNN, RNN), Statistics (Descriptive, Inferential, Probability, Hypothesis Testing), Computer Vision, Model Deployment.
Database Management & BI Tools
MySQL, MongoDB, Power BI, Tableau, OLAP, Data Visualization.
Soft Skills
Adaptability, Problem Solving, Communication, Detail-Oriented, Team Leadership.