Hi, I'm Divya M.
A
Self-driven, quick starter, passionate programmer with a curious mind who enjoys solving complex and challenging real-world problems.
About
Highly skilled Data Engineer with expertise in designing and implementing ETL processes, and data warehouses utilizing SQL and Python.Committed to optimizing big data solutions for analytics, ensuring efficient and effective data processing.
- Languages: Python, SQL
- Databases: MySQL, MongoDB
- Big Data: Apache Spark, PySpark
- Data Warehousing: Snowflake, Azure Synapse Analytics
- ETL & Orchestration: Azure Data Factory, Apache Airflow, Databricks Workflows
- Storage: Azure Data Lake, Delta Lake
- Cloud Platforms: Microsoft Azure
- Libraries: NumPy, Pandas
- Tools & Technologies: Git, Databricks, Power BI, Tableau
- Data Engineering Concepts: ETL Pipelines, Data Ingestion, Data Modeling (Star/Snowflake Schema), Batch Processing, Distributed Processing, Medallion Architecture , Data Quality & Validation
Looking for an opportunity to work in a challenging position combining my skills in Data Engineering, which provides professional development, interesting experiences and personal growth.
Experience
- Process Automation: Automated repetitive Excel tasks using Macros, reducing manual effort by 40%.
- Dashboard Development: Designed and maintained interactive dashboards and reports in Power BI, enabling real-time business insights.
- Advanced Excel Expertise: Proficient in PivotTables, VLOOKUP, HLOOKUP, INDEX-MATCH, and advanced charting techniques for in-depth data analysis.
- SQL & Data Integration: Extracted and cleaned raw data from SQL databases, conducted analysis in Excel, and seamlessly integrated insights into Power BI dashboards
- Collected and analysed user interaction data to identify engagement patterns.
- Extracted and processed data from app logs to track feature usage, setup success rates, and user behaviour.
- Leveraged SQL and Excel for data cleaning and exploratory analysis.
- Developed Power BI dashboards to visualize user trends and drive data-backed decisions.
- Delivered actionable insights and data-driven recommendations to improve app usability and enhance setup completion rates. Tools: Python, SQL, Power BI, Advance Excel,
Data Analysis for My Nevo App
Product Analytics: One for All Setup App
- Implemented -NLP models for analysis and gained hands-on experience with a project.
- Utilized Python for data preprocessing, modeling, and evaluation, and applied TensorFlow and Scikit-learn for building and training machine learning models. Tools: Python, OpenCV, Keras, Tensorflow, PyTorch
Projects
Traffic Sign Recongnition using Machine Learning
- Tools: Python, TensorFlow, PyTorch, Keras, CNN
- Register/login to the web app(with OAuth-based Google Sign-In).
- Search and classify Traffic Sign based on CNN Model
Bipolar Classification Methodology using Deep Learning
- Tools: Django, HTML, CSS, SQLite, NumPy, Pandas
- Register/login to the both doctor and patient(with OAuth-based Google Sign-In).
- Report send to paitent email address
IPL Dashboard Using Power BI
Skills
Languages and Databases
Python
MySQL
Power BI
Advance Excel
PySpark
Apache Spark
Azure Data Factory
Azure Data Lake
Snowflake
Libraries
NumPy
Pandas
scikit-learn
matplotlib
Frameworks
Keras
TensorFlow
PyTorch
Education
Karnataka,India
Degree: Master of Computer Applications
CGPA: 8.0/10.0
- Distributed Database Systems
- Cloud Computing
- Python
Relevant Courseworks:
SRNMNC College of Applied Science
Karnataka, India
Degree: Bachelor of Computer Applications
CGPA: 7.2/10.0
- Data Structures and Algorithms
- Database Management Systems
- Operating Systems
- Machine Learning
- Computer Vision
Relevant Courseworks:

.jpg)