Pravin Yadav Databricks, Data Engineering, Power BI, Airflow
No reviews yet

Being an expertise in Data Engineering/Analytics in Azure Domain including ADF, Databricks, Spark, Python, Power BI and Airflow, I can assure you that you'll be learning end to end data lifecycle with real world problems that the industries are trying to solve.

We'll be taking case studies, understanding the architecture and data model and developing data products on top of the model along with learning the concepts.

If you are someone who loves to learn by performing actual task and not just the concepts you are at the right place.

There will be bonus lectures on optimizations and business story telling

Subjects

  • Python Beginner-Intermediate

  • Azure Data Factory Beginner-Expert

  • Apache Spark Beginner-Expert

  • Databricks Beginner-Expert

  • Apache Airflow Beginner-Intermediate


Experience

  • Software Engineer - I (Mar, 2025Present) at 7-eleven
    1. Creation of single source of truth data model
    2. Automation of data usage scenarios
    3. Optimization of Databricks and Azure resource usage
    4. Implementation of data quality rules for critical business reports
    5. Enhancement and fixes on multiple domains including finance, customer 360, loyalty events and point of sales.
  • Senior Software Engineer (Mar, 2024Mar, 2025) at Tiger Analytics
    1. Developed a metadata driven framework for migrating Tibco Data Virtualization’s workflows to Azure Databricks
    using BFS algorithm, SQL dialect conversion, great expectations quality checks and dynamic python programming
    along with leveraging Lake-House Federation feature and necessary spark optimizations which led to faster migration
    process for easy and medium workflows and reduction of cost for execution by 50% for complex workflows.
    2. Developed Custom Data Factory pipelines using Azure Functions, For-Each, Dafa-Flow activities etc for a Fortune
    500 Banking and Investment Company having legacy on-premise DB2 mainframe systems as source.
    3. Developed a MVC based Rest-API layer for users using Fast-API and OOPS that leverages Databricks API and SQL DB.
    4. Part of internal research team that performs POC on potential solutions across variety of data engineering problems.
  • Data Engineer (Jun, 2021Mar, 2024) at LTIMindtree Bangalore
    1. Worked in multiple end to end Reporting ETL pipelines(Apache Spark/ DLT) and dashboarding(Power BI) for our client (World's largest cosmetic company) including USA, LATAM and CANADA which provided a broader prospective of Data Driven Marketing across regions.
    2. Worked on multiple Data Modeling Architectures including Medallion and Lakehouse Re-design.
    3. Part of an agile project following CI/CD which provided immense learning by handling and implementing design changes (Data Model) by resolving and enhancing multiple SR's and CR's.
    4. Enhanced a Databricks Reporting Batch Job by reducing repeatable table scan in ETL queries and using table logging technique which removed tight dependencies, that led to decreament in execution time by 20% on a daily refresh schedule.
    5. Worked on some critical data quality issues which required quicker fixes.
    6. Worked on tools like Databricks, Power BI, Eclipse and languages including SQL, Python and Java.
    7. Got exceptional in communication skills, being provided multiple chance to interact with clients directly to explain business level impact analysis, modeling and scalability.
    8. Received more than 5 recognition certificates for the contributions, optimized solutions and in-time delivery.

Education

  • Bachelor of Engineering (Jul, 2017Apr, 2021) from St. Francis Institute of technology, Mumbai

Fee details

    5001,500/hour (US$5.2615.79/hour)

    1. No commute will be considerably on the lower side of fees.
    2. Concepts lying under basic to medium difficulty level will be charged as per lower rates.
    3. Any urgent request will be charged based on higher fees.
    4. If there is a task which requires preparation of code, environment or cloud access, it will be charged based on higher fees.
    5. PPT, Code Decks (if any used/developed being in the session) will be given free of cost.
    6. Mock Interview will be charged based on higher rates.


Reviews

No reviews yet. Be the first one to review this tutor.