Shubham Sharma
Senior Data & BI Engineer | Automation & Analytics
Cary,NC
Summary
Senior Data Engineer with over 12 years of experience delivering enterprise-scale data engineering, business intelligence, and automation solutions within financial services and consulting environments. Strong expertise in Azure Databricks, SQL-based analytics (Impala and MS SQL Server), DataLake architectures, and end-to-end ETL pipeline development. Proven ability to translate business requirements into scalable technical solutions, lead engineering initiatives, and improve data reliability, performance, and operational efficiency through automation and AI-enabled approaches. Highly organized and self-motivated professional experienced in project management, team development and process improvement. Skilled in developing and implementing strategies to increase efficiency and performance. Passionate about driving business growth and creating positive work environment.
Overview
13
13
years of professional experience
4
4
years of post-secondary education
2
2
Certifications
Work History
Associate Director
Credit Suisse / UBS
Raleigh, NC
01.2020 - 03.2026
- Lead data engineering and BI initiatives supporting financial management, executive reporting, and operational analytics across multiple stakeholders.
- Design, develop, and maintain scalable ETL pipelines to ingest and transform data from multiple enterprise sources into centralized Data Lake environments.
- Build and optimize complex SQL and Impala queries to support high-volume analytical workloads, focusing on performance tuning and reliability.
- Develop Power BI dashboards and Tableau reports to deliver actionable insights for financial and management reporting.
- Create Python-based automation solutions using Pandas and Flask to streamline data processing, reporting refreshes, and operational workflows.
- Develop web-based utilities to manage and update Tableau connections, improving maintainability and reducing manual intervention.
- Automate scorecard and reporting data collection using Power Automate and Alteryx, integrating data from more than 15 internal sources.
- Build monitoring and recovery tools to identify and resolve failed dashboard refreshes, improving reporting stability and SLA adherence.
- Collaborate closely with business users during requirement gathering, solution design, and implementation to ensure alignment with business objectives.
- Managed complex projects, ensuring successful delivery on time.
Associate
Cognizant
Pune, India
12.2016 - 01.2020
- Worked as a Data Engineer and BI Developer delivering enterprise analytics and reporting solutions.
- Designed and implemented ETL workflows using SSIS to support structured and semi-structured data integration.
- Developed and optimized Impala and MS SQL Server queries, stored procedures, views, indexes, and scheduled SQL Agent jobs.
- Created automation solutions using Batch and VB scripting to improve operational efficiency.
- Led requirement analysis, coordinated with stakeholders, and ensured timely delivery of data solutions.
- Provided technical guidance and task coordination as a team lead for junior engineers.
- Fostered a positive working environment with clear communication.
- Established strong relationships with key stakeholders, facilitating effective communication across departments and teams.
System Engineer
Tata Consultancy Services (TCS)
Pune, India
03.2013 - 12.2016
- Contributed as a Database and ETL Developer supporting enterprise data warehousing and reporting systems.
- Developed comprehensive MS SQL Server solutions including stored procedures, functions, triggers, views, and indexes.
- Built SSIS and SSAS packages to support data integration and analytical processing requirements.
- Created extensive Batch and VB scripts to support large-scale data migration and automation initiatives.
- Wrote and maintained custom scripts to increase system efficiency and performance time.
- Optimized server functionality, resulting in increased productivity across all departments.
Education
Bachelor of Engineering - Electronics and Communications
Rajiv Gandhi Technical University
India 06.2008 - 06.2012
Skills
- Azure DataBricks
- Power BI
- Python, Spark
- Alteryx
- AI Engineering, Prompt Engineering
- Power Automate
- Power Platform
- Tableau
- ETL Pipelines
- SQL Server Integration Service
- SQL Server Analytics Service
- SharePoint, Sharepoint List, SharePoint WebParts
- Data Integration, Performance Tuning
- PowerShell, Batch Scripting, VB Scripts
- Analytical thinking
- Project management
- Coaching and mentoring
- Team leadership
Certification
Azure AI Fundamentals AI-900
Timeline
Azure AI Fundamentals AI-900
01-2026
Mastering Azure DataBricks for Data Engineers
01-2026
Associate Director
Credit Suisse / UBS
01.2020 - 03.2026
Associate
Cognizant
12.2016 - 01.2020
System Engineer
Tata Consultancy Services (TCS)
03.2013 - 12.2016
Bachelor of Engineering - Electronics and Communications
Rajiv Gandhi Technical University
06.2008 - 06.2012