Kalpit Jhaveri
Charlotte
Summary
Seasoned Lead Software Engineer with comprehensive experience in managing high-quality software development projects. Strengths include strong leadership, effective communication skills, and deep knowledge of modern programming languages. Able to drive innovation and efficiency while maintaining tight schedules and budgets. Proven track record for delivering robust solutions that increase business productivity.
Overview
14
14
years of professional experience
Work History
Senior Software Engineer, Data Analytics & Computational Intelligence
Lowes Inc.
07.2019 - Current
- The team needed to scale the supply chain operations and build a fault-tolerant distributed application to handle a high volume of real-time data from various sources
- Design and develop a scalable system to meet 24x7 uptime requirements and ensure seamless integration with other business units
- Led the design and development of multi-tier applications leveraging technologies such as Apache Kafka, Spring Boot, and AWS services (S3, Redshift, EMR)
- Implemented scalable REST APIs and built Lambda architecture pipelines using Apache Spark
- Successfully built a distributed system that scaled with the growing data volumes, reduced system downtime by 25%, and improved overall data processing speed by 30%
- Production issues were affecting data science models, causing delays in debugging and remediation
- Improve production support for data science models by creating detailed operational documentation
- Created a comprehensive SRE (Site Reliability Engineering) document that mapped error codes to specific actions, enabling quicker identification and resolution of production issues
- Reduced time spent troubleshooting and remediating production issues by 40%, leading to improved model performance and reduced operational overhead
- The offshore team was facing challenges in aligning with the core development practices and timelines
- Improve coordination between onsite and offshore teams while ensuring high-quality output
- Mentored a team of 10 offshore engineers, set up regular code reviews, and introduced best practices for CI/CD using Jenkins and Docker
- Increased team productivity by 20%, accelerated development timelines, and enhanced code quality across teams
Senior Software Engineer, Data Analytics Engineering
Syapse Inc.
06.2018 - 07.2019
- The company required an efficient data processing pipeline to handle massive healthcare datasets and reduce processing costs
- Optimize and scale the existing ETL pipeline to handle terabytes of healthcare data efficiently on AWS EMR
- Designed and implemented an optimized PySpark-based ETL pipeline, refactored existing code to utilize AWS S3 and Redshift for improved storage and data retrieval efficiency
- Reduced the cost of running EMR jobs using smarter job partitioning and data storage strategies
- Reduced EMR processing time by 75%, leading to a significant reduction in operational costs, while improving the overall speed and efficiency of the ETL pipeline
- The company was facing downtime in its production environment due to inefficient microservices deployment
- Improve the deployment pipeline to ensure quicker releases and reduced downtime
- Built and deployed a Docker-based microservice architecture using Kubernetes, ensuring better scalability and fault tolerance for production deployments
- Decreased deployment-related downtime by 50% and improved service availability by 35%
Senior Software Engineer Consultant, Information & Data Analytics, GIS
Visa Inc.
09.2016 - 06.2018
- Visa needed to process large volumes of security data from different sources (LEEF, CSV, JSON) in real time
- Develop a distributed system to efficiently process and analyze security data at scale
- Developed Spark Streaming jobs with Scala to process data streams in real-time
- Integrated with Kafka to handle large data ingestion and processing in a fault-tolerant and distributed manner
- Reduced data processing time by 40%, improved real-time threat detection, and ensured 99.9% uptime of the production system
- The company needed to build a user-friendly data visualization platform to allow security analysts to interpret complex data insights
- Develop a cross-browser, responsive web application for data visualization based on data science model results
- Designed and implemented a data visualization dashboard using AngularJS, D3.js, and Node.js, allowing users to seamlessly interact with security data insights across devices and browsers
- The application became the primary tool for security analysts, improving investigation efficiency by 30% and increasing user adoption by 50%
Software Engineer
3M Health Care
02.2011 - 09.2016
- The team needed to improve the efficiency of processing healthcare-related data, which was growing exponentially
- Design and implement a scalable, fault-tolerant data processing pipeline to handle the increasing data volume
- Built and deployed Hadoop-based MapReduce jobs and Hive queries to process large datasets
- Integrated with AWS Lambda to manage some of the cloud services and improve system performance
- Increased data processing efficiency by 40% while reducing system failures by 20%
Education
MS - Computer Science
George Mason University
Fairfax, VA06.2010
BS - Information Technology
University of Mumbai
India03.2007
Skills
- Java
- Scala
- Python
- Apache Spark
- Hadoop
- AWS EMR
- Oracle Data Flow
- Kafka
- Hive
- HBase
- AWS
- GCP
- Oracle Cloud Infrastructure (OCI)
- Fault-tolerant systems
- Scalable systems
- ETL Pipeline Development
- Batch processing
- Stream processing
- Service-Oriented Architecture
- Service discovery
- Software-defined networking
- Inter-service communication protocols
- Docker
- Kubernetes
- Jenkins
- Helm
- Terraform
- Incident response
- Troubleshooting
- Code deployment
- Prometheus
- New Relic
- Structured logging
- Event tracking
- Snowflake
- Verica
- Oracle ADW
Accomplishments
- On the spot award $5k bonus for exemplary show of taking action and unwavering commitment to lead the team to deliver
Languages
English
Full Professional
Timeline
Senior Software Engineer, Data Analytics & Computational Intelligence
Lowes Inc.
07.2019 - Current
Senior Software Engineer, Data Analytics Engineering
Syapse Inc.
06.2018 - 07.2019
Senior Software Engineer Consultant, Information & Data Analytics, GIS
Visa Inc.
09.2016 - 06.2018
Software Engineer
3M Health Care
02.2011 - 09.2016
MS - Computer Science
George Mason University
BS - Information Technology
University of Mumbai
Similar Profiles
Jacob KostJacob Kost
Customer Service Associate at Lowes Inc.Customer Service Associate at Lowes Inc.
Nathan BerubeNathan Berube
Assistant Manager of Merchandising and Pro Service at Lowes Home ImprovementAssistant Manager of Merchandising and Pro Service at Lowes Home Improvement
KRISTY CHETTYKRISTY CHETTY
Sales Assistant at Lowes ManhattanSales Assistant at Lowes Manhattan