Prathish Balachandar

Client #1: Teachers Insurance and Annuity Association of America, Charlotte - USA.

• Spearheaded the design and development of a scalable enterprise data cloud framework using various AWS cloud services like Glue, Apache Iceberg, Apache Airflow (MWAA), RDS, Athena, Apacha Kafka, Snowflake.
• Developed Structured and Unstructured (PDF) data pipeline using AWS services and in-house AI model called gAIt.
• Developed real time data consumption pipeline using Confluent Cloud Kafka and AWS Glue streaming pipeline.
• Developed solution to dynamically allocate Glue worker configurations.
• Developed many custom utils for reporting, DB connectivity and audit loggings.
• Streamlined communication between Data Engineering Lead team members by hosting weekly meetings that encouraged open discussion of ongoing projects.
• Increased departmental efficiency by implementing standardized coding practices across all team members projects.
• Managed a team of junior engineers, providing mentorship and guidance on best practices in data engineering.
• Designed and deployed cloud-based infrastructure, reducing overall costs while increasing performance and scalability.

Client: Truist Bank, Charlotte - USA

• Developed and maintained data pipelines to ingest and store large volumes of data from multiple sources.
• Designed and implemented ETL process for transforming raw data into meaningful insights.
• Defined metrics, monitored performance, and identified areas of improvement in data engineering tasks.
• Optimized existing database structures to improve scalability, efficiency, and performance.
• Collaborated with stakeholders to understand their requirements and develop solutions accordingly.
• Provided technical guidance to team members on best practices of data engineering tasks.
• Identified potential risks associated with data processing activities and proposed mitigation strategies.
• Led development projects from conception through deployment while managing resources effectively.
• Monitored job execution logs to ensure efficient functioning of all ETL jobs running in production environment.
• Performed root cause analysis on failed jobs by troubleshooting issues with underlying systems or applications.
• Managed security protocols such as authentication and authorization to protect sensitive information stored in databases.
• Developed new functions and applications to conduct analyses.

Client #1: Teachers Insurance and Annuity Association of America, Charlotte - USA.

• Spearheaded the design and development of a scalable enterprise data cloud framework using various AWS cloud services like Glue, Apache Iceberg, Apache Airflow (MWAA), RDS, Athena, .
• Worked in a highly dynamic environment to develop a metadata driven solution.
• Developed ETL pipelines using AWS Glue from different sources and orchestrated using AWS managed Apache Airflow.
• Developed Catalog integration between AWS Glue and Snowflake, the data refresh happens in snowflake immediately once the data is refreshed in AWS Glue Catlog.
• Collaborated with cross-functional teams to define requirements and develop end-to-end solutions for complex data engineering projects.
• Ensured data quality through rigorous testing, validation, and monitoring of all data assets, minimizing inaccuracies and inconsistencies.
• Participate in PI planning and prioritize the effort for the quarter.
• Enhanced system performance by designing and implementing scalable data solutions for high-traffic applications.
• Automated data quality checks and error handling processes to ensure the integrity and reliability of datasets.
• Delivered exceptional results under tight deadlines, consistently prioritizing tasks effectively to meet project timelines without compromising quality or accuracy.
• Analyzed large datasets to identify trends and patterns in customer behaviors.
• Monitored data systems performance, identifying bottlenecks and implementing solutions to maintain system efficiency.

Client #2: Caterpillar Inc, Chennai - India

• Developed and maintained data pipelines to ingest and store large volumes of data from multiple sources.
• Designed and implemented ETL process for transforming raw data into meaningful insights.
• Optimized existing database structures to improve scalability, efficiency, and performance.
• Conducted data analysis using SQL and Python to derive insights and support decision-making processes.

Client #1: Lloyds Bank, London - UK

• Lead the Run The Bank (RTB) and Change The Bank (CTB) team of 30+ to achieve SLA of the Production issues and the timely delivery of developed module.
• Coordinated resources to ensure successful completion of projects.
• Acted as a Transition lead, to ensure smooth knowledge transition from various teams/vendors to Wipro teams.
• Worked with both Project and Development teams and helped them developing their Batch cycles from test to production.
• Worked on the Production incidents raised by the users/alerts on various batch/online issues.

Client #2: Standard Bank, Johannesburg - South Africa

• Developed modules using Mainframe - Cobol, DB2, JCL as per the business requirements.
• Developed REXX modules for automation scripts.
• Created detailed project plans with timelines, deliverables, and resources needed.