Associate- BIM

Description

Summary: This role involves leading and modernizing data engineering delivery, focusing on migrating ETL and scheduling systems while guiding a small team on healthcare data platforms. Highlights: 1. Lead modernization of data engineering delivery with a focus on migration. 2. Work hands-on with Databricks, PySpark, and Apache Airflow. 3. Contribute to healthcare data platforms and guide a small team. **Position Summary** -------------------- This role involves leading day\-to\-day technical delivery of data engineering work, especially modernizing existing ETL and scheduling systems. This role focuses on moving data pipelines from Informatica BDM to Databricks and migrating job schedules from TIDAL to Airflow. The person will be hands\-on, guide a small team and work closely with architects, analysts and stakeholders on healthcare data platforms. **Job Responsibilities** ------------------------ * Lead migration of existing Informatica BDM ETL jobs to Databricks using PySpark. * Migrate job scheduling and dependencies from TIDAL to Apache Airflow. * Design, develop and maintain scalable data pipelines on Databricks. * Work on healthcare data such as claims, prescriptions, patient, provider or sales data. * Ensure data is accurate through data quality checks and reconciliations, especially during migration. * Guide and review work done by data engineers and senior associates. * Break down work into tasks, estimate effort and support sprint delivery. * Work with architects and BAs to turn requirements into working data solutions. * Support testing, defect fixes and production releases. * Maintain clear technical documentation and runbooks. **Education** ------------- BE/B.Tech Master of Computer Application**Work Experience** ------------------- * 6–8 years of experience in data engineering, with experience leading small teams or workstreams. * Strong hands\-on experience on Databricks (PySpark), Informatica BDM, Informatica IICS / IDMC, Apache Airflow * Experience migrating: BDM* + Databricks TIDAL+ Airflow * Good SQL skills and understanding of batch data processing. * Experience working with healthcare or life sciences data. * Exposure to cloud platforms (AWS, Azure or GCP). * Good communication and documentation skills. * Experience in data modernization or platform migration projects. * Familiarity with Agile delivery, Jira and Confluence. * Experience working in regulated data environments. **Behavioural Competencies** ---------------------------- Ownership Teamwork \& Leadership Cultural Fit Motivation to Learn and Grow**Technical Competencies** -------------------------- Problem Solving Lifescience Knowledge Communication Informatica Databricks Python**Skills** ----------