As aLead Data Engineer, you will play a leading role in designing, building, and optimizing our data infrastructure, ensuring that it supports the advanced analytics need of the bank. You will oversee a team of data engineers, working closely with data analysts, DevOps team, infrastructure engineers, and other stakeholders to deliver high-quality data solution.#LI-DNIResponsibilitiesLead the design, development and implementation of high-performance Spark Scala applications and data processing pipelines for large-scale dataIntegrate Elasticsearch with Spark for efficient data indexing, querying and retrievalOptimize Spark jobs for performance and scalability on OpenShift Container Platform (OCP)Collaborate with cross-functional teams to translate data requirements into robust and scalable solutionsImplement and maintain CI/CD pipelines for data engineering workflows, ensuring platform stability and efficient resource utilizationMonitor and optimize data pipeline performance, troubleshoot issues and implement necessary enhancementsEstablish and maintain data quality and integrity throughout the data processing lifecycleDocument data engineering processes, workflows and infrastructure configurationsStay abreast of emerging technologies and best practices in data engineering and DevOpsMentor and guide junior team members, fostering a culture of continuous learning and innovationRequirements
As aLead Data Engineer, you will play a leading role in designing, building, and optimizing our data infrastructure, ensuring that it supports the advanced analytics need of the bank. You will oversee a team of data engineers, working closely with data analysts, DevOps team, infrastructure engineers, and other stakeholders to deliver high-quality data solution.#LI-DNIResponsibilities
Want more jobs like this?GetjobsinSingaporedelivered to your inbox every week.
Want more jobs like this?
GetjobsinSingaporedelivered to your inbox every week.
Get Jobs
