Black & White | Permanent

Data Engineer

Bangalore North, India | Posted on 01/08/2024

Job Information

  • Job Type Permanent
  • Date Opened 01/08/2024
  • Industry IT Services
  • Province Karnataka
  • City Bangalore North
  • Postal Code 560001
  • Country India

Job Description

Mandatory skills

  • Strong background in data engineering, with experience architecting complex data systems in large-scale environments
  • Experience in successful delivery of complex finance data related projects end to end
  • Experience in Agile and DevSecOps delivery, quality practices, techniques, test automation and tools required for all aspect of data engineering/ data platforms
  • Experience with cloud-based technologies incl. Microsoft Azure, Databricks, Delta Lake
  • Experience in data ingestion tools of CDC, ADF and Qlik Replicate
  • Experience in adoption of data governance frameworks using Collibra and Unity Catalog
  • Experience with JIRA, Confluence, Github, Bitbucket and other similar developer tools

Experience in using PowerBI for data visualization and analytics, supporting a data-enabled organization


  • Design, develop and deliver the building of data pipelines across various integration points for the global Financia Data Repository (FDR)
  • Develop, confirm pipeline tools for ingestion, transformation, and distribution, based on fact finding and assessment of existing solutions within Prudential frameworks
  • Implement data models, ensuring scalability, performance, and reliability
  • Collaborate with cross-functional teams to understand data requirements and provide technical advice
  • Select appropriate tools and technologies for data storage, processing, and analysis
  • Optimize data infrastructure for cost-effectiveness and performance – working with Develops team to
  • Ensure data security, compliance, and governance standards are met
  • In-depth knowledge of the principles and practices of good systems design

• Strong background in data engineering, with experience architecting complex data systems in large-scale environments • Experience in successful delivery of complex finance data related projects end to end • Experience in Agile and DevSecOps delivery, quality practices, techniques, test automation and tools required for all aspect of data engineering/ data platforms • Experience with cloud-based technologies incl. Microsoft Azure, Databricks, Delta Lake • Experience in data ingestion tools of CDC, ADF.