Technical Lead - Data Engineering

Company Name :

Job Title :

 Technical Lead - Data Engineering

Qualification :

 **B.Tech./B.E. in Computer Science or related field.

Experience :

8-12 years

Must Have Skills :

 Experience leading, designing & developing Data Engineering solutions using Google Cloud Platform (GCP) BigQuery, Cloud Storage, Dataflow, Cloud Functions, Pub/Sub, Cloud Run, Cloud Composer (Airflow), Cloud Spanner, Bigtable etc.

Good to Have Skills :

data engineer, with hands-on experience of 5+ years in GCP cloud data platform.

Roles and Responsibilities :

· Lead the design and implementation of data pipelines using GCP services for one or more projects

· Manage Deployments of data applications and ensure efficient orchestration of services.

· Implement CI/CD pipelines using Jenkins or cloud native tools to automate data pipeline deployment, testing, and integration with other services, ensuring quick iterations and deployments.

· Guide a team of data engineers in building and maintaining scalable, high-performance data pipelines.

· Build data pipelines and ETL/ELT processes leveraging Python, Beam and SQL scripts.

· Willingness and ability to learn and adapt to new technologies as needed during client engagements.

· Continuously monitor and optimize data workflows for performance and cost-effectiveness.

· Design workflows to integrate data from various sources using GCP services and orchestrate complex tasks with Cloud Composer (Apache Airflow).

· Set up monitoring, logging, and alerting using Cloud Monitoring, Datadog, or other tools to ensure visibility into pipeline performance and quickly identify and resolve issues.

· Guide and mentor junior developers and data engineers, helping them overcome technical challenges and ensuring high-quality code and solutions.

· Work closely with application developers, data architects, and business stakeholders to define and deliver robust data-driven solutions.

· Work on data migration from various databases/legacy DW systems build on Oracle, Teradata, SQL server etc to GCP cloud data platform,

· Facilitate agile processes like sprint planning, daily scrums, and backlog grooming.

· Interact with client’s stakeholders on assigned data, BI and analytics programs

· Work closely with program leadership team on stakeholder management, governance and communication.

· Work on estimation and planning for data analytics program

· Contribute in SOW, Proposals, Case studies etc

Location :

 Bangalore/Hyderabad

CTC Range :

 35LPA

Notice period :

 Immediate

Shift Timings :

Mode of Interview :

 Virtual

Mode of Work :

Mode of Hire :

Note :