We are looking for a Data Engineer Lead to join our Data Group.
As a Lead Data Engineer, youll manage 2 experienced DE, and, youll collaborate with our BI/Analytics teams and work closely with our DBA, DevOps, and architecture teams.
You will be responsible for the entire journey of data, from its origin to being ready for analysis.
This includes:
Design, develop, and implement robust data pipelines using ETL/ELT tools to efficiently move data from various sources to our DWH.
Ensure the quality and integrity of data throughout the pipeline by implementing data cleaning, transformation, and validation techniques.
Collaborate with stakeholders across the organization, including BI developers, data analysts, to understand their data needs and translate them into technical specifications.
Build and maintain the infrastructure for our data platform, ensuring scalability, security, and performance.
Develop and implement processes and tools to monitor data quality and identify potential issues.
Document data pipelines and processes for clear communication and future maintenance.
Our DE team is responsible for managing several production pipelines that are feeding customer-facing systems.
As a Lead Data Engineer, youll manage 2 experienced DE, and, youll collaborate with our BI/Analytics teams and work closely with our DBA, DevOps, and architecture teams.
You will be responsible for the entire journey of data, from its origin to being ready for analysis.
This includes:
Design, develop, and implement robust data pipelines using ETL/ELT tools to efficiently move data from various sources to our DWH.
Ensure the quality and integrity of data throughout the pipeline by implementing data cleaning, transformation, and validation techniques.
Collaborate with stakeholders across the organization, including BI developers, data analysts, to understand their data needs and translate them into technical specifications.
Build and maintain the infrastructure for our data platform, ensuring scalability, security, and performance.
Develop and implement processes and tools to monitor data quality and identify potential issues.
Document data pipelines and processes for clear communication and future maintenance.
Our DE team is responsible for managing several production pipelines that are feeding customer-facing systems.
Requirements:
4+ years of experience working as a Data Engineer and at least 2 years in a data-rich environment
Proven leadership and management skills( at least 2 years), including experience in leading and motivating a team of data engineers, setting clear technical goals and roadmap, and facilitating collaboration.
Hands-on experience in developing end-to-end ETL/ELT processes – must
Experience with big data and ETL & orchestration tools: Spark, Kafka, Apache Airflow etc.- must
Excellent SQL skills, including complex SQL queries and procedures
In-depth knowledge of Python
Experience with dimensional data modeling & schema design in Data Warehouses
Strong orientation in GCP environments – big advantage
Bachelor’s degree in Engineering, Computer Science, Math, or other numerate/analytical degree equivalent
Strong communication skills and excellent English are a must
4+ years of experience working as a Data Engineer and at least 2 years in a data-rich environment
Proven leadership and management skills( at least 2 years), including experience in leading and motivating a team of data engineers, setting clear technical goals and roadmap, and facilitating collaboration.
Hands-on experience in developing end-to-end ETL/ELT processes – must
Experience with big data and ETL & orchestration tools: Spark, Kafka, Apache Airflow etc.- must
Excellent SQL skills, including complex SQL queries and procedures
In-depth knowledge of Python
Experience with dimensional data modeling & schema design in Data Warehouses
Strong orientation in GCP environments – big advantage
Bachelor’s degree in Engineering, Computer Science, Math, or other numerate/analytical degree equivalent
Strong communication skills and excellent English are a must
This position is open to all candidates.
