We are seeking a Senior Data Engineer to promote and maintain our unique data processing platform.
You will be joining a team responsible for the management of the data layer at petabyte scale by creating and managing enterprise grade systems, and flows that process ~50TB of data every day and growing.
The team will constantly evaluate new technologies in the field of data processing, data governance and data management to transform the company to truly data driven.
Responsibilities:
Design and implement advanced ETLs, high throughput, fault tolerant infrastructure with an emphasis on correct testing, CI/CD processes and data quality.
New technology due diligence, proof of concepts and implementation.
Deep understanding of our data platform including business value and lineage.
You will be joining a team responsible for the management of the data layer at petabyte scale by creating and managing enterprise grade systems, and flows that process ~50TB of data every day and growing.
The team will constantly evaluate new technologies in the field of data processing, data governance and data management to transform the company to truly data driven.
Responsibilities:
Design and implement advanced ETLs, high throughput, fault tolerant infrastructure with an emphasis on correct testing, CI/CD processes and data quality.
New technology due diligence, proof of concepts and implementation.
Deep understanding of our data platform including business value and lineage.
Requirements:
+6 years of hands-on experience as a Data/Backend Engineer.
+2 years of experience skills with Python / Java / Scala
Experience with designing and building ETL processes / data pipelines using spark and airflow or similar technologies.
Ability to lead activities and to work independently.
Good Analytical skills in SQL.
Advantage:
Cloud native architecture with advantage to AWS.
Knowledge of Linux operating systems.
Good knowledge in containerization.
+6 years of hands-on experience as a Data/Backend Engineer.
+2 years of experience skills with Python / Java / Scala
Experience with designing and building ETL processes / data pipelines using spark and airflow or similar technologies.
Ability to lead activities and to work independently.
Good Analytical skills in SQL.
Advantage:
Cloud native architecture with advantage to AWS.
Knowledge of Linux operating systems.
Good knowledge in containerization.
This position is open to all candidates.
