We’re looking for a talented and experienced Data Engineer to work on our massive data processing and help us deliver more insights from our tens of billions of events.
Responsibilities
Design, Develop and implement robust and scalable data solutions to support and improve data processes
Data Infrastructure management – build, maintain, architecture design (deployment, git, clusters, connection, docker, airflow)
Integrate with various of external data sources through APIs and implement end-to-end data pipelines & ETLs
Optimize workloads to reduce cost and improve performance
Own the data Understand the data behavior include business knowledge, methodology and architecture
Evaluate, Implement and support new BI technologies
2+ years of experience as a Data Engineering
2+ years of experience with Python
2+ years of experience with ETL Processes
Proficient in SQL
Fast learner, team player, independent with a positive attitude and passion for data
Advantages
Experience with Google BigQuery/Snowflake/Redshift
Experience with Cloud technology
Experience with workflow managers such as Airflow/Luigi
Experience with DBT