We are looking for a Data Platform Engineer.
In this role, you will be responsible for building data infrastructure for performance analysis, tuning, and analysis of a new analytics product. As a member of our Data Performance team, you will collaborate closely with other SW & HW Engineers to improve the performance of our new cutting-edge APUs. You will collaborate with our business leaders and participate in the product design and implementation. You will evaluate, implement, and integrate a diverse set of tools and technologies such as Spark, Comet, Velox, Dagster, Hardware emulators and software simulators.
Responsibilities:
Join a multi-disciplinary team of experts operating at the foundation of data infrastructure stack
Build a robust data benchmarking infrastrucure
Develop in-house measurements and ETL tools
Conduct detailed performance analysis and characterization
Research state-of-the-art benchmarks and techniques for SQL and data optimization
In this role, you will be responsible for building data infrastructure for performance analysis, tuning, and analysis of a new analytics product. As a member of our Data Performance team, you will collaborate closely with other SW & HW Engineers to improve the performance of our new cutting-edge APUs. You will collaborate with our business leaders and participate in the product design and implementation. You will evaluate, implement, and integrate a diverse set of tools and technologies such as Spark, Comet, Velox, Dagster, Hardware emulators and software simulators.
Responsibilities:
Join a multi-disciplinary team of experts operating at the foundation of data infrastructure stack
Build a robust data benchmarking infrastrucure
Develop in-house measurements and ETL tools
Conduct detailed performance analysis and characterization
Research state-of-the-art benchmarks and techniques for SQL and data optimization
Requirements:
BS degree in Computer Science
At least 4 year experience in a Data Engineering role
At least 4 year experience of programing
At least 2 years working with Spark
In depth knowledge of SQL
Strong development skills in Python
Advantages:
Experience with SQL benchmarks, specifically TPC-H and TPC-DS
Experience with SQL query tuning
Experience with GPUs or other hardware accelerators
BS degree in Computer Science
At least 4 year experience in a Data Engineering role
At least 4 year experience of programing
At least 2 years working with Spark
In depth knowledge of SQL
Strong development skills in Python
Advantages:
Experience with SQL benchmarks, specifically TPC-H and TPC-DS
Experience with SQL query tuning
Experience with GPUs or other hardware accelerators
This position is open to all candidates.
