We are looking for a Senior Big Data Engineer.
Responsibilities:
Working with our AI/ML researchers and our Buyer Product group – Senior Big Data Engineer handles
ETL data pipelines
Model training
Model deployment
Analysis and monitoring
Need to manage integration points with the following groups:
Researchers
Product
Platforms
Data
Application backend
Responsibilities:
Working with our AI/ML researchers and our Buyer Product group – Senior Big Data Engineer handles
ETL data pipelines
Model training
Model deployment
Analysis and monitoring
Need to manage integration points with the following groups:
Researchers
Product
Platforms
Data
Application backend
Requirements:
Python – 6+ years
Apache Spark (pyspark) 6+ years
SQL
model deployment
dockers
Additional optional experience:
Backend – Java/Scala
Orchestration AirFlow/Jenkins
Near Real Time processing – Apache Flink/ Spark Streaming
Python – 6+ years
Apache Spark (pyspark) 6+ years
SQL
model deployment
dockers
Additional optional experience:
Backend – Java/Scala
Orchestration AirFlow/Jenkins
Near Real Time processing – Apache Flink/ Spark Streaming
This position is open to all candidates.
