Manage Spark as a Service solution for Data Engineers and Data Scientists
Provide an in-house infrastructure for data engineers to write their own Python serverless functions and data ingestion pipelines
Maintain and develop Wix's data execution and orchestration platform using Apache Airflow
Give best practices and guidance to the entire Data Guild
Requirements:
Software Engineer/Data Engineer with 5+ years of hands-on experience in the data world and Python programming
Software Engineer/Data Engineer with 5+ years of hands-on experience in the data world and Python programming
Youre experienced with cloud computing services and Spark and you have expertise designing, developing and implementing large-scale projects in the cloud
You have a practical data-driven approachyou use real-life data as the basis for informed decision-making that aligns with our approach to designing and implementing effective solutions
Bonus points if youre familiar with Airflow, EMR, Kubernetes, building microservices and APIs or any other big data infrastructure
This position is open to all candidates.
