משרות תוצאות חיפוש מתאימות לבקשתך:

This role will report to the Team manager- R&D.

Why is this role so important ?
we are a data-focused company, and data is the heart of our business. As a data server engineer, you will work in one of the companys core teams and design and implement complex, high-scale systems that retrieve and analyze data from around the internet.

You will be responsible for:

Scraping – Building and maintaining high scale web-scraping operations.
Processing – Creating complex data pipelines that process and enrich our raw data and serve it to different consumers through various databases and data-lakes.
Engineering – Designing and building large scale, high quality systems to support our data infrastructure and production systems
As a Data-Server Engineer in Data Extraction, you will:

Write complex PySpark applications that process, manipulate and validate large datasets, in high quality and under strict SLA.
Develop dockerized high-performance microservices.
Take a major part in designing and implementing complex high scale systems using a large variety of technologies.
Work in a team with talented and independent engineers with whom youll be able to share knowledge and expertise.
learn new technologies, handle a multitude of systems.
Implement solutions in AWS cloud environment.
Take part in monitoring and debugging data pipelines and high scale services in order to identify and fix bottlenecks and failures.