פורסם לפני יותר מחודש
פורסמה ברשת
As a Senior Big Data Engineer, working within our Foundation Entity Group, you will play a pivotal role in designing, developing, and maintaining the data infrastructure that powers our location analytics platform.
RESPONSIBILITIES:
Data Pipeline Architecture and Development: Design, build, and optimize robust and scalable data pipelines to process, transform, and integrate large volumes of data from various sources into our analytics platform.
Data Quality Assurance: Implement data validation, cleansing, and enrichment techniques to ensure high-quality and consistent data across the platform.
Performance Optimization: Identify performance bottlenecks and optimize data processing and storage mechanisms to enhance overall system performance and reduce latency.
Cloud Infrastructure: Work extensively with cloud-based technologies (GCP), to design and manage scalable data infrastructure.
Collaboration: Collaborate with cross-functional teams including Data Analysts, Data Scientists, Product Managers, and Software Engineers to understand requirements and deliver solutions that meet business needs.
Data Governance: Implement and enforce data governance practices, ensuring compliance with relevant regulations and best practices related to data privacy and security.
Monitoring and Maintenance: Monitor the health and performance of data pipelines, troubleshoot issues, and ensure high availability of data infrastructure.
Mentorship: Provide technical guidance and mentorship to junior data engineers, fostering a culture of learning and growth within the team

Requirements:
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
5+ years of professional experience in software development, with at least 3 years as a Big Data Engineer.
Spark expertise (mandatory): Strong proficiency in Apache Spark, including hands-on experience with building data processing applications and pipelines using Spark’s core libraries.
PySpark/Scala (Mandatory): Proficiency in either PySpark (Python API for Spark) or Scala for Spark development.
Data Engineering: Proven track record in designing and implementing ETL pipelines, data integration, and data transformation processes.
Cloud Platforms: Hands-on experience with cloud platforms such as AWS, GCP, or Azure.
SQL and Data Modeling: Solid understanding of SQL, relational databases, and data modeling.
Big Data Technologies: Familiarity with big data technologies beyond Spark, such as Hadoop ecosystem components, data serialization formats (Parquet, Avro), and distributed computing concepts.
Programming Languages: Proficiency in programming languages like Python, Java, or Scala.
ETL Tools and Orchestration: Familiarity with ETL tools and frameworks, such as Apache Airflow.
Problem-Solving: Strong analytical and problem-solving skills.
Collaboration and Communication: Effective communication skills and collaboration within cross-functional teams.
Geospatial Domain (Preferred): Prior experience in the geospatial or location analytics domain is a plus.

This position is open to all candidates.
מידת ההתאמה שלי לתפקיד
התאמה למשרה
התאמתך לתפקיד מחושבת על פי כישורך (כפי שסיפרת לנו עליהם) מול דרישות המעסיק - אין בכך כדי להעיד על קבלתך לעבודה (זה יחליט המעסיק)
כישורים חסרים
משרות חדשות במערכת שיכולות לעניין אותך
Mobileye
אזור מרכז - גוש דן
פורסם לפני שבוע 1
The positionYou will be part of Mobileye Data Engineering team. We provide features and generate meta-data to enable and streamline ...
דוברי שפות
פורסם לפני 3 שבועות
דרוש/ה data Analyst בחברה גלובאלית ענקית בנס ציונה!מדובר בהחלפה לחופשת לידה (9 חודשים עם אופציה להארכה). במסגרת התפקיד: השתתפות בניתוח ...
דוברי שפות
פורסם לפני 3 שבועות
At BeeHero, we believe technology should do more than just make life easier; it should drive real-world impact . Our ...
yad2
דוברי שפות
חולון / בת יםלוד / רמלהמודיעיןפתח תקווהראש העיןראשון לציוןתל אביב
פורסם לפני חודש 1
• Data Integration and Pipeline Development: Design, build, and maintain robust data pipelines that connect diverse data sources, including databases, ...
דוברי שפות
נתניה
פורסם לפני יותר מחודש
We are looking for a Senior Big Data Engineer.Responsibilities:Working with our AI/ML researchers and our Buyer Product group – Senior ...
דוברי שפות
פורסם לפני יותר מחודש
Manage Spark as a Service solution for Data Engineers and Data Scientists Provide an in-house infrastructure for data engineers to ...
דוברי שפות
פורסם לפני יותר מחודש
We seek a passionate Data Engineer Manager to join the Data team, in our TLV Site. Responsibilities – what youll ...
היברידי
אזור מרכז - גוש דן
פורסם לפני יותר מחודש
דרוש/ה מפתח/ת Pythonהזדמנות נהדרת להיכנס לחברה הדוגלת בחדשנות ולקחת חלק בפרויקטים משמעותיים בתחום ה- data המשפיעים על יומיום של כולנו!לנס ...
פורסם לפני יותר מחודש
We are seeking a passionate and hands-on BI\Data Engineering Manager to join our Data Department.The BI\ Data Engineering Manager will ...
פורסם לפני יותר מחודש
We are loooking for a Senior Product Manager, Data Platforms.What will you do:Lead the discovery, definition, planning and execution of ...
פורסם לפני יותר מחודש
We are seeking a highly skilled Senior Data Engineer to join our R&D team as the inaugural member focused on ...
פורסם לפני יותר מחודש
We are looking for a Data Engineer Lead to join our Data Group. As a Lead Data Engineer, youll manage ...
פורסם לפני יותר מחודש
We are looking for a Senior Data Engineer.You will be responsible for the entire journey of data, from its origin ...
חיפה
פורסם לפני יותר מחודש
דרושים/ות מפתחי/ות SQL – הזדמנות להקפיץ את הקריירה קדימה.המשרה בחיפה! המשרה מיועדת לנשים ולגברים כאחד.
פורסם לפני יותר מחודש
This role presents a unique opportunity to enter the ML domain. For those already experienced in ML infrastructure, it offers ...
הצגת משרות נוספות