?Position Overview: As a Senior Data Engineer, you will be a key player in shaping our next-generation cloud data infrastructure. You will design and implement cutting-edge, scalable architectures, optimize high-volume data pipelines, and drive innovation in real-time data processing and analytics. This role offers an exciting opportunity to work with the latest AWS technologies, machine learning models, and automation frameworks to deliver high-performance, data-driven solutions that empower law enforcement agencies worldwide.
Responsibilities: Innovative Data Architecture & Design: Architect, design, and implement highly scalable, secure, and cost-efficient AWS-based data solutions using Apache Spark, Kubernetes, and AWS-native services utilizing AI-driven optimizations and real-time streaming capabilities.
* Define best practices for cloud-native data modeling, event-driven architectures, and high-performance computing. Advanced Data Pipeline Development: Build, optimize, and maintain intelligent ETL/ELT pipelines leveraging AWS Glue, Apache Spark on EMR, and Lambda functions for automated data workflows.
* Innovate with real-time streaming solutions using AWS Kinesis, Kafka, to enable instant decision-making capabilities.
* Enhance data workflows with dynamic autoscaling and resource optimization. Data Governance & Security Excellence: Implement advanced data governance frameworks, ensuring compliance, data lineage tracking, and AI-driven anomaly detection.
* Strengthen security with cutting-edge AWS security tools, including IAM, KMS, and end-to-end encryption mechanisms. Collaboration & Thought Leadership: Collaborate with cross-functional teams, including AI/ML engineers, data scientists, and software developers, to build intelligent, data-driven solutions.
* Mentor and inspire team members, fostering a culture of innovation and technical excellence. Operational Efficiency & Optimization: Monitor and enhance data pipelines and infrastructure using predictive analytics and automated observability tools.
* Continuously optimize cloud costs and performance, leveraging serverless architectures and infrastructure as code (IaC) solutions like Terraform and AWS CDK.
Office Location:
Petah Tikva
Experience: Minimum of 7 in designing and developing cloud-based data solutions, with deep expertise in AWS technologies. Technical Skills: Mastery of AWS data services (e.g., S3, Glue, Redshift, Athena, DynamoDB, EMR, Lambda, Kinesis, Step Functions).
* Proficiency in big data frameworks (e.g., Apache Spark, Hadoop) and real-time processing tools (e.g., Apache Flink, Kafka Streams).
* Strong coding skills in Python, with expertise in automating data workflows and cloud infrastructure.
* Hands-on experience with AI-driven data quality frameworks, schema evolution, and self-healing data pipelines. Innovation & Leadership: Passion for pushing technological boundaries and leveraging emerging AWS innovations.
* Strong analytical and problem-solving mindset with a drive for automation and efficiency.
?Preferred Qualifications:
* AWS Certifications such as AWS Certified Data Analytics – Specialty, AWS Certified Solutions Architect – Professional.
