We are pushing the boundaries of real-time analysis, utilizing machine learning and artificial intelligence to find the delicate balance between low latency and data accuracy.
Responsibilities:
Building production-grade data pipelines and services
Design and Build data-lake/lakehouse
Taking ownership of major projects from inception to deployment
Architecting simple yet flexible solutions, and then scaling them as we grow
Collaborating with cross-functional teams to ensure data integrity, security, and optimal performance across various systems and applications.
Staying current with emerging technologies and industry trends to recommend and implement innovative solutions that enhance data infrastructure and capabilities.
Requirements:
3+ years of experience delivering production-grade data pipelines and backend services
2 + years of experience using Spark/Presto/ Trino or similar
Experience building data pipelines, and working in distributed architectures
Experience with SQL and NoSQL Databases
Experience with designing and implementing data lake/warehouse
Experience with Snowflake/Databricks/Sagemaker or similar Advantage
Knowledge and understanding of work in a modern CI environment: Git, Docker, K8S – An advantage
Experience with ETL tools: AWS Glue, Apache Airflow, etc… – An advantage
Experience with Kafka – Advantage
Experience with Kafka Connect (Java) – Advantage
3+ years of experience delivering production-grade data pipelines and backend services
2 + years of experience using Spark/Presto/ Trino or similar
Experience building data pipelines, and working in distributed architectures
Experience with SQL and NoSQL Databases
Experience with designing and implementing data lake/warehouse
Experience with Snowflake/Databricks/Sagemaker or similar Advantage
Knowledge and understanding of work in a modern CI environment: Git, Docker, K8S – An advantage
Experience with ETL tools: AWS Glue, Apache Airflow, etc… – An advantage
Experience with Kafka – Advantage
Experience with Kafka Connect (Java) – Advantage
This position is open to all candidates.
