You will collaborate closely with cross-functional teams, including data scientists, analysts, and software engineers, ensuring smooth data flow and optimizing our services.
What will you do?
Lead the design, development, and maintenance of efficient and scalable data pipelines, facilitating data collection, processing, and transformation from diverse sources
Implement real-time data streaming solutions using Kafka, ensuring timely data ingestion and availability
Utilize Java, including Spring Boot, to build robust and high-performance data processing services within our data platform
Collaborate closely with cross-functional teams to comprehend data requirements, identify opportunities for data optimization, and support data-driven initiatives
Uphold data integrity, reliability, and availability by implementing effective ETL processes and conducting data quality checks
Leverage AWS services for data storage, processing, and analytics, adhering to security and performance best practices
Monitor and troubleshoot service performance, proactively identifying bottlenecks and implementing optimizations
Bachelors degree in Computer Science, Engineering, or any related field
4+ years of professional experience as a Backend Engineer
Full proficiency in Java (Spring Boot) and Kafka, with a proven track record of working with micro-services architecture and streaming solutions
Proficiency in AWS services for data storage, processing, and analytics
Strong experience in designing and constructing ETL processes for data transformation and integration advantage
Demonstrated ability to challenge decisions and work independently
Strong problem-solving skills and meticulous attention to detail
Familiarity with Python and NodeJS (a plus)
Experience with GenAI tools a must
