Responsibilities:
Leading the data engineering team and working closely with cross-functional teams.
Effectively manage tasks and workflows using Jira, ensuring timely completion and adherence to project timelines.
Monitor pipelines and alerts through email and Slack, promptly addressing any issues that may arise.
Identify bottlenecks within processes and strategize solutions to ensure smooth project execution.
Collaborate with team members to plan and prioritize tasks, understanding the specific needs and requirements for successful project delivery.
Oversee the maintenance of data-related resources, including MySQL, BigQuery, Postgres/TSDB, with a focus on monitoring, upgrading, optimizing, and developing these systems.
Design and maintain Airflow data pipelines, creating new procedures for monitoring and managing datasets to support both internal and external clients.
Review and analyze Pull Requests (PRs) and Code Reviews (CRs) to maintain code quality and consistency.
Roles & Responsibilities:
Collaborate with engineers, product managers, and data scientists to understand data needs.
Prepare data for analytical or operational uses.
Design, build, test, and maintain data pipelines to bring together information from multiple systems.
Represent data insights.
Requirements:
Proven experience in data engineering with a strong track record of leadership and project management.
Strong communication and collaboration skills.
In-depth knowledge of data engineering technologies, ETL processes, and data warehousing.
5+ years of Data Engineering experience.
2+ years of experience as a DBA.
4+ years of Python experience.
Full proficiency in SQL.
Experience in Database design and performance optimization.
Work in a cloud environment.
Required Skills:
Coding.
Communication skills.
Methodicalness.
Self learner.
Analytical.
Cross-functional Team Leadership.
