What you'll be doing
A Staff Data Infrastructure Engineer is responsible for designing, implementing, and managing the data infrastructure of an organization. Working closely with data scientists, software engineers, and other stakeholders to ensure the availability, usability, and integrity of data. Managing the cost reduction of the data team over the data infrastructure
Handling the POCs and new projects, supporting all the data engineering team members, providing technical guidance and assistance.
In charge of the machine-learning data stuck for offline and online.
Overseeing Data Architecture and Management, Managing the cost reduction of the data team.
Work with top notch data tools and environments at high data scale and super significant to the business. PB data scale.
Working on a large scale of Data, creating data lake infrastructure based on docker/Airflow combined with lots of AWS services & creating MASS ETL tools.
In addition, creating the data lake of the division, along with Presto over EMR.
In charge of 1B events per day, including log-servers written in Go-lang.
Working with Upsolver over AWS kinesis streams.
A profound love for software engineering with a perpetual drive to enhance both the software and the associated workflows.
Eager to lead design and architecture talks, actively engage with various stakeholders, and champion best practices, quality, and positive work ethic.
A collaborative spirit, willing to mentor and learn from peers.
Unwavering commitment to quality, advocating for automated processes, and holding a sense of end-to-end ownership.
Excellent problem-solving skills are essential