Sonarsource Staff Data Engineer at Sonarsource to design and develop data platform and pipelines supporting functional domains. Responsible for implementing data storage, transformation, load capabilities, and maintaining data flow documentation.
Responsibilities
Design and implement data storage, transformation, and load capabilities of our pipelines.
Continuously enhance the data lake and the platform built around it. Propose, implement and manage data handling services according to stakeholders in other engineering teams
Establish top-class end-to-end pipelines making use of the data.
Maintain evergreen data flow documentation across systems.
Collaborate on Data Governance with other stakeholders/domains.
Work with the security function to ensure we adhere to expected security standards.
Collaborate with the incident manager to bring your expertise when asked and own implementation of recommendations from post-mortems.
Experience and qualifications
You have solid software engineering experience, focusing on developing data engineering pipelines and storage in the cloud. You have been exposed to big data architecture essentials, streaming, ETL batches, data store administration, ...
You see yourself as a developer working on data. You are motivated by both technical and functional aspects of services.
You are a friendly, enthusiastic, and organized team player. You actively share your knowledge and give and receive feedback to improve the team and yourself.
Strong experience building end-to-end ETLT, ETL, or ELT pipelines with batch or streaming technologies in Java and Python.
Qualification
Fluent in English
Required
Solid software engineering experience developing data engineering pipelines and storage in the cloud
Strong experience building end-to-end ETLT, ETL, or ELT pipelines with batch or streaming technologies in Java and Python
Good knowledge of data engineering concepts (Data Lake, Data Warehouse)
Experience with Infrastructure as code tools (CDK, CloudFormation, Terraform)