We are seeking a skilled and proactive Data Engineer to design, implement, and maintain the technical infrastructure that ensures the availability, quality, traceability, and scalability of institutional and scientific data.
The Data Engineer will work closely with Data Scientists, Analysts, and other technical professionals to deliver scalable data solutions that meet analytical and research needs. The position involves building and maintaining automated pipelines, ensuring data integration from heterogeneous sources, and applying modern DevOps and DataOps practices to deploy production-grade infrastructure aligned with data governance standards and FAIR principles.
Primary Responsibilities :
- Design and maintain automated data pipelines (DataOps) to support scalable and efficient data ingestion, processing, and storage.
- Develop robust ETL / ELT workflows that process data from a variety of sources, including sensors, APIs, databases, and flat files.
- Integrate and harmonize data from diverse sources, ensuring consistency, quality, and alignment with strategic needs.
- Implement continuous integration and deployment (CI / CD) practices to validate and deploy updates to data pipelines and infrastructure components.
- Manage relational and non-relational databases, ensuring their performance, security, and reliability.
- Apply data security measures to protect data in transit and at rest.
- Document and version technical workflows and data processes to ensure reproducibility and traceability.
- Support institutional data governance by implementing technical standards aligned with FAIR principles and internal policies.
- Collaborate closely with Data Scientists, Analysts, and Engineers to understand needs and deliver tailored infrastructure solutions.
- Monitor the operational quality of data pipelines and proactively anticipate or resolve failures.
Qualifications :
Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.3+ years of hands-on experience in building and maintaining data pipelines and infrastructure.Deep knowledge of ETL / ELT processes, data modeling, and data integration across systems.Familiarity with DevOps practices (CI / CD) in a data context.Experience in working with large datasets and ensuring high availability and integrity of data systems.Excellent collaboration and communication skills in multidisciplinary environments.Experience with data integration, ETL (Extract, Transform, Load) processes, and data governance practices.Excellent problem-solving skills and the ability to work effectively in a collaborative, interdisciplinary environment.Join us in driving innovation and advancing interdisciplinary research through the power of data engineering. This role presents a unique opportunity to collaborate with leading researchers and contribute to groundbreaking projects that shape the future of academia.
We foster a supportive and collaborative culture that encourages professional growth and development. You'll have the opportunity to work alongside talented individuals and contribute to cutting-edge research initiatives that have a meaningful impact.
#J-18808-Ljbffr