We are seeking a Senior Data Infrastructure Engineer , responsible for supporting a data processing infrastructure cluster.
The selected individual will have a pivotal role in sustaining, improving, and resolving problems from the AWS level down to specific data pipeline arrangements. Responsibilities will include deploying updates, establishing new instances, and overseeing continuous deployment pipelines to guarantee efficient functioning.
Responsibilities
- Address incidents and diagnose problems from AWS to data pipeline config
- Resolve identified problems or escalate them to the data team with detailed reasoning
- Apply enhancements within the infrastructure to boost efficiency and dependability
- Configure new instances according to project specifications
- Oversee and improve continuous deployment (CD) pipelines
- Cooperate with diverse engineering teams to incorporate their contributions into the infrastructure
- Guarantee the security of the system and adherence to relevant regulations
- Track system performance and suggest enhancement measures
- Record infrastructure modifications and refresh system documentation as necessary
Qualifications
At least 3 years of relevant experience in a data infrastructure roleProficiency in AWS and Kubernetes (K8S)Understanding of Terraform for infrastructure as code (IaC) applicationsExpertise in either Airflow or Spark for data pipeline executionQualifications in managing CI / CD tools like JenkinsCapability to operate autonomously and within a collaborative environmentExceptional problem-solving abilities and meticulous attention to detailNice to have
Background in Flink and DatabricksProficiency in Spinnaker for CD managementAbility to quickly adapt and master new technologiesWe offer
International projects with top brandsWork with global teams of highly skilled, diverse peersEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedInSeniority level : Mid-Senior level
Employment type : Full-time
Job function
Engineering, Information Technology, and Business DevelopmentIndustries
Software Development, IT Services and IT Consulting, and Venture Capital and Private Equity Principals#J-18808-Ljbffr