Senior Data Engineer AWS

Your tasks:

Development, operation and continuous further development of an AWS-based data infrastructure and corresponding data pipelines
Optimization and ensuring the stable operation of Spark ETL processes for efficient data processing
Development and maintenance of robust data pipelines in close cooperation with data owners and data analysts
Analysis of functional and technical requirements as well as conception and implementation of data products within an AWS Big Data Stack
Automation of development and operation processes as well as continuous further development of the existing development stack
Coaching and technical support of other data engineers regarding technical questions and automation topics
Close cooperation with business stakeholders and architecture teams to align technical solutions with business requirements
Optimization of existing AWS services with regard to performance and costs
Support with migrations to new tools, technologies and cloud services
Co-design of modern CI/CD, Infrastructure-as-Code and DevOps processes

Your profile:

Several years of experience in data engineering and in the development of complex data pipelines
University degree in computer science or a comparable qualification or equivalent professional experience
Sound knowledge of Apache Spark, SQL and Python
Experience with AWS and cloud-based big data architectures
Ideally knowledge of AWS Analytics Services such as Glue, SageMaker, Athena, Lambda and Batch
Experience in software development with Scala or Java is an advantage
Knowledge of CI/CD as well as Infrastructure as Code with Terraform
Good understanding of DevOps Best Practices and automated development and operation processes
Experience in optimizing cloud resources with regard to performance and costs is an advantage
Agile and team-oriented way of working with a strong growth mindset and enjoyment of knowledge exchange
Very good German skills in speaking and writing as well as good English skills

Automatically translated from the original.

Posted 4 weeks ago

Location