Opis:
What we offer
- Flexibility - working hours are flexible just like the work mode, you can work remotely or in a hybrid model from from our Waras office.
- Great atmosphere - we value a friendly, informal atmosphere, and direct contact with everyone in the company.
- Outstanding People - we understand that great teams are about personalities, not just skills. Therefore our team accommodates a fantastic blend of individuals and management that removes roadblocks.
- Modern technologies - we use proven technologies that are currently up-to-date. Even if you have not used all of them, you can make up for it with us!
- Unlimited possibilities - you’ll get the opportunity to develop your qualifications thanks to sponsorship for the industry's meetups and conferences as well as working on challenging international projects with the latest technologies.
- Private medical care and Multisport - we care about your health and wellbeing so you’ll get access to private medical care for you and your family, and partial funding for a sports card.
Wymagania:
Our requirements
- At least 5 years of practice in related roles.
- Expertise in Python and Spark, with proven experience in designing and implementing data workflows.
- Hands-on experience with AWS EMR Serverless, Glue, Glue Data Catalog, Lambda, S3, and EMR.
- Strong understanding of data quality frameworks, governance practices and scalable architectures.
Obowiązki:
Your responsibilities
- Designing, building, and maintaining robust, scalable and efficient ETL pipelines using Python and Spark.
- Willingness to work from the office (one day per week or once a month for a few days).
- Developing workflows leveraging AWS services such as EMR Serverless, Glue, Glue Data Catalog, Lambda and S3.
- Implementing data quality frameworks to ensure reliable data processing.
- Optimizing existing workflows and driving migration to a modern data lakehouse architecture, integrating Apache Iceberg.
- Monitoring system performance and ensuring data reliability through proactive optimizations.
10 lut 2025;
from:
www.pracuj.pl