Senior Data Engineer

Holisticon Connect is a division within NEXER GROUP - a custom software development company. We started in Poland in 2017 and are now a team of over 180 people with offices in Wrocław, Warsaw, and Cracow. We have the opportunity to work with world-renowned brands from Scandinavia, the UK, and Western Europe. Our goal is to grow stronger, in competence rather than in numbers. If you like what we do, check out our offer, maybe we will have the pleasure of meeting you! 😊 

We are seeking a highly skilled and experienced Senior Data Engineer to make a significant impact on our data engineering efforts in delivering Data Products to the Oncology R&D organization. Your role will focus on advancing our data stack, automation, and observability capabilities. This is a multinational project with the majority of the DataOps and Data Engineering team based in the UK and Europe (including Germany and Spain), while project management is often based in the US.

The project aims to support FAIR data initiative by maintaining existing data quality pipelines (mostly based on Python libraries for data validation like pydantic/Bandera, plus some custom solutions) and developing new ones (using Python as well as dbt for some cloud-based pipelines). 

We offer a choice of employment form: B2B or Employment Contract 

• UoP: 17 000 – 20 000 PLN gross/month
• B2B: 140 – 160 PLN net/hour + VAT

Your responsibilities:

• Building and maintaining the infrastructure and pipelines for extracting, transforming, and loading data for use in data products and analyses;
• Working with data scientists and other stakeholders to understand the data needs and requirements of the organization and designing data systems and pipelines to meet these needs;
• Implementing data ingestion, transformation, and storage systems in a FAIR and high-quality way;
• Ensuring the reliability, scalability, and performance of data systems and pipelines;
• Implementing data governance policies and procedures to ensure the security, privacy, and integrity of data;
• Collaborating with other members of the data team to build and maintain data products and services;
• Staying up-to-date with new technologies and best practices in the field of data engineering.

You might be the perfect match if you are/have:

• Computer Science, Engineering, or Bioinformatics background (Master level) with 5 years of relevant experience;
• Deep knowledge of Python and vast experience with Python data and scientific libraries like Pandas, Numpy/Scipy, Polars, etc.;
• An ability to interact with various data sources, both structured and unstructured (e.g. HDFS, SQL, noSQL);
• Experience working across multiple scientific compute environments to create data workflows and pipelines (e.g. HPC, cloud, Unix/Linux systems);
• Understanding of the FAIR data principles and how they apply to the delivery of integrated X-Omics solutions;
• Deep understanding of typical data quality issues, cleaning, and masking techniques;
• Fluency in English (C1) to work effectively in a multinational team;
• Location in Poland for easy signing of cooperation offers and occasional team meetings (at least 5 years).

Moreover, we appreciate skills in these areas:

• Experience working with metadata models, controlled vocabularies, and ontologies;
• Experience with deploying data pipelines using orchestration services: Airflow/Prefect/AWS Glue/Dagster/etc;
• Experience using AWS services: S3/EBS, EC2, CloudWatch, SNS and Lambda;
• Understanding of software development, testing, and quality processes, experience with testing frameworks and documentation;
• Expertise with biological/health data, especially NGS and other ‘omic technologies;
• Ability to understand, map, integrate, and document complex data relationships and business rules.

By joining us, you gain the following: 

• Opportunity to work on exciting, international projects in cutting-edge industries like Automotive, Biotech, IoT; 
• Possibility to develop in cloud technologies. We are a certified AWS partner;
• Becoming part of a team that believes that the next step to a promising future is to put your heart into it and make it happen; 
• Respect for your private life so you don't have to work overtime or on weekends; 
• Team Events budget to socialize outside of work; 
• Company Events to celebrate smaller and bigger successes (Summer Party, Programmer's Day, and trips abroad – so far we've been in Cape Town, Are, and Barcelona). 

Perks and benefits: 

• Fully remote work or in our office in Wrocław, Warsaw or Cracow; 
• Free benefits such as Luxmed, Multisport, and life insurance in Nationale Nederlanden; 
• Attractive referral system (9,5k for senior, 6k for mid, 2,5k for junior); 
• Personal Training Budget with additional paid hours; 
• Passion Day - an extra day off for your hobby to spend as you please; 
• Flexible working hours with no micro-management approach. Our core hours are 9-15, the rest of the working time is up to you; 
• We provide high-quality work equipment + 2 additional monitors and accessories. 

If you apply for this position and match our expectations, then: 

1) You will be invited to an HR Screening with our IT Recruiter. 

2) You will get a test. 

3) You will meet with a client. 

Submit your application online in one easy step! Apply now!