Senior Data Engineer

Infogain

Kraków

Type of work

Undetermined

Experience

Senior

Employment Type

B2B, Permanent

Operating mode

Remote

Tech stack

PySpark

advanced

ETL

advanced

SQL

regular

Job description

Who we are:

Infogain is a global technology solutions and services company that enables businesses to accelerate their digital transformation journey. With a strong focus on customer-centricity, Infogain delivers innovative solutions and services that help clients harness the power of emerging technologies to drive growth, enhance operational efficiency, and improve customer experience.

As a trusted partner to leading enterprises, Infogain offers a comprehensive range of services spanning the entire IT lifecycle. From strategic consulting and digital experience design to advanced engineering and data analytics, Infogain leverages its deep industry expertise and global delivery capabilities to deliver tangible business outcomes for clients across various industries, including retail, high-tech, banking and financial services, healthcare, and travel.

At Infogain, we take pride in our customer-first approach, agility, and collaborative mindset. Our team of dedicated professionals embraces innovation and works closely with clients to understand their unique challenges and goals, enabling us to deliver tailored solutions that drive meaningful business impact. With a proven track record of successful engagements and a strong commitment to quality, Infogain is a preferred partner for organizations seeking to accelerate their digital transformation and achieve competitive advantage in today's rapidly evolving business landscape.

Project info:

As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining scalable and efficient data pipelines. Your role will involve collaborating with cross-functional teams to ensure the availability, reliability, and accuracy of data for various analytical and reporting purposes.

Write and optimize PySpark code to enable effective execution and transformations of data.
Design and develop ETL processes and data pipelines to extract, transform, and load data from various sources into target systems.
Develop and maintain complex SQL queries to extract and manipulate data from databases.
Utilize Databricks and Notebooks to analyze data, develop prototypes, and provide data insights.
Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and implement data solutions accordingly.
Work with the MS Cloud stack, including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and Power BI, to build robust data solutions.
Optimize and tune data processes to ensure efficient and scalable performance.
Ensure data quality, integrity, and security throughout the data lifecycle.
Keep up-to-date with industry trends and best practices in data engineering and apply them to enhance data solutions.

Must-Have:

Strong proficiency in writing and transforming PySpark code for efficient data processing and transformations.
Good understanding of ETL principles, data pipelines, and data integration techniques.
Proficient in writing efficient and complex SQL queries to extract and manipulate data.
Hands-on experience with Databricks and Notebooks for data analysis and prototyping.
Knowledge of the MS Cloud stack, including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and Power BI.

Must possess a legal work permit in Poland

Good-to-Have:

Familiarity with DevOps tools and practices for CI/CD and automation.
Prior experience in the clinical domain or healthcare industry.
Familiarity with healthcare data standards, regulations, and best practices.

Qualifications and Skills:

Bachelor's degree in Computer Science, Engineering, or a related field. A Master's degree is a plus.
4+ years of professional experience as a Data Engineer or a similar role.
Strong problem-solving and analytical skills.
Excellent communication and interpersonal skills.
Proven ability to work effectively in a team and collaborate with cross-functional stakeholders.
Strong attention to detail and a commitment to delivering high-quality results.
Ability to adapt to a dynamic and fast-paced work environment.
We offer competitive compensation packages, a collaborative work culture, and opportunities for professional growth and development.

General benefits:

Hybrid work model combining office & remote work
Attractively located office with collaboration spaces
Onsite parking space for employees
Company performance related bonus
Referral program with financial bonus
Life Insurance
Budget for development (including language courses and others), clear career path with the possibility to gain experience in international environment
Access to internal Learning Platform with multiple trainings oriented for professional growth

Lifestyle benefits: