Senior Data Engineer

For our Client, we are looking for a Senior Data Engineer (2–3 days onsite in Wrocław) to join an innovative data team. Join a global financial organization and build a large-scale data platform based on Azure and Databricks! 

RESPONSIBILITIES

• Data Management: Extract, combine, transform, load, manipulate, and cleanse data from various sources to ensure high-quality datasets for analysis.
• Data Structures: Create and integrate data structures suitable for analysis, including developing DDLs to create various MS Cloud SQL Server tables and views in Pond (a subset of the Data Lake) DB.
• Databricks Development: Design and develop Databricks notebooks for extracting data from various input files, joining related entities to create Shared File Formats (SFFs).
• Ingestion Framework: Configure the Ingestion Framework (IF) tables to utilize the existing framework for loading staging and Data Lake Core (DLC) tables.
• Algorithm Development: Develop and deploy algorithms in performance-efficient code across analytical and data platforms.
• Data Pipelines: Build large-scale batch and real-time data pipelines using data processing frameworks in cloud platforms or on-premise environments.
• Continuous Integration: Leverage best practices in continuous integration and delivery to enhance data workflows.
• Data Governance: Track data consumption patterns, collaborating with data governance and information stewards, and participate in vetting and promoting content for the curated data catalog.
• Automation: Recommend and implement automation in existing and future integration flows to improve efficiency.
• Data Quality Improvement: Drive advancements in data acquisition, testing, and tooling to enhance data quality.
• Agile Collaboration: Work in cross-functional agile teams to continuously experiment, iterate, and deliver on new product objectives.
• Requirement Analysis: Play a key role in requirement analysis and project estimates to ensure alignment with business goals.
• Performance Monitoring: Monitor performance and optimize SQL queries for maximum efficiency.
• Documentation: Prepare detailed design documents with prototypes and screenshots based on Business Requirement Documents (BRD) and System Requirement Documents.
• Cloud Tools Utilization: Work with various cloud data tools such as Azure SQL, Azure Data Factory, and Azure Databricks to ingest and prepare data for analysis as per business requirements.
• Collaboration: Work closely with data modelers and business analysts to understand the data model and source-to-staging data mapping.

REQUIREMENTS

• Education: Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
• Experience: 5+ years of experience in data engineering or a related field, with a strong focus on ETL processes and cloud data tools.
• Certifications required: Certified Azure Data Engineer, Databricks Certified Data Engineer
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with MS Cloud SQL Server, Azure Data Factory, and Azure Databricks, PySpark, Spark SQL, ADLS, SQL, PowerBI, SSIS, SSRS, Agile and Scrum
• Strong knowledge of SQL and experience with relational databases.
• Familiarity with big data technologies and data processing frameworks.
• Soft Skills: Excellent problem-solving skills, strong communication abilities, and a collaborative mindset.

WHAT DO WE OFFER ON THIS PROJECT?

• Cooperation based on a B2B contract and rate: x PLN/hour / Cooperation based on a B2B contract.
• 100% remote work / Hybrid work from [city name] (x times a week in the office) / 100% office-based work in [city name].
• Current support during cooperation
• Events and integration meetings, as well as participation in various initiatives, e.g., sports.
• Access to the benefits offering (medical care, life insurance, Multisport card).

WHAT DOES THE RECRUITMENT PROCESS LOOK LIKE?

Application: Apply and submit your CV.

After the application review, the recruiter will contact selected candidates by phone.

Screening: Have a conversation with a speedapp recruiter about your experience.

Next steps: The speedapp recruiter will explain the recruitment process for the specific position.

The speedapp recruiter will stay in touch with you throughout the entire process.

ABOUT SPEEDAPP

At speedapp, we believe that an organization is only as good as the people who make it up. We are a team of IT experts and other professionals working for our clients around the world (including Israel, Austria, USA). We go far beyond the HR category. We build IT teams and also help manage them.

👉 10 years of experience

👉 +100 clients worldwide 

+300 hires per year

💎 We have won the prestigious "Forbes Diamonds" award four times (2022, 2023, 2024, 2025). We are a member of the European Fast Growth Icons network and FinTech Poland. We are ranked 18th among the 100 fastest growing companies 2023 by Clutch.

DO YOU HAVE ANY QUESTIONS?

Contact the recruiter responsible for this process directly.

Ilona Wójcik
Junior IT Delivery Consultant
ilona.wojcik@speedapp.pl