Data Engineer (Python/SQL; Hybrid from Warsaw)

Data Engineer (Python/SQL; Hybrid from Warsaw)

• 💰 Salary: 20,000-28,100 PLN/month

• 🌎 Hybrid from Warsaw (3 days/week in office)

• 🕦 Full-time position

• ☑️ B2B

We are looking for a Data Engineer for a partner client who leads in AI-driven enterprise solutions. They provide digital transformation services and consulting that create value for businesses, focusing on operational excellence, enhanced efficiency, and new revenue streams, especially in the private capital sector.

Requirements:

• 3+ years of hands-on Python programming experience, with strong Pandas knowledge.

• 5+ years of expertise in writing advanced SQL queries for relational database systems.

• 5+ years building and maintaining ETL pipelines with tools like Airflow, Prefect, or equivalent platforms.

• Solid background in DBT for data transformation workflows and modeling.

• Practical experience working with cloud data warehouses such as RDS, Redshift, or Snowflake.

• Knowledge of data warehouse architecture including OLTP, OLAP, dimensional modeling, and fact tables.

• Background in cloud-native data architectures, messaging systems, and analytics platforms.

Nice to have:

• Familiarity with Docker and Kubernetes containerization.

• Understanding of CI/CD automation practices.

• Knowledge of AWS Lambda, Step Functions, or similar serverless technologies.

• Experience implementing data partitioning strategies.

• Hands-on experience with Databricks and PySpark.

• Relevant cloud platform certifications.

Responsibilities:

• Build and maintain Python-based scripts and ETL workflows using Prefect and Airflow for data preparation and analysis.

• Create dimensional and denormalized data models optimized for reporting and analytics use cases.

• Develop database schemas and ontologies optimized for AI applications.

• Design cloud infrastructure solutions for managing complex data topologies.

• Execute data transformation and migration tasks using Python, DBT, and Pandas.

• Implement event-driven and streaming architectures for real-time data processing.

• Process and transform data from various formats including structured, semi-structured, and unstructured sources.

• Fine-tune ETL processes for high performance and scalability with large-scale datasets.

• Proactively monitor data pipelines and resolve performance issues and bottlenecks.

• Apply industry best practices for data governance, security, and management across Prefect, DBT, and Pandas workflows.

• Develop SQL queries, create stored procedures, and analyze legacy data pipeline implementations.

• Conduct thorough code reviews ensuring alignment with requirements, performance optimization, and coding standards.

• Support continuous integration and deployment workflows for automated releases.

• Ensure data quality through validation, cleansing processes, and robust error handling.

Get to know DevsData

We are a technology consulting company and a recruitment agency, delivering software solutions to clients from Europe and the US. We work 100% remotely, in an international team, including people from Asia, London, or San Francisco. We employ people with experience in international corporations as well as students of the best technical and business universities.

Find out more: https://devsdata.com