Data Engineer

Are you an experienced Data Engineer eager to tackle new challenges in the manufacturing industry? Join our team to work on software for our business partner specializing in this field.

In this role, you will be involved in designing and developing data pipelines using modern cloud tools and technologies. Your work will help integrate and optimize data processes, contributing to the enhancement of product quality predictions. If you are passionate about data engineering and eager to work with cutting-edge technologies, this opportunity is for you.

In Short

🌎 100% REMOTELY or from one of our 2 offices

💰 140 - 180 PLN/h + VAT

☑️ B2B contract

Your Daily Missions

• Identifying significant, reliable, and accurate data in a diverse data landscape.
• Designing and developing new data pipelines using cloud tools and architectures.
• Playing a key role in creating data products such as BI reports and delta tables.
• Preparing and participating in the implementation of data pipelines and applications by ensuring data availability and consistency in the Data Lake.
• Optimizing data processing workflows.
• Supporting Data Scientists by ensuring they have access to high-quality data.
• Being part of the SCRUM team.

The Essentials We’re Seeking

• 5+ years of commercial experience with one of the following technologies: Python, C#, Java, Scala, Shell (Python preferred).
• Experience in the area of Data Engineering and strong analytical skills.
• Experience with the Big Data technology stack, e.g., PySpark/Spark, Delta Tables, etc.
• Experience with multiple Big Data file formats like Parquet, Avro, and Delta Lake.
• Proficiency in modern data platforms such as Databricks, Synapse, or equivalent.
• Good practical knowledge of SQL and relational databases: PostgreSQL, SQL Server, and familiarity with NoSQL databases.
• Experience with Azure or willingness to learn the Azure cloud ecosystem.
• Solid understanding of concepts like Change Data Capture (CDC) and schema evolution.
• Fluency in English (minimum B2) – we work in an international team.

Nice-to-haves

• Proficiency with Tableau and/or Grafana for data visualization and BI.
• Experience in setting up MLOps processes and managing a machine learning model registry.
• Knowledge of time-series databases and real-time data processing.
• Familiarity with .NET.
• Familiarity with Pandas and Snowflake.
• Experience with CI/CD pipelines on GitLab/GitHub.
• Understanding of modern software development practices, including Docker, Infrastructure as Code (IaC), and Kubernetes.
• Some experience with Terraform.

Reasons Why You Would Enjoy Working With Us

• We work in the latest technologies and with international clients, and our projects are polished from < to /> - learn about some of the projects we have completed.
• We organize TechTalks, meet-ups and create guilds where we exchange knowledge - you can learn a lot from your teammates.
• We have a close-knit team and we make sure to have regular integrations - we often go out to celebrate together.
• You can work remotely or choose to work from our offices in Wroclaw or Bielsko-Biala. However, we count on your openness to occasionally visit the office for team meetings or client visits, or possible occasional trips to the client's headquarters.
• You can adjust your working hours to suit your needs, starting your day between 7:00 and 10:00 am.
• You can work with great specialists in their fields who also have a sense of humor and other after-hours hobbies. It is the people who create the unique atmosphere and relaxed atmosphere at CSHARK.
• We have a flat structure - we are not a corporation and don't want to be one 🙃.
• We offer bonuses for employee referrals (from 3000 PLN to 7000 PLN).
• We organize remote English classes and provide access to the company library. You can also become an author/author of articles published on our technical blog - https://cshark.com/blog/.