Data Engineer (Databricks)

Hello! It's nice to have you here! Let us introduce ourselves 😊

At HiQo Solutions we focus on developing entire IoT systems. We are US-based company, headquartered in Atlanta with delivery centers in Europe. 

Since 2007, we have delivered top-tier software engineering and IT consulting across healthcare, finance, logistics, and manufacturing. Our teams work on cutting-edge projects in software development, IoT, data science, and more, constantly exploring new ways to solve problems.

We are looking for a skilled and proactive Senior Data Engineer with deep expertise in Databricks to join our data platform team. You will be responsible for designing, building, and optimizing scalable data pipelines and lakehouse architectures that power analytics, reporting, and machine learning across the organization.

******

This role is part of a US-based project and follows the US Central Time schedule. We expect candidates to be available from 4 PM to at least 8 PM CET/CEST. Priority will be given to candidates who can meet these hours.

Responsibilities

• Develop and maintain robust ETL/ELT pipelines using Databricks and Apache Spark

• Design and implement Delta Lake architectures for structured and semi-structured data

• Collaborate with data analysts, scientists, and product teams to deliver clean, reliable datasets

• Optimize performance of Spark jobs and manage cluster resources efficiently

• Automate workflows using Databricks Jobs, Workflows

• Ensure data quality, lineage, and governance using Unity Catalog and monitoring tools

• Document data models, pipeline logic, and architectural decisions

• Participate in code reviews and contribute to engineering best practices

Required skills and experience

• 4+ years of experience as a Data Engineer or in a similar role

• Strong hands-on experience with Databricks, including Delta Lake, Spark SQL

• Proficiency in Python and SQL for data manipulation and pipeline development

• Solid understanding of Apache Spark internals and performance tuning

• Experience with cloud platforms (Azure, AWS,GCP)

• Knowledge of data modeling, partitioning, and lakehouse principles

• Ability to work with large-scale datasets and optimize storage and compute costs

• Strong communication skills and ability to collaborate across teams

• English proficiency- at least B2 level

• Highly desirable: availability to work from 4pm to at least 8pm CET/CEST

Nice to have

• Experience with Azure Data Factory or Airflow

• Proficiency with modern data warehouses and tools including Snowflake, Synapse, Red Gate

• Exposure to data governance frameworks and tools (e.g., Unity Catalog, Purview)

• Understanding of machine learning workflows and integration with data pipelines

• Experience with BI tools (Power BI, Tableau) and supporting analytics teams

• Contributions to open-source projects or technical blogs

We offer:

• It’s a unique opportunity to join our offices in Cracow or Wroclaw (only if you want to!)

• Do you prefer working 100% remotely?- That’s totally possible!

• We work only with foreign customers and our team is multicultural- a good way to study and improve your English skills.

• Simple structure and 'open door' way of communication

• Flexible working time - you can agree on it within the team

• Necessary tools and equipment

• Full-time English teachers

• Medical insurance for employees

• HiQo University- internal education and training programs

• HIQO COINS - We have a system of rewarding employees for extracurricular activities