All offersBiałystokPythonSenior Data Engineer (Internal Project)
Senior Data Engineer (Internal Project)
new
Python
Sigma Software

Senior Data Engineer (Internal Project)

Sigma Software
4 000 - 4 500 USDNet/month - B2B
Type of work
Full-time
Experience
Senior
Employment Type
B2B
Operating mode
Remote
Sigma Software

Sigma Software

Sigma Software is a global software development company that enables enterprises, startups, and product houses to meet their technology needs through end-to-end delivery. We have been working since 2002, from all over the world.

Company profile

Tech stack

    Airflow
    advanced
    Spark
    advanced
    Azure
    advanced
    Databricks
    advanced
    SQL
    advanced
    Python
    advanced

Job description

Friendly offer

Seeking Senior Data Engineer to lead a small team, modernize a simple data platform into a cloud-based self-service analytics project.


CUSTOMER

Sigma Software provides top-quality software development, graphic design, testing, and support services. Systems developed to deliver customer benefits in automotive, telecommunications, aviation, advertising, gaming, banking, real estate, and healthcare industries.


PROJECT

Within an internal project at Sigma Software, we have two primary goals: to automate reporting and to create a self-service data analytics system for our company.

You will be responsible for designing and modeling data into DWH and Data Marts using Spark and MS SQL, exposing this data to, and collaborating with, BI engineers making reports in Apache Superset, and other roles consuming such data. Additionally, you’ll work with various other team members who rely on this data. Part of your task will involve transitioning our on-premises solution to a cloud-based environment.


RESPONSIBILITIES

• Our goal is to create an efficient system for collecting, processing, analyzing, and visualizing large amounts of data from various sources

• Lay down the foundation and model the data

• Develop a platform for building and maintaining data pipelines that collect data from different sources

• Create Data Warehouse

• Analyze and prepare domain descriptions in collaboration with Business analytics

• Create Data Marts

• Design a permission model with flexible control over vertical and horizontal access to data


REQUIREMENTS

• Conceptual knowledge of data analytics fundamentals, e.g., dimensional modeling, ETL/ELT, reporting tools, data governance, data warehousing, structured and unstructured data

• Strong SQL knowledge and experience with RDBMS, confident knowledge of database fundamentals

• Experience in database development and data modeling, ideally with Databricks/Spark

• Experience with Python

• Working knowledge of serialization formats and their trade-offs (columnar vs. row-based)

• Experience debugging and optimizing Spark jobs

• Strong written and verbal communication skills

• At least an Upper-Intermediate level of English

• BS in Computer Science or a related field

• Experience with a Business Intelligence tool is a nice-to-have

4 000 - 4 500 USD

B2B

Apply for this job

File upload
Add document

Format: PDF, DOCX, JPEG, PNG. Max size 5 MB

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Informujemy, że administratorem danych jest Sigma Software sp. z o.o. z siedzibą w Warszawie, ul. Chmielna 134 (dalej ja...more