Data Engineer (Kafka)
Data
Data Engineer (Kafka)
Warszawa
Type of work
Full-time
Experience
Senior
Employment Type
B2B
Operating mode
Remote
Link Group
Hundreds of IT opportunities are waiting for you—let’s make it happen! Since 2016, our team of tech enthusiasts has been building exceptional IT teams for Fortune 500 companies and startups worldwide. Join impactful projects in BFSI, CPG, Industrial, and Life Sciences & Healthcare industries. Work with cutting-edge technologies like Cloud, Business Intelligence, Data, and SAP. Unlock your potential, grow your skills, and collaborate with top global clients. Ready for your next big career move? Let’s link with us!
Tech stack
Apache Kafka
PySpark
Azure
SQL
Python
Job description
Online interview
Your main responsibilities will involve:
- Designing, developing, and maintaining the Data Layer for our new solution.
- Sourcing data from legacy solutions using cloud-based architecture.
- Utilizing SQL Server, Azure Functions, Azure Web Apps in the solution's architecture.
- Developing robust and efficient code in Python, with extensive use of PySpark and other relevant frameworks.
The ideal candidate:
- Has hands-on experience with Kafka and SQL.
- Is familiar with Azure
- Is proficient in Python, with extensive experience in PySpark.
- Has solid experience in data modeling and implementing Data Layers for solutions.
- Is an innovative thinker who understands the transformative role of IT in our organization.
- Thrives in a fast-paced environment and enjoys learning new technologies.
- Can communicate complex IT related issues in an understandable manner.
Is proficient in written and spoken English.
It is an advantage if you have experience with:
- Data Bricks and Delta Tables
- Experience building data-intense application
- DevOps/git/Agile (Continuous integration / Continuous delivery)
Check similar offers
