Senior Big Data Engineer
Data
Senior Big Data Engineer
Ciklum
Gdańsk
Type of work
Undetermined
Experience
Senior
Employment Type
B2B
Operating mode
Remote
Ciklum
We are a global Digital Solutions Company for both Fortune 500 and fast-growing organisations around the world. More than 4000 experts in 11 engineering hubs are creating digital platforms for a variety of industries. Let’s empower success together.
Tech stack
Spark
Big Data
SQL
Job description
Online interview
On behalf of Ciklum Digital, Ciklum is looking for a Senior Big Data Engineer to join the team on a full-time basis with possibility to work from our offices in Gdansk and Wroclaw or fully remotely from all over Poland.
You will join a highly motivated team and will be working on a modern e-commerce solution for our existing client. We are looking for technology experts who want to make an impact on new business by applying best practices and taking ownership.
About the Project:
- Client is an international company dealing in consumer knowledge and insights based on continuous consumer panels. They work in fields such as fast-moving consumer goods, impulse products, beauty and personal care, fashion, baby, telecommunications and entertainment
- Project is about the delivery of data processing platform, Azure Data Lake gen2, Azure Databricks
Responsibilities
- Creation of Databricks notebooks (Databricks training will be provided)
- Incorporation of machine learning models
- Python and PySpark development
Requirements
You can name examples of use in different contexts. Are guided by best-practices and specifications of such skills:
General:
General:
- 3+ years of experience in Spark (Scala/Java) Development
- Good SQL experience
- 3+ years of experience as a developer in big commercial projects
- Desire to learn Databricks
Desirable
- Good experience in Python
- Experience in Azure Data Factory
- Experience with development for Azure Cloud
Personal skills
- Curious mind and willingness to work with client in a consultative manner to find areas to improve
- Intermediate +++ English
- Good analytical skills
- Good team player, motivated to develop and solve complex tasks
- Self-motivated, self-disciplined and result-oriented
- Strong attention to details and accuracy
What's in it for you
- Close cooperation with client
- Constant flow of new projects
- Dynamic and challenging tasks
- Ability to influence project technologies
- Projects from scratch
- Team of professionals: learn from colleagues and gain recognition of your skills
- European management style
- Continuous self-improvement
- Private medical healthcare, fully covered by Ciklum, with a possibility to include your family
- Fully covered life insurance – 100 000 PLN
- Fully covered drug insurance – up to 2 000 PLN/year
- Multisport card, 100% covered by Ciklum – Benefit Systems, Plus package
- Parking space, 50% covered by Ciklum