Senior Databricks Engineer
Data
Senior Databricks Engineer
Ciklum
Gdańsk
Type of work
Undetermined
Experience
Senior
Employment Type
B2B
Operating mode
Remote
Ciklum
We are a global Digital Solutions Company for both Fortune 500 and fast-growing organisations around the world. More than 4000 experts in 11 engineering hubs are creating digital platforms for a variety of industries. Let’s empower success together.
Tech stack
Azure Databricks
Azure Data Lake
PySpark
Python
Job description
Online interview
On behalf of Ciklum Digital, we are looking for a Senior Databricks Engineer to join our team on a full-time basis.
Work from any Ciklum office or remotely if you are in the EU or Ukraine.
Work from any Ciklum office or remotely if you are in the EU or Ukraine.
Project description:
- Client is an international company dealing in consumer knowledge and insights based on continuous consumer panels. They work in fields such as fast-moving consumer goods, impulse products, beauty and personal care, fashion, baby, telecommunications and entertainment
- Project is about the delivery of data processing platform, Azure Data Lake gen2, Azure Databricks
Responsibilities
- Creation of Databricks notebooks
- Incorporation of machine learning models
- Python and PySpark development
Requirements
- PySpark knowledge
- Databricks
- Good understanding of Azure Data Lake gen2
- SQL
- Python
- Azure DevOps platform including CI/CD Pipelines
Desirable
You should have an idea of the subject and its parts. Can explain. Have experience of use of such skills:
- General experience of data project
- Familiarity with Agile Scrum
- Understanding of principles of DevOps
Personal skills
- Curious mind and willingness to work with client in consultative manner to find areas to improve
- Intermediate +++ English
- Good analytical skills
- Good team player, motivated to develop and solve complex tasks
- Self-motivated, self-disciplined and result-oriented
- Strong attention to details and accuracy
What's in it for you
- Close cooperation with client
- Constant flow of new projects
- Dynamic and challenging tasks
- Ability to influence project technologies
- Projects from scratch
- Team of professionals: learn from colleagues and gain recognition of your skills
- European management style
- Continuous self-improvement