Senior Data Engineer & Team Leader
Data
Senior Data Engineer & Team Leader
Netguru
Kraków
Type of work
Undetermined
Experience
Senior
Employment Type
B2B
Operating mode
Remote
Netguru
Netguru is a consultancy, product design, and software development company founded in 2008. Netguru has become one of the fastest growing companies in EU, recognised by the Financial Times, Deloitte, and Forbes.
Tech stack
Data Engineering
SQL
Python
DWHs and ETL processes
Docker
PostgreSQL or MongoDB
big data infrastructures
AWS or Azure or GCP
Job description
How we work:
- We focus on the finance and insurance sectors with use cases like recommender systems, churn prediction, and applications of NLP to customer support.
- We conduct internal webinars to share knowledge in the fields of Machine Learning and Data Engineering.
- We’re building an ML-Ops culture within our department and we want to extend that to the Data Engineering area.
- We use AWS and GCP as our cloud providers.
- We encourage our team to share knowledge and experience at external conferences.
- We cooperate closely with the Machine Learning team.
Responsibilities:
- Leading a team of great Data Engineers, building a culture and communication approach that is suited to the needs of the team.
- Aligning the team’s goals with the departmental strategy.
- Coaching and motivation of the team.
- Close cooperation with the Machine Learning team to help our customers become more customer-centric.
- Taking part in shaping the business, in particular our Data Engineering offering.
- Conducting data audits.
- Creating long-term data strategies.
- Designing and implementing scalable data architectures.
Must-haves:
- At least 3 years' practical experience in Data Engineering.
- Experience in preparing data for Machine Learning projects.
- At least 6 months’ experience as a team leader.
- Ability to design and implement complex data pipelines and data infrastructures based on technical specifications for the purpose of collecting and curating data from internal and external data sources.
- Proficiency in SQL.
- Proficiency in scripting for automation with Python.
- Knowledge and experience in designing and building DWHs and ETL processes.
- Experience with Docker.
- Experience working with relational and unstructured data, for example, PostgreSQL or MongoDB.
- Experience with big data infrastructures (e.g. Hadoop, Spark, MapReduce).
- Experience with at least one of the following cloud infrastructures: AWS, Azure or GCP.
Nice-to-haves:
- Knowledge of the Scrum and Agile methodologies.
- Willingness to help and mentor other developers.
- Experience with event architectures and message-subscribe systems like Kafka.
- Experience of working with Kubernetes.
- Experience in software engineering – systems design, coding principles, and best practices.
- Experience in Machine Learning.
Perks & benefits:
- a private health insurance package with dental care,
- a MultiSport card,
- optional life insurance for you and your family,
- individual growth budget for your educational plan,
- additional accessories for your computer to make your work even more efficient and comfortable,
- free breakfasts and co-financed lunches,
- Team Retreats and Team Meetups,
- & more!
You can work 100% remotely or from one of our 9 offices (Poznań, Warszawa, Gdańsk, Kraków, Wrocław, Białystok, Katowice, Łódź, Rzeszów)
We are just getting started 🚀 Ready to face the challenge?