Data Engineering Tech Lead
Data
Data Engineering Tech Lead
Scalac
Gdańsk
Type of work
Undetermined
Experience
Senior
Employment Type
B2B
Operating mode
Remote
Scalac
Scalac is the Team! This is crucial. We love to work together. We specialize in systems development on a large scale, based on Functional Programming Languages. We believe that truly great products happen when employer and employee go hand in hand.
Tech stack
Scala
Java
Akka
Spark
Kafka
Cassandra
Apache Hadoop
Docker
MongoDB
Job description
Scalac Sp. z o.o.
Scalac is a software house that within just four years has managed to grow to more than 80 developers. Scalac is the Team! This is crucial. We love to work together. We specialize in systems development on a large scale, based on Functional Programming Languages. Working with Scalac means working with great Scala hAkkers, Frontend and Data engineers. We develop complex projects for various types of customers mainly in Fintech, ecommerce and health sector. We believe that truly great products happen when employer and employee go hand in hand. That's why we put strong emphasis on your well being and personal development.
Scalac Happiness Recipe:
- Work Hard
- Do the right thing
- Have fun
Data Engineering Tech Lead
Scope of work:
Scalac Data Engineering position consists of 70% of individual contribution and 30% of leadership activities. It means that you write code as the full-blooded developer and lead data team as the born mentor. We are looking for Data Engineering Tech Lead who will become our Head of Data Engineering (in a year from now).
Responsibilities:
Scalac Data Engineering position consists of 70% of individual contribution and 30% of leadership activities. It means that you write code as the full-blooded developer and lead data team as the born mentor. We are looking for Data Engineering Tech Lead who will become our Head of Data Engineering (in a year from now).
Responsibilities:
- You write code. You are responsible for the software development in data domain.
- You lead data team by providing technical leadership, becoming a mentor, taking care of team effectiveness, knowledge sharing, etc.
- You work with CTO on Scalac data strategy and work with the data engineers to implement it.
- You participate in setting the direction of data domain, in close cooperation with CTO.
- You provide tech research and keep data tech stack updated.
- You cooperate closely with sales team, participating in tech talks with prospects as our primary Data Engineering consultant.
- You are a consultant for customers. Help them to evaluate their problems, requirements, their architecture, engineering needs. You are a listener and a problem solver for them. You participate in meetings and estimations with clients.
- You support the hiring process in data domain.
- You contribute to open source projects, write tutorials and blog posts.
- You participate in conferences and meetups.
- You are ready to be onsite in EU countries and in US/Canada for at least a week in a month.
- Bring your own ideas - we’re waiting for passionate people!
What do we search for:
Tech skills:
Tech skills:
- Programming experience in Data Engineering and distributed computing domain. Functional programming - Scala.
- Strong understanding of data processing and distributed computing concepts and technologies (being able to choose an optimum tech stack).
- Experience in designing and implementing data processing architectures.
- Experience in architecting and developing data pipelines and systems:
- databases and FS (Cassandra, Hadoop, Redis, Postgres, MongoDb, SQL, S3, Aerospike),
- queues (RabbitMQ, Kafka, Kinesis),
- processing (Kafka, Flink, Spark, Hive, Processing),
- distributed / Big Data frameworks (Finagle, Akka, Data Science / ML, Zookeeper),
- data formats (Avro, ProtoBuf, Parquet),
- workflow managers (Luigi / Airflow). - Experience in growing and scaling technically project: from a single app with a proto-data pipeline to high load / availability systems, data lakes, etc.
- Experience in consulting and applying different architectural patterns: event sourcing, streaming, microservices, etc.
- Understanding of the pros and cons of different cloud providers.
Soft skills:
- Knowledge of agile methodologies.
- Experience with the design of applications for scale and load.
- Experience in leading a team.
- Experience in growing internal expertise in data engineering and science.
- High level of self effectiveness.
- Experience in being a consultant for customers.
Nice to have:
- Experience with Machine Learning.
Our offer:
- Great customers to work with (small, agile, startup-ish clients AND bigger well-respected ones, Western Europe companies).
- Freedom (team decides) to choose conventions and work tools.
- Best work equipment.
- Opportunity for professional development (unlimited books budget, budget for trainings, opportunities to travel to technical conferences).
- Regular company-wide retreats - we meet in person to work and play together.
- 100% remotely job.
- Working with the international team.
- Salary: 10 000 - 20 000 b2b