Senior/Lead Big Data Engineer
Data
Senior/Lead Big Data Engineer
Wrocław
Type of work
Undetermined
Experience
Senior
Employment Type
Permanent
Operating mode
Remote
Tech stack
Hadoop
Spark
Scala
Python
Cloud
Kafka
Airflow
AWS
Azure
GCP
Job description
Online interview
We are looking for Senior/Lead Big Data Engineers with at last 5 years of commercial experience to join our growing Data Practice and make our team even stronger. Projects and technologies we are working with are very different and cover all technologies which present currently on the market and represented by open source communities.
We are providing our service to Clients in different domains: Financial, Health Care, Insurance and many others, so you will have a chance to develop yourself in any direction you want.
You can join one of our offices, which are located in Warsaw, Krakow, Wroclaw, Katowice and Gdansk or work remotely. The remote option applies only to the Candidates who will be working from any location in Poland.
We are providing our service to Clients in different domains: Financial, Health Care, Insurance and many others, so you will have a chance to develop yourself in any direction you want.
You can join one of our offices, which are located in Warsaw, Krakow, Wroclaw, Katowice and Gdansk or work remotely. The remote option applies only to the Candidates who will be working from any location in Poland.
RESPONSIBILITIES
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, Time series data, SAP and a lot other based on various proprietary systems. You will need to research and implement data ingestion with help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part business logic and implement it using any language which supported by base data platform
REQUIREMENTS
- Expert knowledge of one of the languages: Java or Scala or Python
- Production experience with: Hadoop, Spark, Kafka, Airflow
- Experience with one of the cloud platforms: Azure, Google Cloud Platform, Amazon Web Services, Cloudera (or any other) HADOOP distribution, Databricks
NICE TO HAVE
- Spark Streaming
- Kafka Streaming / Kafka Connect
- Snowflake
- ELK Stack
- Docker / Kubernetes
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
- Experience as a technical team leader and a mentor
We offer
- UoP or B2B contract
- Vast opportunities for self-development: online courses and library, experience exchange with colleagues around the world, partial grant of certification
- English language classes
- Polish language classes for Foreigners
- Career development center
- Unlimited access to LinkedIn learning solutions
- Possibility to relocate for short and long-term projects (ex. to USA or Switzerland)
- Benefit package (private insurance, health care, multisport, lunch tickets, and shopping vouchers, etc.)
- Possibility to be involved in an international project
- Remote work options
- Relocation package for foreign applicants as well as for people relocating within Poland
Check similar offers
