Junior Big Data Engineer
Python
Junior Big Data Engineer
VirtusLab
Kraków
Type of work
Undetermined
Experience
Junior
Employment Type
B2B
Operating mode
Office
VirtusLab
Join #VLteam! We have extensive knowledge about Data Engineering & Data Science, Cloud-Native Services, Reactive Systems, Dev Tooling and Frontend. We are also worldwide experts in Scala language, officially supporting its development and tooling.
Tech stack
English
SQL
Hortonworks/other big data stacks
Bash
Python
Hadoop
Spark
Job description
Could you be/become the passionate Data Engineer we’re looking for?
We are looking for someone who:
- has data engineering skills and interests (sql, etc)
- is familiar with some scripting language and willingness to pick up new ones (eg python, bash)
- for the Lead role: experience in leading small teams
We are not very much concerned with your formal education or any other formalism. What we are concerned with is your passion, knowledge and experience.
Background
The particular project we have in mind for the role is focused on engineering the data, it's ingest, movement and analysis in order to have a golden source of that data available happily in a Hadoop stack.
Sample of daily activities:
- work on creating a data ingest process, bringing the data into Hadoop
- analyse/mitigate data mismatches in sql query results
- maintain and support (3rd line) implemented systems
We are based in Cracow, Poland. We allow some sporadic remote work (usually 1 or 2 days a week), but the bulk of the work is to be done in our office with the rest of the team.
Technology stack:
Storage: SQL, HDFS, HBase, Hive, Teradata…
Scripting: bash, python…
Hadoop: oozie, sqoop, Hortonworks
Automation: jenkins
Scripting: bash, python…
Hadoop: oozie, sqoop, Hortonworks
Automation: jenkins
What to expect
We rely heavily on industry best practices and put a lot of emphasis on code quality, scalability, performance, availability and robustness. We take these things very seriously.
In most of our projects:
- we peer-review 100% of our code,
- we use continuous integration and deployment,
- we constantly test product performance to meet requirements,
- we use tools for static code analysis,
- we use and encourage contributing to open source projects.
We put emphasis on internal training. We even have a department which specializes in internal and external training. We also participate in and sponsor many technical conferences (both in Poland and abroad) and encourage employees to present speeches, run workshops or even become certified trainers. The professional growth of our team is an important part of our company culture.
If this sounds interesting to you, just get in touch and tell us about yourself.