All offersKrakówDataSenior Scala Big Data Engineer
Senior Scala Big Data Engineer
Data
VirtusLab

Senior Scala Big Data Engineer

VirtusLab
Kraków
Type of work
Undetermined
Experience
Senior
Employment Type
B2B, Permanent
Operating mode
Remote
VirtusLab

VirtusLab

Join #VLteam! We have extensive knowledge about Data Engineering & Data Science, Cloud-Native Services, Reactive Systems, Dev Tooling and Frontend. We are also worldwide experts in Scala language, officially supporting its development and tooling.

Company profile

Tech stack

    Spark
    advanced
    Scala
    advanced
    Hadoop or Cloud solutions
    regular
    English
    regular

Job description

Would you like to wrangle terabytes of data in minutes using cutting-edge technologies? 
Would you like to join a team of talented and passionate Software Engineers? 
Developing your programming skills, building and maintaining data lakes, data platforms and applications for various modern and highly-funded companies? 
Using FP and type safety to make sure your applications are correct and do that in a company developing Scala 3?
 
If you are a Scala developer who would like to get into Big Data or a Data Engineer who wants to learn more about Scala (or both!) then we are looking for someone just like you.
 
 
You'll join the Data department  at Virtuslab where we are providing Big Data and Machine Learning consulting services for various UK, EU and US clients. 
Currently, the two main ones are:

  1. A modern and highly-funded insurance company for whom we create and use a generic framework written in a Functional Programming way on top of Apache Spark, to ingest, validate, transform, store and export data from various sources. We're cooperating with some well-known, world-class Scala experts and there's a lot of places to show your skills on cracking hard problems. 
    Tech Stack: Scala, Spark, AWS (EMR, EC2, S3, Codebuild)

  2. A huge retailer, with tons of data stored in a large, on-prem Hadoop Cluster, which we're extending with cutting edge, flexible, cloud-based solutions. We're responsible for creating large business aggregates for different e-commerce domains. Additionally, we cooperate with data scientists to optimise operations across a number of business areas (from van deliveries to in-store security).
    Tech stack: Scala, Spark, Hadoop, Kafka, Kubernetes, Azure
 

What & how? 


  • On premise and cloud based infrastructures (project dependent, but Scala and Spark are the main technologies)
  • Professional and comprehensive monitoring, logging and alerting
  • Evolutionary Agile approach to software delivery
  • Great teamwork and knowledge sharing
  • Contributions to the open-source software communities

What we expect?


  • Ability and eager to lead by example
  • Hands-on experience in designing and development of scalable, distributed, highly available solutions
  • Interest in solving challenging data engineering problems using state-of-the-art techniques
  • Grounded knowledge and understanding of data structures, algorithms and distributed computing
  • Fluent with Scala and/or Spark
  • Functional Programming mind-set is a nice to have
  • Able to develop and maintain high-quality code
  • Can communicate with the business using good English (both written and verbal)
  • Experienced in using big data and cloud solutions (eg Hadoop, AWS, Azure)

  • Has a deep understanding of data-intensive distributed systems

What’s on offer?


  • Private healthcare
  • Sport card
  • Stretching
  • Training package - every year you can use three working days for internal (Virtusity) or external training, we offer a full or partial refund
  • Funding of language lessons
  • Transparent rules of getting promoted - transparent environment that gives opportunities for personal growth, a promotion and a pay rise
  • Virtusity - in-house training division - knowledge sharing is an important part of our actions so we provide internal workshops and rich knowledge base 
  • Building tech community in Poland - we create a space for the exchange of experience and ideas
  • Open source initiatives - we contribute to open source projects and enhance software that is used by software developers around the world 
  • Flexibility in projects - we make a room for your autonomy and provide you with mentoring and guidance from the first day
  • Flexible hours - you decide when you work efficiently
  • Integration, sport events and tournaments
  • Office in the center of Kraków, Kielce or Rzeszów and soon in Katowice, Wrocław and Gdańsk!
  • Chillout zones
  • MacBook with all additional accessories needed

We do not expect you to qualify for all of the above points. A good understanding of some of these areas and a willingness to develop expertise in others may be sufficient. We are not concerned with your education or any other formalism. What we are concerned with are your passion, knowledge and experience.