Software Engineer - Data Platforms (Expert)

We are #VLteam - tech enthusiasts constantly striving for growth. The team is our foundation, that's why we care the most about the friendly atmosphere, a lot of self-development opportunities and good working conditions.. Trust and autonomy are two essential qualities that drive our performance. We simply believe in the idea of ​​“measuring outcomes, not hours”. Join us & see for yourself!

About the role

As a Data Platform Engineer in our team, you’ll play a crucial role in designing, implementing, and deploying Data Platforms for our customers.

We seek an experienced software engineer skilled in developing large-scale data pipelines/systems, with strong problem-solving abilities and experience at a vast scale. You’ll lead innovation, swiftly test and validate new concepts, and integrate them, ensuring team collaboration.

Project scope

Our Client is a NASDAQ-listed company with a portfolio of different solutions supporting Go-To-Market strategy. With a comprehensive B2B database, our client’s platform puts sales and marketing professionals in a position to identify, connect, and engage with qualified prospects.

The mission is to provide every company with a 360-degree view of their ideal customer, empowering each phase of their go-to-market strategy and driving their ability to hit their number.

Tech Stack

Java, Beam, Spark, Kafka, Airflow, HBase, Presto, AWS and GCP (Dataflow/Glue, Dataproc/EMR, Cloud Function/Lambda, BigQuery/Athena, BigTable/Dynamo).

Challenges

• Design, build, and operate highly scalable and flexible systems that can manage and process billions of records a day and support complex and diversified data pipelines
• Leverage cloud computing architectures to support development needs
• Track and identify relevant new technologies in the market and push their implementation into our pipelines through research and prototyping
• Develop processes and tools to monitor, analyze, maintain, and improve data operation, performance, and usability.

Team

Currently, there is 1 person from VL working there, and there are 9 open positions. The team is primarily based in the US and Israel.

What we expect in general

• 8+ years of Software Engineering experience in data platform/big data software, with a proven track record of delivering highly scalable and efficient solutions
• Substantial experience with Java 8+ (preferred), Scala or Python
• Experience with streaming/data processing technologies such as Beam, Spark, Kafka, Airflow, HBase, Presto
• Experience in building enterprise-grade software in a cloud-native environment (GCP or AWS) using cloud services
• Experience in system architecture and design
• Familiarity with designing CI/CD pipelines with Jenkins, Github Actions, or similar tools
• Experience with Kubernetes using GKE/EKS
• Experience with SQL, particularly performance optimization (nice to have)
• Experience with Graph and Vector databases or processing frameworks (nice to have)
• Bachelor’s degree in Computer Science, Software Engineering, or related field
• Excellent communication skills and a pragmatic approach to problem-solving

Don’t worry if you don’t meet all the requirements. What matters most is your passion and willingness to develop. Moreover, B2B does not have to be the only form of cooperation. Apply and find out!

What's on offer?

• Flexible hybrid work model - you decide where & when to start the work. You can work remotely or join us in one of our modern offices (Krakow, Kielce, Wroclaw), always located in the city centres. Just choose what suits you best! 
• Language lessons - we refund up to 500 PLN (per quarter) for learning all languages you would like to take! What’s more, we refund up to 1,000 PLN (per quarter) for learning the English language.
• Virtusity – our training division - we value the personal growth of our #VLteam. That’s why we have a rich offer of internal courses, workshops, etc. (technical, as well as soft skills training) conducted by our employees. 
• Training Package - use our training budget and 24 paid work hours for your development. You can choose the training from our Virtusity portfolio or external conferences, courses, workshops, etc. 
• Home office reimbursement - you can rent all the necessary equipment from our offices, but you can also get up to 800 PLN financial support to set up your WFH.
• Multisport card or MyBenefit points - do you like sports and want free unlimited admission to sports facilities in your city? Or maybe you prefer the cinema, SPA in the mountains, delicious dinner, or Allegro shopping? At VirtusLab, you decide whether you choose a sports card or vouchers for countless attractions. 
• Private healthcare - our insurer's offer allows you to have free health advice, treatments, diagnostic tests, etc., in more than 1,500 clinics operating all over the country.
• Stretching - feeling tense or tired? Take a break from work and join our online stretching sessions.
• Building tech community - we run 9 meetup groups in Kraków, Kielce, and Rzeszów and support many other local initiatives. We also contribute to numerous open-source projects (world-famous solutions and create our own ones). Check out also Sphere.it - our unique platform with tech videos and online events.