Data Platform Engineer (Expert)

We are #VLteam - tech enthusiasts constantly striving for growth. The team is our foundation, that's why we care the most about the friendly atmosphere, a lot of self-development opportunities and good working conditions.. Trust and autonomy are two essential qualities that drive our performance. We simply believe in the idea of ​​“measuring outcomes, not hours”. Join us & see for yourself!

About the role

As a Data Platform Engineer, you'll lead a small engineering team in an R&D setting and play a crucial role in designing, implementing, and deploying elements of a Data Platform for our customer aiming to consolidate data within the company. We seek an experienced software engineer skilled in developing large-scale data pipelines/systems with strong problem-solving abilities. You'll lead innovation, swiftly test and validate new concepts, and integrate them ensuring team collaboration.

Project scope

Our client is a NASDAQ-listed company that provides a range of solutions to support Go-To-Market (GTM) strategies. They offer a comprehensive B2B database platform that enables sales and marketing professionals to identify, connect with, and engage qualified prospects effectively. The core mission of our client is to equip every company with a complete, 360-degree view of their ideal customer, enhancing every phase of their GTM strategy and boosting their success in achieving business targets.

As a Data Platform Engineer, you'll lead a small engineering team in an R&D setting and play a crucial role in designing, implementing, and deploying elements of a Data Platform for our customer. We seek an experienced software engineer skilled in developing large-scale data pipelines/systems with strong problem-solving abilities. You'll lead innovation, swiftly test and validate new concepts, and integrate them ensuring team collaboration.

Tech Stack

Java, Beam, Spark, Kafka, Airflow, Presto, AWS and GCP (Dataflow, Dataproc/EMR, Cloud Function/Lambda, BigQuery, BigTable), Python

Challenges

• Design, build, and operate highly scalable and flexible systems that can manage and process billions of records a day and support complex and diversified data pipelines
• Leverage cloud computing architectures to support development needs
• Track and identify relevant new technologies in the market and push their implementation into our pipelines through research and prototyping
• Develop processes and tools to monitor, analyze, maintain, and improve data operation, performance, and usability.

Team

Currently, there are 7 engineers from VL working there in 2 subteams. The team is primarily based in the US and Israel

What we expect in general

• Software Engineering experience in data platform/big data software, with a proven track record of delivering highly scalable and efficient solutions
• Substantial experience with Java 8+ (preferred), Scala or Python
• Experience with streaming/data processing technologies such as Beam, Spark, Kafka, Airflow, HBase, Presto
• Experience in building enterprise-grade software in a cloud-native environment (GCP or AWS) using cloud services
• Experience in system architecture and design
• Familiarity with designing CI/CD pipelines with Jenkins, Github Actions, or similar tools (nice to have)
• Experience with Kubernetes using GKE/EKS (nice to have)
• Experience with SQL (nice to have)
• Experience with Graph and Vector databases or processing frameworks (nice to have)
• Excellent communication skills and a pragmatic approach to problem-solving

Don’t worry if you don’t meet all the requirements. What matters most is your passion and willingness to develop. Moreover, B2B does not have to be the only form of cooperation. Apply and find out!

What's on offer?

• Flexible hybrid work model - you decide where & when to start the work. You can work remotely or join us in one of our modern offices (Krakow, Kielce, Wroclaw), always located in the city centres. Just choose what suits you best! 
• Language lessons - we refund up to 500 PLN (per quarter) for learning all languages you would like to take! What’s more, we refund up to 1,000 PLN (per quarter) for learning the English language.
• Virtusity – our training division - we value the personal growth of our #VLteam. That’s why we have a rich offer of internal courses, workshops, etc. (technical, as well as soft skills training) conducted by our employees. 
• Training Package - use our training budget and 24 paid work hours for your development. You can choose the training from our Virtusity portfolio or external conferences, courses, workshops, etc. 
• Home office reimbursement - you can rent all the necessary equipment from our offices, but you can also get up to 800 PLN financial support to set up your WFH.
• Multisport card or MyBenefit points - do you like sports and want free unlimited admission to sports facilities in your city? Or maybe you prefer the cinema, SPA in the mountains, delicious dinner, or Allegro shopping? At VirtusLab, you decide whether you choose a sports card or vouchers for countless attractions. 
• Private healthcare - our insurer's offer allows you to have free health advice, treatments, diagnostic tests, etc., in more than 1,500 clinics operating all over the country.
• Stretching - feeling tense or tired? Take a break from work and join our online stretching sessions.
• Building tech community - we run 9 meetup groups in Kraków, Kielce, and Rzeszów and support many other local initiatives. We also contribute to numerous open-source projects (world-famous solutions and create our own ones). Check out also Sphere.it - our unique platform with tech videos and online events.