Data Engineer (Senior)

We are #VLteam – tech enthusiasts constantly striving for growth. The team is our foundation, that’s why we care the most about the friendly atmosphere, a lot of self-development opportunities and good working conditions. Trust and autonomy are two essential qualities that drive our performance. We simply believe in the idea of ​​“measuring outcomes, not hours”. Join us & see for yourself!

About the role

You will participate in defining the requirements and architecture for the new platform, implement the solution, and remain involved in its operations and maintenance post-launch. Your work will introduce data governance and management, laying the foundation for accurate and comprehensive reporting that was previously impossible.You will adhere to and actively promote engineering best practices, data governance standards, and the use of open standards. Build data ingestion & processing pipelines. Collaborate with stakeholders to define requirements, develop data pipelines and data quality metrics

Compass BI

Project scope 

Our client is a company that specialises in insurance, reinsurance, and asset management. It focuses on delivering scalable capital solutions that cater to various areas, including property, casualty, and speciality insurance lines. 

Currently in its startup phase, it is actively strategising to enhance its operations and expand its service capabilities. A key aspect of their plans involves the adoption of modern technologies, which will enable the company to streamline processes and increase overall efficiency in their offerings through improved management of data. By leveraging modern technology, our client aims to position itself as a competitive player in the insurance industry while also addressing the evolving needs of its clients.

As part of this transformation, Virtuslab (VL) will accelerate progress on its roadmap and in building a modern data platform with scalable compute capabilities, enhance reporting and workflow automation, and embed cloud-native engineering practices.

Tech stack

Azure, Databricks, SQL, Python, Power Bi 

Challenges

The project involves building a comprehensive reporting and analytics platform from the ground up. Key challenges include integrating data from multiple complex sources, ensuring high data quality and consistency, and designing scalable data models that support both operational and analytical reporting. It also requires close collaboration with business stakeholders to understand reporting needs and translate them into effective data solutions.

Team

The team is small but highly motivated, taking on a broad scope of responsibilities as the platform is built and expanded.

What we expect in general

• Hands-on experience with Python

• Proven experience with data warehouse solutions (e.g., BigQuery, Redshift, Snowflake)

• Experience with Databricks or data lakehouse platforms

• Strong background in data modelling, data catalogue concepts, data formats, and data pipelines/ETL design, implementation and maintenance

• Ability to thrive in an Agile environment, collaborating with team members to solve complex problems with transparency

• Experience with AWS/GCP/Azure cloud services, including: GCS/S3/ABS, EMR/Dataproc, MWAA/Composer or Microsoft Fabric, ADF/AWS Glue

• Experience in ecosystems requiring improvements and the drive to implement best practices as a long-term process

• Experience with Infrastructure as Code practices, particularly Terraform, is an advantage

• Proactive approach

• Familiarity with Spark is a plus

• Familiarity with Streaming tools is a plus

Don’t worry if you don’t meet all the requirements. What matters most is your passion and willingness to develop. Apply and find out!

A few perks of being with us

• Building tech community

• Flexible hybrid work model

• Home office reimbursement

• Language lessons

• MyBenefit points

• Private healthcare

• Training Package

• Virtusity / in-house training

And a lot more!