Lead Azure Data Engineer - Cybersecurity ☁️💥

Join us, and enhance data analytics capabilities for a secure digital future!

Kraków - based opportunity with hybrid work model (6 days/month in the office)

As a Lead Data Engineer, you will be working for our client, a global leader in cybersecurity and data analytics. The Client’s team focuses on advancing cybersecurity capabilities through innovative data engineering and analytics solutions. You will be contributing to the development and enhancement of their data lake and analytics platform, supporting cutting-edge technologies and cloud infrastructures. Your role will involve collaborating with data engineers and cybersecurity professionals to build scalable data pipelines and ensure the continuous growth of security analytics systems.

Your main responsibilities:

1. Designing and implementing data pipelines for cybersecurity use cases
2. Ingesting and provisioning raw datasets and curated data assets
3. Driving improvements in the reliability and frequency of data ingestion
4. Supporting and enhancing data ingestion infrastructure and pipelines
5. Automating and optimizing data engineering workflows
6. Identifying and onboarding new data sources for cybersecurity use
7. Conducting exploratory data analysis for new schemas
8. Collaborating with platform engineers for cloud infrastructure and platform engineering
9. Ensuring the operational efficiency of production data pipelines
10. Monitoring and enhancing cloud-based data transport and data cleaning processes

You're ideal for this role if you have:

1. 5+ years of experience in data engineering or cloud infrastructure engineering
2. Proficiency in programming languages like Python, Java, or C#
3. Experience with cloud technologies, especially Azure (Azure Data Factory, Azure Databricks, etc.)
4. Strong understanding of data engineering principles and data pipeline design
5. Expertise in building and maintaining ETL workflows across disparate datasets
6. Knowledge of data acquisition, cloud-based data pipelines, and data transport
7. Experience with SQL, Kusto query language, or similar query languages
8. Familiarity with cloud cost optimization and data asset curation
9. Ability to work in a fast-paced, collaborative environment
10. Knowledge of cybersecurity principles (preferred but not required)

It is a strong plus if you have:

1. Experience with Infrastructure-as-Code tools such as Terraform or Ansible
2. Familiarity with big data technologies like Kafka, Spark, and streaming services
3. Previous exposure to Security Information & Event Management (SIEM) systems
4. Experience in real-time analytics deployment for large-scale datasets
5. Understanding of cybersecurity frameworks such as NIST, ISO27001, or OWASP
6. Knowledge of cloud security practices and network protocols
7. Experience with cloud-based security orchestration, automation, and response (SOAR) technologies

We offer you:

ITDS Business Consultants is involved in many various, innovative and professional IT projects for international companies in the financial industry in Europe. We offer an environment for professional, ambitious and driven people. The offer includes:

1. Stable and long-term cooperation with very good conditions
2. Enhance your skills and develop your expertise in the financial industry
3. Work on the most strategic projects available in the market
4. Define your career roadmap and develop yourself in the best and fastest possible way by delivering strategic projects for different clients of ITDS over several years
5. Participation in Social Events, training, and work in an international environment
6. Access to an attractive Medical Package
7. Access to Multisport Program

#GETREADY

Internal job ID #6917

You can report violations in accordance with ITDS’s Whistleblower Procedure available here.