Data Engineer (Azure)

Tasks

• Designing and implementing data processing systems on Azure platform. This involves writing efficient and scalable code to process, transform, and clean large volumes of structured and unstructured data.
• Building data pipelines to ingest data from various sources such as databases, APIs, or streaming platforms.
• Integrating and transforming data to ensure its compatibility with the target data model or format.
• Hands-on experience in designing and optimizing of data storage (data lakes, data warehouses, distributed file systems).
• Familiarity with partitioning, compression, optimization of data storage and retrieval.
• Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency.
• Collaborating with cross-functional teams including data scientists, analysts, and business stakeholders to understand their requirements and provide technical solutions.
• Independence and responsibility in delivering solutions.
• Ability to work under agile methodologies.

Requirements

• Proven experience in Azure cloud-based infrastructure, Databricks and one of SQL implementation (e.g., Oracle, T-SQL, MySQL, etc.).
• Proven experience in Python, PySpark.
• Very good level of communication including ability to convey information clearly and specifically to co-workers and business stakeholders.
• Working experience in the agile methodologies – supporting tools (JIRA, Azure DevOps).
• English at least at B2 level, ideally C1.
• Experience or familiarity with other cloud technologies, data warehouses, data governance, and business analysis is a plus.

We offer

• Stable employment. On the market since 2008, 1500+ talents currently on board in 7 global sites.
• “Office as an option” model. You can choose to work remotely or in the office, depending on your location.
• Flexibility regarding working hours and your preferred form of contract.
• Comprehensive online onboarding program with a “Buddy” from day 1.
• Cooperation with top-tier engineers and experts.
• Unlimited access to the Udemy learning platform from day 1.
• Certificate training programs. Lingarians earn 500+ technology certificates yearly.
• Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
• Internal Gallup Certified Strengths Coach to support your growth.
• Grow as we grow as a company. 76% of our managers are internal promotions.
• A diverse, inclusive, and values-driven community.
• Autonomy to choose the way you work. We trust your ideas.
• Create our community together. Refer your friends to receive bonuses.
• Activities to support your well-being and health.
• Plenty of opportunities to donate to charities and support the environment.
• Modern office equipment. Purchased for you or available to borrow, depending on your location.