Senior Azure Data Engineer + Databricks

We are seeking an experienced Cloud Data Engineer proficient with Azure and Databricks. The ideal candidate will have hands-on experience in designing and implementing data pipelines, data warehousing solutions, and ETL workflows. Be an expert in mentioned technologies.

Tasks:

• Designing and implementing data processing systems on Azure platform. This involves writing efficient and scalable code to process, transform, and clean large volumes of structured and unstructured data.
• Building data pipelines to ingest data from various sources such as storages, databases, APIs, or streaming platforms.
• Support team members with troubleshooting and resolving complex technical issues and challenges.
• Provide technical guidance in data engineering and with team in selecting appropriate tools, technologies, and methodologies. Be updated with the latest advancements in data engineering and ensuring the team follows best practices and industry standards.
• Collaborate with stakeholders to understand project requirements, define scope, and create project plans.
• Support project managers to ensure that projects are executed effectively, meeting timelines, and quality standards. Monitor progress, identify risks, and implement mitigation strategies.
• Act as a trusted advisor for the customer.
• Oversee the design and architecture of data solutions, collaborating with data architects and other stakeholders. Ensure data solutions are scalable, efficient, and aligned with business requirements. Provide guidance in areas such as data modeling, database design, and data integration.
• Align coding standards, conduct code reviews to ensure proper code quality level.
• Identify and introduce quality assurance processes for data pipelines and workflows.
• Optimize data processing and storage for performance, efficiency and cost savings.
• Evaluate and implement new technologies to improve data engineering processes on various aspects (CICD, Quality Assurance, Coding standards).
• Maintain technical documentation of the project, control validity and perform regular reviews of it.
• Ensure compliance with security standards and regulations.

Requirements:  

• At least 6 years of professional experience in the Data & Analytics area
• 1+ years of experience (or acting as) in the Senior Consultant or above role with a strong focus on data solutions build in Azure and Databricks/Synapse/(MS Fabric is nice to have).
• Proven experience in Azure cloud-based infrastructure, Databricks and one of SQL implementation (e.g., Oracle, T-SQL, MySQL, etc.)
• Proficiency in programming languages such as SQL, Python, PySpark is essential (R or Scala nice to have).
• Very good level of communication including ability to convey information clearly and specifically to co-workers and business stakeholders.
• Working experience in the agile methodologies – supporting tools (JIRA, Azure DevOps).
• Experience in leading and managing a team of data engineers, providing guidance, mentorship, and technical support.
• Knowledge of data management principles and best practices, including data governance, data quality, and data integration.
• Good project management skills, with the ability to prioritize tasks, manage timelines, and deliver high-quality results within designated deadlines.
• Excellent problem-solving and analytical skills, with the ability to identify and resolve complex data engineering issues.
• Knowledge of data security and privacy regulations, and the ability to ensure compliance within data engineering projects.
• Knowledge of data orchestration tools.
• Experience in designing and creating integration and unit tests will be nice to have.
• Continuous learning mindset, staying updated with the latest advancements and trends in data engineering and related technologies.
• Experience or familiarity with other cloud technologies, data warehouses, data governance, and business analysis is a plus.

We offer:

• Stable employment. On the market since 2008, 1500+ talents currently on board in 7 global sites.
• “Office as an option” model. You can choose to work remotely or in the office, depending on your location. 
• Flexibility regarding working hours and your preferred form of contract. 
• Comprehensive online onboarding program with a “Buddy” from day 1.  
• Cooperation with top-tier engineers and experts. 
• Unlimited access to the Udemy learning platform from day 1.
• Certificate training programs. Lingarians earn 500+ technology certificates yearly. 
• Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
• Internal Gallup Certified Strengths Coach to support your growth.
• Grow as we grow as a company. 76% of our managers are internal promotions.  
• A diverse, inclusive, and values-driven community.  
• Autonomy to choose the way you work. We trust your ideas. 
• Create our community together. Refer your friends to receive bonuses. 
• Activities to support your well-being and health.
• Plenty of opportunities to donate to charities and support the environment. 
• Modern office equipment. Purchased for you or available to borrow, depending on your location.