Cloud Data Engineer
Python
Cloud Data Engineer
Gdańsk
Type of work
Undetermined
Experience
Mid
Employment Type
Permanent
Operating mode
Remote
Tech stack
Azure
Docker
Python
AWS
Spark
Amazon AWS
Job description
About us
Product Team that specializes in Maritime and Trade at IHS Markit provide users with the ability to see where every ship is in the world with knowledge of where it comes from, goes to and details on who owns and operates that ship. We can also show what cargo is being moved in volume and value and the key people in the supply chain. Governments, Ship operators, port authorities, financials and cargo owners use our services to optimise supply chains, review operational activity and evaluate market positions
Your Role
We are looking for a skillful and passionate Cloud Data Engineer to join the IHS Markit Maritime and Trade Team. You will be a key member of the Maritime & Trade Product Development and Delivery in Gdańsk.
Key responsibilities include:
- Design and develop key cloud-based data processing and analytics components in projects with significant business impact for Maritime & Trade business line
- Develop and maintain backend applications that integrate with various data storage technologies.
- Review existing data processing solutions and implement cost-effective and cloud-optimized alternatives.
- Work in a team environment using Agile practices and methods (Kanban/Scrum)
- Work with internal customers to understand requirement better and adjust the design accordingly
- Have a chance to learn analytical algorithms and ML solutions
- Solve problems through dialog with other team members
Key Qualifications and Skills:
- Working level knowledge of AWS/Azure/GCP (AWS is preferred)
- High analytical and problem-solving skills
- Experience working with Spark/Hadoop or other data processing frameworks
- Familiarity with Docker
- Familiarity with DevOps concepts (Ansible, Terraform, CI/CD)
- Good knowledge about common design patterns, especially around data intensive applications
- Full project life-cycle experience in Python
- Familiarity with database/distributed storage concepts
- Strong troubleshooting skills
- Fluent knowledge of Polish and good knowledge of English
Nice to have:
- Kubernetes/ECS
- SQL, Data Warehouses
- Apache Kafka, Amazon Kinesis
What we offer
- Attractive benefits package (private health care, life insurance, MultiSport card)
- Participation in English classes
- Chillout & fun room (table tennis, table football, Xbox, billiards)
- Three days for charity/volunteering
- Fruit days, Coffee, tea, chocolate
- Remote recruitment and onboarding process
Check similar offers
