Senior Big Data Engineer - Data Platform and Processing
Data
Senior Big Data Engineer - Data Platform and Processing
DevsData
Oslo, Norway
Type of work
Undetermined
Experience
Senior
Employment Type
B2B
Operating mode
Office
DevsData
DevsData is a premium recruitment and software development agency specialized in developing unique software, artificial intelligence, and Big Data solutions. We’re working 100% remotely so that we can change the world from every place on Earth.
Tech stack
Apache Spark
Distributed systems
Handling high volume of data
JVM (Java/Scala)
Python
Apache Kafka
Cassandra
Luigi
Kubernetes
Hadoop
Job description
Senior Data Engineer / Big Data engineer needed
- Full-time (40h a week)
- Location: Oslo, Norway (yes, relocation is required)
- Duration: 12+ months (permanent employment / long-term contract)
- Start: mid January 2019 (negotiable)
- 3-4 people with this profile are needed
- Rate of up to $85/h, travel costs are covered by the company
- B2B - you will pay taxes in your country of origin
- For exceptional talents, experts in a field, the rate can be higher
Yet another time we search for extraordinary specialists to join our nerdy crew! :)
Project for a big retail corporation in Norway (12k employees) with stores across entire Europe.
You’ll be working closely with business people (including ex-McKinsey partner with 20 years of business experience; Harvard graduate), IT specialists (SE architects, DevOps, UI/UX people), marketing/sales department, Machine Learning/Artificial Intelligence professionals, QA, logistics department and product manager to design, prioritize, and build new IT products in fashion, retail/e-commerce sectors related to a digital transformation that is happening in the organization.
Expect processing high volume of data using modern technology stack.
Expect processing high volume of data using modern technology stack.
One of the most important products that will need to be build is a new ecommerce platform (think: Zalando competitor) as well as information/data exchange platform for physical stores and IT tools for supply chain optimisation.
The role is a fast-paced environment that involves above-average degree of tech & business conceptual thinking, swiftness, communication & people skills and ecommerce/retail understanding. Ideal candidate can present a work history for well-known brands, some startup world experience (we’re lean and move quickly), min 2 years of similar commercial experience on a similar position.
If you are looking for an easy next project/job, or quick cash - there are better offers out there.
Basic algorithmic experience and problem solving absolutely required - if you're strong in JS/React, but struggle at algo or data structures, don't bother applying.
A rare, exciting opportunity to hone industry-related, practical business know-how, system design skills and work/network with top-notch world-class professionals (we already relocated people from the US and Canada for this project; people with Harvard and Google on their CVs).
Initial tech stack (not exclusive):
- Distributed systems
- Apache Kafka
- Apache Spark
- Jvm (scala/java)
- Luigi
- Handling high volume data
- Python
- Cassandra
- Kubernetes
- Terraform
- Ansible
- Google Cloud
- Hadoop
- Bash
- Numerical libraries, pyspark, mllib, sklearn
- Tensorflow
- AWK
- Apache Kafka
- Apache Spark
- Jvm (scala/java)
- Luigi
- Handling high volume data
- Python
- Cassandra
- Kubernetes
- Terraform
- Ansible
- Google Cloud
- Hadoop
- Bash
- Numerical libraries, pyspark, mllib, sklearn
- Tensorflow
- AWK
Requirements
- Previous involvement in building large IT product totally from scratch
- Previous experience with processing high volume of data
- Minimum 1 year of professional experience on commercial projects and similar position (senior data/software engineer)
- Minimum 6 years of commercial, hands-on IT experience in total
- International experience
- Fluent English communication skills
- Being up to date with recent tech tools & frameworks, extensive overall IT knowledge
- Willingness to relocate to Oslo
Big pluses
- Studied Computer Science at a prestigious university - e.g. Harvard, Oxford, Cambridge, MIT, Stanford, Wharton, Berkeley (or top universities in your country; for Poland - University of Warsaw, AGH, Jagielonian University, and Warsaw University of Technology)
- ️Worked or contracted to well-know brands and corporations e.g. Google, Palantir, Hedge Funds, Amazon, eBay, Microsoft, Goldman Sachs (kidding, GS is actually a minus :)), Intel, Nvidia
- ️ Work experience also from the fast-paced startup world
- ️ Worked with a distributed/remote team before
- Excellent communication skills
- Business understanding / product skills
- If you consider yourself a nerd :) and are passionate about the technology, that's a big plus