Codahead is a software and hardware development company. Our expertise is at world class level and we're known for delivering. We operate in Europe and North America. We have expertise with Custom software development, Artificial Intelligence driven products, Internet of Things, Hardware Engineering and applied machine learning.
We offer up to 131 pln/h on B2B
About the project:
You will join a small team of experienced backend/data engineers to help us improve/rebuild the infrastructure. From getting it from sources, transforming it, and finally providing it to consumers, you will be challenged to find the best solutions to process the diverse set of data in an ever-growing environment
About the role:
⚙ Design and develop a distributed data processing system built upon AWS
⚙ Analyze performance and scaling of existing solutions in response to increased load
⚙ Develop and improve architecture, as well as selecting optimal technologies and methodologies
⚙ Provide end to end data deployment from inception to consumption
⚙ Close work with DS engineers provide data for the ML components
⚙ Develop best practices for data integration and streaming
Tech Stack (What we are doing):
● Getting data by using Crawlers based on Akka
● Storing data in Hbase, ElasticSearch, MySQL, Postgres, S3
● Communicating via REST API, Kafka, Kinesis, SQS
● Running batch jobs by using Hive, Spark, Athena
● Monitoring applications by using Zabbix, ELK, Cloudwatch
Essential skills:
👀 4+ years of relevant experience as a Data Engineer or Backend Engineer
👀 Deep knowledge of data structures and algorithms
👀 Good understanding of SQL and NoSQL databases, design, and methods for efficiently retrieving data
👀 Strong knowledge of Java and Scala
👀 Understanding of Big Data technologies and solutions (Hadoop, Spark, etc)
👀 Experience with streaming services (Apache Kafka, Kinesis)
👀 Experience with Clouds (AWS preferred)
Awesome but not a must:
👍 Infrastructure as a code (Terraform)
👍Container technologies (Docker and Kubernetes)
👍Workflow engines (Apache Airflow or similar)
👍Python
Parts of the recruitment will be discussed in English.
Perks:
😊 Mac OS/Linux/Windows operating systems at your choice
😊 MultiSport card and private medical care (Luxmed)
😊 Flexitime (8:00/10 - 16:00/18)
😊 Extensive training package
😊 English classes with native speaker
😊 Opportunity to travel abroad
😊 Innovative projects
😊 Parking space
😊 Team building events
😊 Fresh fruit, snacks and fizzy drinks
😊 Games room