All offersŁódźDataData Engineer with Python
Data Engineer with Python
Data
CodiLime

Data Engineer with Python

CodiLime
Łódź
Type of work
Full-time
Experience
Senior
Employment Type
B2B
Operating mode
Remote

Tech stack

    Python
    advanced
    Snowflake
    regular
    Postgres
    regular
    Apache Spark
    regular
    Apache Airflow
    regular
    AWS
    regular
    Git
    junior
    CI/CD
    junior

Job description

Online interview

Get to know us better


CodiLime is a software and network engineering industry expert and the first-choice service partner for top global networking hardware providers, software providers and telecoms. We create proofs-of-concept, help our clients build new products, nurture existing ones and provide services in production environments. Our clients include both tech startups and big players in various industries and geographic locations (US, Japan, Israel, Europe).

While no longer a startup - we have 300+ people on board and have been operating since 2011 we’ve kept our people-oriented culture. Our values are simple:

  • Act to deliver.
  • Disrupt to grow.
  • Team up to win.


The project and the team


Our client is a large consulting company, building a SaaS platform to support M&A (Merger and Acquisition) process by generating reports on companies and their competitors such as company overviews, market data, and news feed analysis. Currently, the platform is being extensively extended and integrated with other subsystems of the client.

What else you should know:

  • The team consists of less than 15 people including an architect, project manager, ML developers, and multi-tech and multi-language engineers familiar with numerous APIs, data structuring and processing techniques, presenting output in multiple ways depending on business needs.
  • We use SCRUM/Agile methodology.
  • Our tech stack for the project includes AWS infrastructure, Terraform, relational and non-relational databases (ES, Postgres, Snowflake), application logic and data processing pipelines written in Python and orchestrated by Apache Airflow, front-end built in React.
  • The client is based in the US.

Now we are working on many interesting projects, so we may invite you to an interview for a different project if we consider your skills and profile suitable.


Your role


As a member of the project team, you will be responsible for:

  • Designing and implementing features in Postgres and Snowflake database
  • Implementing solutions suitable for either OLTP or OLAP approaches
  • Investigating possible bottlenecks and improving overall databases’ performance
  • Writing code pieces in Python to PoC developed ideas
  • Participating in technical design discussions
  • Delivering automatic tests for your code
  • Validating the solution with the client (demo)
  • Fixing discovered bugs efficiently and effectively
  • Working in agile methodology and collaborating with a team


Do we have a match?


As a Data Engineer you must meet the following criteria:

  • Very good understanding of data pipeline design concepts and approaches
  • Hands-on experience with Postgres and Snowflake
  • Excellent coding skills in Python
  • Experience with Apache Airflow, Apache Spark tools
  • Experience with CI/CD tools and processes
  • Knowledge of AWS
  • Experience in frameworks like PyTorch, TensorFlow, Ray would be a plus
  • Experience with non-relational databases would be a plus
  • Knowledge of Git
  • Good communication skills, English (B2 level), ability to confront technical solutions with the team and the client’s technical representatives to validate the solution with the client


More reasons to join us


  • Flexible working hours and approach to work: fully remotely, in the office or hybrid
  • Professional growth supported by internal training sessions and a training budget
  • Solid onboarding with a hands-on approach to give you an easy start
  • A great atmosphere among professionals who are passionate about their work
  • The ability to change the project you work on