Senior Data Engineer
Data
Senior Data Engineer
C&F S.A.
Warszawa
Type of work
Undetermined
Experience
Senior
Employment Type
B2B
Operating mode
Remote
C&F S.A.
We provide Data Management, Big Data, Advanced Analytics and Compliance services to Fortune 500 companies. We are experts working around the globe and combine business and process insights with tech expertise to develop state-of-the-art IT solutions.
Tech stack
SQL
English
SparkSQL
Python
ETL
Job description
Online interview
Is this job for you?
- Do you like working with data?
- Is data analysis and data patterns what you love?
- Do you enjoy talking to the customers and get to know their point of view?
- Do you like to get your hands dirty building technical solutions?
- Do you think you are a “one-man army”?
- Do you like learning new stuff?
What the working environment is:
- Prepared AWS Cloud environment (S3, Elastic Kubernetes, Redshift)
- Prepared microservice platform – homegrown – Atlas – for data flow creation (Creators are among the team)
- Developer GUI – pyCharm or other, depending on the need
- JetBrain DataGrip for SQL
- Git, Jenkins, S3, Presto, Visual Studio Code
Your main tasks:
- Define and describe the data together with the partner (data consumer)
- Create Proof of Concept for the described data
- Prepare / design / develop (if needed) / verify data process
- Prepare deployments to TEST / STAGE / PROD environments
What we are looking for:
- Ability to collaborate with the partner/data consumer in order to identify the requirements
- SQL proficiency (ANSII SQL, Spark SQL)
- ETL flow basics and way of data flow creation
- Knowledge of Python (Pandas and scripts automation)
- Communicative English that will help you to understand the partner
It would be advantage, if you are also familiar with:
- Project usage of Redshift and AWS (S3, Elastic Kubernetes)
- Project work with JSON and RESTful API
- Windows or Unix / Linux Scripting
- version control solutions (Git and/or BitBucket)
- CI/CD concept and usage of Jenkins
- Kafka usage (sending and receiving data)
- Large Volume data with Change Data Capture
What we offer:
- Great people to work with, open for new challenges and directions. We are honest and open-minded, focused on helping each other.
- Trust. Bring your ideas and arrange the Team as per your vision. Creativity and pro-active approach is much appreciated.
- No boredom. We deliver Data Lakes (including data ingestion and analytical tools around them) so they keep growing all the time requiring us to be innovative and respond quickly to new demand.
- Growth opportunities for international career development. We support the largest international organization outside of Poland, working with cutting-edge BI and BigData technology stacks.
- Flexible terms of cooperation: adjustable work hours, full-time employment or contract-based agreement
- Competitive remuneration and various bonuses, such as access to special medical care (Medicover) and sport (FitProfit or FitSport) cards, refunding of English classes, free yoga and jogging lessons with professional trainers, access to PPK and budgets for professional development.
- Comfortable working conditions in a modern office and a friendly atmosphere (NOTE: due to the COVID we currently work remotly).
Our team:
International, multicultural team that is growing, and that is why we need you. Your teammates are Data Engineers, Technical Leader, and partners from the customers’ company. The partners may be Data Consumers, Analysts or Data Architects.