Sr. Data Engineer

About Craft:

Craft is the leader in supplier risk intelligence, enabling enterprises to discover, evaluate, and continuously monitor their suppliers at scale. Our unique, proprietary data platform tracks real-time signals on millions of companies globally, delivering best-in-class monitoring and insight into global supply chains. Our customers include Fortune 500 companies, government agencies, SMEs, and global service platforms. Through our configurable Software-as-a-Service portal, our customers can monitor any company they work with and execute critical actions in real-time. We’ve developed distribution partnerships with some of the largest integrators and software platforms globally.

We are a post-Series B high-growth technology company backed by top-tier investors in Silicon Valley and Europe, headquartered in San Francisco with hubs in Seattle, London, and Warsaw We support remote and hybrid work, with team members across North America, Canada, and Europe.

We're looking for innovative and driven people passionate about building the future of Enterprise Intelligence to join our growing team!

About the Role:

Craft is looking for an experienced and motivated senior-level Data Engineer to join one of our teams responsible for a key product within the organization. As a core member of this team you will have a great say in how solutions are engineered and delivered. Craft gives engineers a lot of responsibility and authority, which is matched by our investment in their growth and development.

We’re growing quickly and looking to hire data engineers for multiple teams. We’re always looking for folks with strong data engineering experience, Python coding experience, Pandas expertise, and solid software engineering practices. In addition to those skills, we’re looking for two different categories of data engineers. If you feel that your experience aligns with one or both of the categories below, we have a place for you!

1. Someone who has experience with data lakes and data warehousing, graph databases and knowledge graphs.
2. Someone who has experience with streaming and batching of data from data partners and building data pipelines for transactional use, as well as experience with API development, FastAPI, and asyncio.

What You'll Do:

• Building and optimizing data pipelines (batch and streaming).
• Extracting, analyzing and modeling rich and diverse datasets of structured and unstructured data.
• Designing software that is easily testable and maintainable.
• Support in setting data strategies and our vision.
• Keep track of emerging technologies and trends in the Data Engineering world, incorporating modern tooling and best practices at Craft.
• Work on extendable data processing systems that allows to add and scale pipelines.
• Applying machine learning techniques such as anomaly detection, clustering, regression classification, and summarization to extract value from our data sets.

What We're Looking For:

• 4+ years of experience in Data Engineering.
• 4+ years of experience with Python.
• Experience in developing, maintaining, and ensuring the reliability, scalability, fault tolerance, and observability of data pipelines in a production environment.
• Strong knowledge of SDLC and solid software engineering practices.
• Knowledge and experience with Amazon Web Services (AWS) and Databricks (nice to have).
• Demonstrated curiosity through asking questions, digging into new technologies, and always trying to grow.
• Strong problem solving and the ability to communicate ideas effectively.
• Familiar with infrastructure-as-code approach.
• Self-starter, independent, likes to take initiative.
• Have fundamental knowledge of data engineering techniques: ETL/ELT, batch and streaming, DWH, Data Lakes, distributed processing.
• Familiarity with at least some technologies in our current tech stack:
• Python, PySpark, Pandas, SQL (PostgreSQL), ElasticSearch, Airflow, Docker
• Databricks, AWS (S3, Batch, Athena, RDS, DynamoDB, Glue, ECS, Amazon Neptune)
• CircleCI, GitHub, Terraform

What We Offer:

• Option to work as a B2B contractor or full-time employee
• Competitive salary at a well-funded, fast-growing startup
• PTO days so you can take the time you need to refresh!
• Full-time employees: 20- 28 PTO days allotted + paid public holidays
• B2B contractors: 15 PTO days allotted + paid public holidays
• 100% remote work (or hybrid if you prefer! We have coworking space in center of Warsaw.)