Senior Data Engineer (with Snowflake)
Ulica Henryka Sienkiewicza 52, Białystok +4 Locations
Transition Technologies PSC
Responsibilities:
Design, build, and maintain scalable data pipelines (ETL/ELT) leveraging Snowflake and Airflow
Implement optimized schemas, partitioning, and indexing strategies in Snowflake and relational databases
Develop data processing workflows and automation scripts in Python and SQL; integrate with APIs and microservices
Ensure scalability, performance, and resilience of pipelines; implement observability for jobs and data flows
Partner with data scientists and ML engineers to deliver high-quality datasets optimized for AI/ML workloads
Prepare, transform, and manage datasets for embeddings, RAG workflows, and LLM fine-tuning
Requirements:
Experience: A minimum of 5-7+ years in data engineering, preferably supporting AI/ML applications and hold B.Sc., B.Eng., or higher, or equivalent in Computer Science, Data Engineering or related fields
Experience with Snowflake
Programming: Proficiency in Python, SQL and vector database native languages
Databases: Experience with relational databases
Cloud Platforms: Hands-on experience with AWS (OpenSearch, S3, Lambda) or Azure (Azure AI Search, Azure Blob Storage, Azure Automation)
ETL/ELT Pipelines: Experience building scalable ETL/ELT workflows using dbt, Apache Airflow, or similar
APIs & Microservices: Ability to design and integrate RESTful APIs for data exchange
Data Security & Governance: Understanding of encryption and role-based access controls
Version Control & DevOps: Familiarity with Git, CI/CD, containerization (Docker, Kubernetes), and Infrastructure as Code (Terraform, CloudFormation)
Generative AI Support: Experience working with AI-specific data needs, such as embeddings, RAG (Retrieval Augmented Generation), and LLM fine-tuning data preparation
Nice to have:
NoSQL, vector databases
IoT data streaming (Kafka, Kinesis, PySpark etc).
What can we offer:
Flexible forms of employment and working hours (CoE or B2B)
An interesting, challenging job in the dynamically developing Capital Group company;
Work on innovative projects using modern technologies;
Direct impact on shaping the image of the Capital Group's companies on the market;
Possibility to develop competences in a wide range;
Attractive salary;
Stability of employment and a friendly work atmosphere;
Cool benefits, among others integration meetings, internal company competitions, fruit Tuesdays, sweet Thursdays and much more;
Transition Technologies PSC is a dynamic, fully Polish-owned company with over 700 employees across five offices and a coworking space in Wrocław. Generating over 250 million in revenue, we focuse on customer satisfactio...
Senior Data Engineer (with Snowflake)
Senior Data Engineer (with Snowflake)
Ulica Henryka Sienkiewicza 52, Białystok
Transition Technologies PSC