Senior Data Engineer (AI solutions)

Job Responsibilities:

• Collaborate with AI engineers, data scientists, product owners, and other developers in Agile teams to integrate LLMs into scalable, robust, fair and ethical end-user applications, focusing on user experience, relevance, and real-time performance
• Design and implement scalable, high-performance data pipelines for AI/GenAI applications, ensuring efficient data ingestion, transformation, storage and retrieval; integrate different databases, requiring understanding of data architectures / Domain data ecosystem
• Work with vector databases (e.g., AWS OpenSearch or Azure AI Search) to store and retrieve high-dimensional data for Generative AI workloads
• Build and maintain cloud-based data solutions using AWS OpenSearch, S3 or Azure AI Search, Azure Blob Storage
• Design and optimize data storage and processing using Snowflake for scalable, cloud-native analytics solutions
• Develop ETL/ELT pipelines to enable real-time and batch data processing
• Collaborate with AI/ML Engineers and Data Scientists to ensure seamless integration of data pipelines with AI finetuning, inference and training workflows
• Optimize data storage, retrieval, and processing strategies for efficiency, scalability, and cost-effectiveness
• Implement data governance, security best practices, and compliance measures aligned with standards
• Set up monitoring, alerting, and logging for data pipelines, ensuring high availability and reliability

Expectations:

• 3+ years of experience in data engineering, preferably supporting AI/ML applications
• Proficiency in Python, SQL and vector database native languages
• Experience with relational, NoSQL, vector databases, and Snowflake (pref)
• Hands-on experience with AWS (OpenSearch, S3, Lambda) or Azure (Azure AI Search, Azure Blob Storage, Azure Automation)
• Experience building scalable ETL/ELT workflows using dbt, Apache Airflow
• Understanding of encryption and access controls
• Familiarity with Git, CI/CD, Docker, Kubernetes, Terraform and CloudFormation
• Experience working with AI-specific data needs (embeddings, RAG) and LLM fine-tuning data preparation
• Excellent analytical skills and the ability to handle complex challenges with innovative solutions
• Sc., B.Eng. (or higher) in Computer Science, Data Engineering or related fields
• Team-oriented, proactive, and collaborative
• Excellent verbal and written communication skills (in English and Polish)

Nice to have:

• Ability to design and integrate RESTful APIs

We Offer:

• Ongoing support from a dedicated agent, taking care of your project continuity, client contact, necessary formalities, work comfort and development, 
• Consultant Development Program – advice on growth planning based on the latest trends and market needs in IT, including consultations with agents and growth mentors, 
• Access to 7N Learning & Development – a development and educational platform with webinars, a library of articles and industry reports, and regular invitations to one-time and recurring development events – technical, business, and lifestyle, 
• Spectacular integration events, both for you (e.g., annual Kick-Off trip, Christmas parties, or Summer Olympics sports events) and for your loved ones (e.g., family picnics, movie premieres), 
• Professional development not only during the project – you can get involved in knowledge transfer to others within the 7N Services offering directed at 7N clients, 
• Relationships and access to the knowledge of the most experienced IT experts in the market – the average professional tenure of our consultants in Poland is over 10 years, 
• A complete benefits package, including funding for medical care, life insurance, sports cards for you and your loved ones, as well as discounts in stores in Poland and abroad.