Senior Data Engineer (AI Consumer Intelligence Platform)

Our client is hiring Data Engineers

Join a rapidly growing AI Consumer Intelligence Platform Delivering Insights for the World’s Biggest Brands

Hiring Company Background

Our platform synthesizes massive-scale data - billions of Google searches, social conversations, product reviews, and videos - to deliver actionable consumer insights for Fortune 500 clients in days instead of months. Our clients include global leaders in beverages, personal care, and consumer packaged goods.

With a newly appointed CTO expanding our European engineering team, you will shape data engineering standards, define infrastructure architecture, and establish pipeline best practices at a high-growth company, No legacy code politics. No entrenched hierarchies. No inherited technical debt. Your impact will be immediate and visible.

Your Mission

As a Senior Data Engineer, you'll architect and scale production data pipelines that process hundreds of billions of data points for NLP and ML systems.

You'll own the complete data lifecycle—from ingestion and transformation through deployment and observability—while optimizing delivery speed, cost efficiency, and data quality.

This isn't prototyping. You'll convert MVPs into scalable products, establish DataOps/DevOps standards, and design governance mechanisms that prevent technical debt. Your architectural decisions will directly impact how Fortune 500 companies access consumer insights in real-time.

Tech Stack

- Core: Python, PySpark, SQL

- Cloud & Infrastructure: Azure ecosystem, Databricks

- Deployment: Kubernetes, containerization, observability tooling

- NLP/ML: Large Language Models, LLM APIs, Spacy/NLTK/CoreNLP/TextBlob

- Data: Robust pipelines for multi-language text at scale

Required Qualifications

- 5+ years in data engineering

- Python: Production-grade expertise required

- PySpark: Proficiency required

- Databricks: Architecture decisions, optimization, cost management

- Production Deployment: Kubernetes, containerization, CI/CD in enterprise environments

- LLM Experience: Integration, API usage, pipeline deployment

- Computer Science degree

Preferred Qualifications

- NLP/ML: Applied experience with Spacy, NLTK, CoreNLP (or similar)

- Industry Experience: Consumer insights, CPG/FMCG, adtech, marketing analytics, or B2B SaaS

- Multi-Language Text Processing

- LLM Fine-tuning: a strong plus if you've done it in production

What We Offer

- Competitive compensation

- Fully remote (Europe-based required for EST overlap)

- Cutting-edge work: Real-world challenges at scale with the latest ML/NLP technologies

- Ownership & impact: Shape architecture decisions for a fast-growing platform

- Autonomy: We trust you to deliver exceptional work on your terms

- Leadership track: Individual contributor now, with potential team leadership within 12 months