Senior Data Platform Engineer (Fintech)

📍 Work mode: 100% Remote in NYC time zone (at least 5/6 hours of overlap with NYC) 🕒 Contract type: B2B💼 Experience level: Senior💰 Rate: 40-65 $ net + VAT / hour⏳ Start date: ideally ASAP 📆 Project length: Long-term cooperation

About the role:Be part of a new function building our data ingest and data science platforms. You will be working closely with all lines of business as they develop new products built on the platforms you provide.You will be building cutting edge data platforms that ingest, manage and process data from all of Tradewebs businesses. The platform will have to accommodate a wide range of use cases from simple customer facing data APIs to large scale machine learning models.

Job responsibilities:

• Build and run data platform using such technologies as public cloud infrastructure (AWS and GCP), Kafka, Spark, databases and containers

• Develop data platform based on open source software and Cloud services

• Build and run ETL tools and frameworks to onboard data into the platform, define schema, build DAG

  processing pipelines and monitor data quality.

• Help develop machine learning development framework and pipelines

• Manage and run mission crucial production services.

Skills:

• Experience as Data Platform Engineering or SRE

• Strong software engineering experience and working with Python.

• Experience building ETL and stream processing tools and frameworks using Kafka, Spark, Flink, Airflow/Prefect, etc.

• Strong experience working with SQL and databases/engines such as MySQL, PostgreSQL, SQL Server, Snowflake, Redshift, Presto, etc.

• Experience with using AWS/GCP (S3/GCS, EC2/GCE, IAM, etc.), Kubernetes and Linux in production.

• Strong proclivity for automation and DevOps practices

• Experience with managing increasing data volume, velocity and variety Agile, self-starter and is focused on getting things done.

• Strong communicator

Nice to have:

• Familiarity with data science stack: e.g. Jupyter, Pandas, Scikit-learn, Dask, Pytorch, MLFlow, Kubeflow, etc.

• Financial Services experience