Senior Data Engineer
Data
Senior Data Engineer
Wrocław
Type of work
Undetermined
Experience
Senior
Employment Type
B2B
Operating mode
Remote
Tech stack
Python
Linux
Airflow
GitLab
Docker
Rundeck
AWS
Job description
Online interview
MayStreet has an immediate opening for a Senior Data Engineer. This is a full-time remote position. We are looking for a passionate and enthusiastic problem-solver with an interest in capital markets data to join us as we continue providing technology innovation and support to the world’s leading global capital markets companies.
In this role, you will work alongside a talented and open-minded data team that works on mission-critical applications within capital markets technology. You will have the opportunity to contribute in all phases of the development lifecycle – from suggesting the use of emerging technologies to designing, integrating, and upgrading complex architecture.
MayStreet is a global software company Headquartered in New York City, servicing the world’s top capital markets trading companies. We’re building the next generation of capital markets technology. Global capital markets are an ocean of fast-moving, interrelated and complex data. Historically it’s been nearly impossible for all but a select few firms to make use of much of this data. MayStreet solves this problem by managing collection, storage and API access to uniquely high-quality data sets.
Work qualifications
- Significant experience with Python. Ability to write and maintain object-oriented Python applications is a must.
- The ideal candidate will have at least 4+ years or relevant experience
- Experience with processing job management – experience using one or more of the following: Jenkins, Rundeck, Apache Airflow or other task scheduling software
- Time spent working in a batch data processing environment or other environment where large data jobs are performed using automation
- Experience with ETL pipelines and Data Lakes
- Git version control systems - GitLab and/or GitHub
- Strong proficiency with Linux and an understanding of Linux server architecture and operation. Should be very comfortable with data copying, scheduling tasks and Linux daemons
Nice to haves, but not required
- C/C++ programming experience
- Experience with AWS data warehouse, Redshift, Athena, Dremio or Snowflake
- Experience with Google Cloud BigQuery
- Experience with and knowledge of US and International market data
- Experience with multicast market data
- Experience with monitoring and visualization systems such as Nagios, Prometheus and Grafana
- Experience with time series databases
- Experience with AWS S3
- Experience with Docker and Kubernetes
MayStreet perks
- Competitive compensation
- Entrepreneurial environment
- Small team with growth opportunity
- Exposure to all aspects of the financial technology services industry
MayStreet is an equal opportunity employer.
Check similar offers
