Backend Engineer

About On The Spot:

On The Spot Development is a software development company that builds R&D teams for heavily invested startups and tech companies from the UK, EU, and Israel.

This job opportunity is for a position within one of our teams. You will be directly employed by On The Spot and will collaborate closely with our partner companies, contributing to their product's journey.

About the team:

Orca Security is a cybersecurity startup and cloud innovation leader. Founded in 2019 in Israel by former Check Point managers, it raised $630+ million and became a 'unicorn' in 2021. At Orca, we believe that in the right environment and with the right team, talent has no boundaries.

This team spirit, together with our drive to always aim high (because the cloud is the limit), have quickly earned us unicorn status and turned us into a global cloud security innovation leader. So if you’re ready to join an amazing team of people who inspire each other every day, now is the time to find your place in our pod.

About the role:

As a part of Orca cloud security suite, we are developing a product that processes massive amounts of real-time data. Our team drives Cloud Detection and Response (CDR) offering, managing large-scale API log ingestion, comprehensive stream and batch log analysis, and high-performance real-time services. By connecting software engineering, big data processing, cloud infrastructure and security, we are delivering scalable and reliable systems.

You will play a crucial role in designing, developing, and maintaining our real-time data processing infrastructure, which is going to become one of the key product offerings for the company.

This position requires deep technical expertise, ownership of major product domain and infrastructure components, and active collaboration with cross-functional teams, including product management, research, infrastructure, sales engineering, and customers.

Responsibilities:

1. Own and drive the architecture, implementation, operation, and maintenance of the entire Cloud Detection and Response product offering, including breach detection, anomaly detection, and forensics
2. Ensure the reliability, performance, and scalability of our infrastructure, making data-driven improvements
3. Develop and optimize real-time and batch processing pipelines for API log ingestion and analysis
4. Implement and enhance observability using metrics, logging, and tracing to monitor service health and performance
5. Work closely with product management and research teams to align technical decisions with business needs
6. Design and implement storage solutions optimized for different types of data (structured, semi-structured, unstructured)

Qualifications:

1. 5+ years of experience in software engineering with a focus on backend, distributed systems, or real-time data processing
2. Strong expertise in building scalable and performant services
3. Experience designing and deploying real-time data pipelines using Kafka or similar technologies
4. Deep understanding of cloud infrastructure, preferably AWS, and containerized deployments using Kubernetes
5. Proficiency in working with databases (PostgreSQL, Elasticsearch, or similar) and optimizing data storage for high-scale environments
6. Strong problem-solving skills and a mindset for automation and efficiency
7. Excellent communication skills and the ability to work in cross-functional teams‍
8. Nice to have experience with Apache Spark & Apache Airflow

Bonus points:

1. Experience with real-time security and anomaly or threat detection systems
2. Familiarity with batch and stream processing frameworks
3. Prior work in high-scale, multi-tenant SaaS environments
4. Contributions to open-source projects related to real-time data processing

Tech stack:

1. Programming Languages: Python, Go
2. Frameworks: Django, FastAPI
3. Messaging & Streaming: Kafka, SQS
4. Infrastructure & Orchestration: Kubernetes, Docker
5. Databases: PostgreSQL, SingleStore, Elasticsearch
6. Monitoring & Observability: Grafana, Prometheus
7. Version Control & CI/CD: GitHub
8. Cloud infrastructure: AWS, GCP, Azure
9. Analytics engines: Apache Spark‍
10. Workflow management: Apache Airflow

Benefits:

1. Work in a highly professional team. Informal and friendly atmosphere in the team
2. Paid vacation — 20 business days per year, 100% sick leave payment for up to 10 working days
3. 5 sick days per year
4. Health insurance in Luxmed (after the end of the probationary period)
5. Legal and Accounting support in Poland
6. Additional compensation benefits
7. Ability to work from our comfortable office in Warsaw at Prosta 51
8. Flexible working hours – we care about you (!) and your output
9. Equipment provision
10. Partially compensated educational costs (for courses, certifications, professional events, etc.)
11. English and Polish classes 2 times a week (online)
12. Bright and memorable corporate life: corporate parties, gifts to employees in honor of live events, weekly pizza Fridays‍