Big Data Developer (with Python) Mid/Senior
Data
Big Data Developer (with Python) Mid/Senior
Luxoft Poland
Warszawa
Type of work
Undetermined
Experience
Senior
Employment Type
Permanent
Operating mode
Remote
Luxoft Poland
Luxoft, a DXC Technology Company, is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. We are a global family with an epic atmosphere – we love what we do!
Tech stack
Python
SQL
Agile
HDFS
hBase
Impala
Hive
Airflow
Azure
Job description
Driven by regulatory demand, our client, a top tier investment bank has to establish Global Operational Continuity in Resolution (OCIR) framework across the existing fragmented local solutions, harmonizing taxonomy, processes and procedures and increasing transparency on dependencies and risks in order to ensure and support going concern during resolution or stress situation.
Objective of our project is to provide a global analytics and MI solution using approved data sources, standardize and improve data quality. This global solution has to allow flexible configuration of regulatory rules to enable decommissioning of local fragmented solutions as well as flexible data models, business rules, documentation standards to ensure that capabilities and solutions are scalable, transparent and facilitate:
- Restructuring - timely execution of a bank's recovery and resolution plan
- Reacting to ad-hoc regulatory requests or rules changes
- Adaptation to a long-term roadmap
Objective of our project is to provide a global analytics and MI solution using approved data sources, standardize and improve data quality. This global solution has to allow flexible configuration of regulatory rules to enable decommissioning of local fragmented solutions as well as flexible data models, business rules, documentation standards to ensure that capabilities and solutions are scalable, transparent and facilitate:
- Restructuring - timely execution of a bank's recovery and resolution plan
- Reacting to ad-hoc regulatory requests or rules changes
- Adaptation to a long-term roadmap
Responsibilities
- Responsible for overall technology direction for the assigned module/project
- Designs, develops and modifies code based on functional and system requirements
- Ensure that architectural designs are future-proofed from a scale, load, and performance perspective
- Design and implementation of data processing systems and software
- Integration of existing databases in processing pipeline
- Implementation of low-latency and highly available APIs
- Perform development tool and environment design and configuration
- Support bug fixes, change requests and functional enhancement on the code
- Validates scope, plans and deliverables for assigned projects
- Interacts with Design team and Test team for requirements and defects
- Write reusable, testable and efficient code
- Participate in testing process through unit and functional testing
Skills
Must have
- Minimum 3+ years' experience in a similar role, preferably within financial services
- Functional knowledge Python is mandatory
- Fluent with SQL
- Good interpersonal skills, able communicator and team player, highly autonomous
- Clear written communication skills when documenting processes and features and communicating via e-mail
- Outstanding problem solving skills
- Comfortable working in an Agile environment
Nice to have
- Experience with BigData technologies: HDFS, Hbase, Impala, Hive, Spark
- Able to develop, monitor, debug and maintain a CI/CD pipeline that feeds into a production deployment, plus one or more staging and testing environments
- Experience with Apache AirFlow, Postgresql, Saltstack, Kerberos, Solr is a plus
- Experience with Microsoft Azure or GCP is a plus
- Any of Tomcat, Nginx, MongoDB would be advantageous
- English: C1 Advanced
