Big Data Engineer

Responsibilities:

• Designing, building, and managing scalable big data architectures and solutions
• Developing and optimizing data pipelines for processing large-scale datasets
• Integrating and processing data from various sources to enable analytics and reporting
• Ensuring the data infrastructure is robust, reliable, and efficient
• Collaborating with data scientists, analysts, and other stakeholders to understand data requirements
• Implementing real-time data processing and batch processing systems
• Monitoring and troubleshooting big data systems to ensure high availability and performance
• Ensuring data security, integrity, and compliance with data governance policies
• Staying up to date with the latest trends and technologies in big data and cloud solutions

Requirements:

• 3+ years of experience in Big Data engineering or related roles
• Strong proficiency in big data technologies (e.g., Hadoop, Spark, Kafka, Hive, Flink)
• Hands-on experience with data processing frameworks (e.g., Apache Hadoop, Apache Spark, Apache Flink)
• Proficiency in programming languages such as Java, Scala, or Python
• Experience with cloud platforms (AWS, GCP, or Azure) and big data services (e.g., AWS EMR, Google BigQuery)
• Strong knowledge of data storage technologies (e.g., HDFS, NoSQL, relational databases)
• Familiarity with ETL tools and frameworks for data integration and transformation
• Solid understanding of data architecture and data warehousing principles
• Experience with containerization and orchestration tools (e.g., Docker, Kubernetes) is a plus
• Strong problem-solving and troubleshooting skills
• Good communication skills and ability to work in a collaborative team environment
• Fluency in English (both written and spoken)

Offer:

• 100% remote work
• MultiSport Plus
• Group insurance
• Medicover Premium
• e-learning platform