Java Developer with Big Data

🧩 Mandatory Skills

• Java and/or Scala (Scala preferred)
• AWS (strong proficiency)
• Apache Kafka
• Apache Spark or Hadoop or Hive
• SQL (advanced level)
• Data pipeline development in AWS environment

⚙️ Required Experience

• 5+ years of experience in backend or big data development
• Hands-on experience building scalable data pipelines in the AWS ecosystem
• Solid knowledge of distributed systems and large-scale data processing
• Experience with MySQL, Cassandra, and other structured/unstructured databases
• Exposure to fraud detection, real-time analytics, or machine learning models is a plus
• Familiarity with real-time streaming platforms like Apache Flink, Spark Streaming, or Apache Pinot

🎯 Responsibilities

• Design, develop, and optimize scalable big data pipelines
• Implement real-time and batch data processing using Spark and Kafka
• Deploy solutions on AWS using services like EMR, S3, Lambda, Glue, etc.
• Collaborate with data scientists and architects to integrate fraud detection logic
• Monitor and troubleshoot performance and data quality issues
• Maintain documentation and follow DevOps best practices for deployment and CI/CD

✅ Nice to Have

• Experience with Python for scripting or data engineering
• Prior work on fraud analytics or payment systems
• Familiarity with AWS Glue, Redshift, or Athena