4 to 6 Years Relevant Experience
We are seeking a highly skilled Big Data and Hadoop Ecosystems Developer with proven experience in building data-driven solutions using Hadoop, Spark, and Scala. The ideal candidate should have hands-on experience in data transformation, cloud platforms, and big data ecosystems, with a strong understanding of banking domain terminologies. If you're a proactive problem solver who thrives in complex environments, we’d love to hear from you.
Key Responsibilities:
- Develop and maintain scalable Big Data applications using Hadoop, Hive SQL, Spark, and related ecosystem tools.
- Create high-performance Scala/Spark jobs for data aggregation, transformation, and processing.
- Work with stream-processing systems such as Storm, Spark Streaming, or Flink.
- Optimize Hive queries and Spark jobs for performance enhancement.
- Participate in end-to-end development: environment setup, data connectivity, development, testing, deployment, and production support.
- Collaborate with cross-functional teams in a multi-reporting line organizational structure.
- Contribute to DevOps practices and follow Agile methodologies for iterative development and delivery.
- Occasionally act as the primary contact or project lead on small to medium-sized projects.
Required Skills & Experience:
- Hands-on experience with:
- Hadoop, Hive SQLs
- Apache Spark, Scala
- Big Data Ecosystem Tools
- Strong command of data warehousing principles and practices.
- Understanding of object-oriented programming and HDFS architecture.
- Experience with streaming technologies such as Storm, Spark Streaming, or Flink.
- Familiarity with DevOps tools and Agile development frameworks.
- Exposure to banking or financial services domain with relevant terminology and practices.
- Strong problem-solving skills, ability to work independently in ambiguous or dynamic environments.
Desirable Skills:
- Knowledge of cloud platforms, especially AWS or Azure.
- Experience in setting up and managing cloud-based big data infrastructure.
- Ability to quickly grasp new technologies and adapt to shifting priorities.
- Excellent communication and interpersonal skills for working in cross-functional, global teams.