8+ Years Relevant Experience
We are looking for a seasoned Big Data Developer with strong hands-on experience in Hadoop ecosystems, Python, HDFS, Hive, and associated big data tools. The ideal candidate will have a solid background in data warehousing environments, excellent problem-solving capabilities, and strong SQL and scripting skills. If you are a self-motivated individual who thrives in fast-paced, data-intensive projects, we want to hear from you.
Key Responsibilities:
- Develop and maintain robust data pipelines using tools such as Python, Hive, Sqoop, NiFi, and Airflow.
- Perform in-depth troubleshooting and performance optimization across the Hadoop ecosystem.
- Collaborate with data analysts, engineers, and business users to understand requirements and translate them into technical solutions.
- Work in Data Warehouse (DWH) environments with large-scale datasets and data integration workflows.
- Design and implement data ingestion, cleansing, transformation, and loading processes.
- Contribute to requirements gathering, technical analysis, and documentation.
- Write efficient SQL queries, Shell scripts, and manage HDFS data storage and retrieval.
Required Skills & Experience:
- 8+ years of hands-on experience in Big Data development and Hadoop ecosystems.
- Proficiency with:
- Python, HDFS, Hive, Sqoop, NiFi, Airflow
- Strong experience in SQL and Shell scripting.
- Solid understanding of Hadoop internals and distributed computing principles.
- Previous experience working in a Data Warehousing environment.
- Excellent problem-solving, communication, and multitasking skills.
- Ability to learn and adapt quickly through self-education and on-the-job experience.
Good to Have:
- Experience with PySpark, HBase, and Oracle databases.
- Exposure to cloud-based big data platforms (AWS, GCP, or Azure) is a plus.
Soft Skills:
- Strong analytical mindset and attention to detail.
- Ability to work both independently and collaboratively in cross-functional teams.
- Effective time management and organizational skills.