10+ Years Relevant Experience
About the Role
We’re looking for a seasoned Data Architect with extensive experience in designing, developing, and managing large-scale data solutions. The ideal candidate will have a proven track record in building robust ETL pipelines, optimizing big data processing, and driving improvements in data quality and workflow efficiency.
Essential Skills
- 10+ years of hands-on experience in large-scale data architecture and solution design.
- Proven expertise in ETL pipeline design, development, and optimization.
- Strong background in data preprocessing and improving data quality.
- Experience processing large datasets (5B+ records) within Spark-Hadoop clusters.
- Experience automating data processing tasks for DAAS (Data-as-a-Service) projects to improve efficiency.
- Hands-on experience configuring file and client setups for smooth data integration and delivery.
- Proven ability to manage end-to-end data pipelines, reducing processing time and improving quality.
Desirable Skills
- Experience with HBase.
- Strong hands-on expertise with Apache Spark.
- Knowledge of NiFi for data flow automation.
- Prior Big Data Architect experience.