6+ Years Relevant Experience
Job Overview:
We are looking for a highly skilled Senior Data Engineer with over 6 years of relevant experience to design, develop, and maintain scalable data solutions. The ideal candidate will have a deep understanding of data modeling, ETL processes, and modern cloud data platforms, particularly with DBT, Snowflake, and Azure Data Factory (ADF).
Key Responsibilities:
- Design and develop robust DBT models, ADF pipelines, and write complex SQL/Snowflake queries.
- Troubleshoot and resolve day-to-day job failures to ensure seamless data flow and platform stability.
- Maintain data integrity, performance, scalability, and reliability of data platforms.
- Recommend and implement improvements for database and application performance optimization.
- Collaborate with cross-functional teams in a fast-paced, agile development environment.
Required Skills & Experience:
- Strong proficiency in SQL, with experience writing complex queries and optimizing for performance.
- Hands-on experience with Azure Data Factory (ADF) and Azure Storage (Blob, Tables, etc.).
- Solid understanding of ETL concepts and experience with cloud-based ETL tools.
- Proficiency in Snowflake data modeling, query optimization, and warehouse management.
- Experience with DBT model development and data transformation workflows.
Desirable Skills:
- Experience with SSIS or other ETL tools.
- Familiarity with Agile development methodologies and DevOps practices.
- Strong development/programming skills (e.g., Python or similar languages).
- Experience with CI/CD pipelines and test-driven development.
- Strong troubleshooting and debugging skills for advanced SQL.
- Deep working knowledge of Azure services and best practices for cloud-based data architecture.