Exp: 6+ years
Must-Have :
- In-depth understanding of database structure for both dimensional as well transaction-based modelling including data mining
- Experience gathering and analysing Data requirements, design, development, and implementation of application components.
- Experience assessing data solutions for compliance and conformance with guidelines and policies
- Understanding of the use and maintenance of data dictionaries, data models, and data maps in an enterprise business software environment
- Design scalable and re-usable frameworks for ingesting large data sets and moving them from Bronze to silver and from Silver to Gold layer in databricks.
- Hands-on experience in query tuning, performance tuning, troubleshooting, and debugging Spark and/or other big data solutions
- Comfortable working on Spark programming in Python, Scala or Java
- Experience with Development Tools for CI/CD, Unit and Integration testing, Automation and Orchestration, REST API, BI tools and SQL Interfaces
- Working with event based / streaming technologies to ingest and process data
- Experience or exposure with data visualization tools (e.g. PowerBI and R)
- Knowledge of data mining and segmentation techniques