Senior Data Engineer

Job Category: Senior Data Engineer
Job Type: Full Time

ETL Developer for the Compliance Analytics business unit. The selected candidate will be responsible for creating and managing ETL processes that load data from various sources into relational/non-relational targets including Hadoop. Also participating in design, development, testing, execution and quality assurance of both automated and manual data integration. Another aspect to this position is production support of 17 existing ETL processes. This is an exciting opportunity which will involve working closely with wide range of stakeholders across Compliance Org.

Responsibilities:

  • Design and develop enterprise ETL solutions using Informatica and Hadoop
  • Support existing applications in Informatica, SSIS and Hadoop (Hive, Spark)
  • Coordinate activities with data source application owners to ensure integration, data integrity and data quality
  • Translate requirements into ETL designs, mapping specifications, unit test scenarios and validations
  • Defining and converting Business rules into ETL processes
  • Create robust and high-performing ETL mappings using Informatica PowerCenter and other Informatica tools
  • Provide technical knowledge support to the business team
  • Implementing technology improvements to our Data integration environment
  • Contributing to technical and process flow documentation
  • Implement solutions in alignment with strategic vision
  • Knowledge/Experience with Data Centre Migrations

Skills:

  • Minimum of a Bachelor’s degree in Computer Science, Engineering, or equivalent
  • Minimum of 8 years of ETL and Hadoop development experience
  • Working knowledge of all Informatica Power Centre
  • Experience with Hadoop technologies (Hive, Spark) and SFTP’s (secure file transfers protocols)
  • Experience with optimization or performance tuning of ETL Jobs, SQL
  • Experience in developing Informatica ETL mappings to load data from different source systems into relational/non-relational targets
  • Developing and executing scripts on UNIX/Linux platforms
  • Experience of writing and executing Python scripts
  • Developing and executing Autosys JIL files
  • Proactively monitor jobs with good debugging skills
  • Experience with data modeling and associated tools
  • Experience in Database design, optimization and development
  • Experience with Agile environment
  • Interacting with business partners in the US

Experience:

  • A person who continually researches and stays ahead of what is latest and greatest out there
  • Experience with Continuous Integration tools like Jenkins, SVN/Bitbucket, Azure DevOps are important
  • Exposure to SQL DB, No SQL DB, Big Data is an advantage
  • Knowledge of Cloud technologies (AWS or Azure)
  • The candidate must have excellent verbal and written communication skills, and be able to work independently and in a team environment
  • Candidate must have the ability to manage multiple project tasks simultaneously while managing all maintenance and support tasks.
  • Experience with financial services applications preferred
  • Proven ability to turn complex design challenges into elegant solutions and understand the need to solve both business and user problems

Education:

  • Bachelor’s degree in computer science or related field;

Apply for this position

Allowed Type(s): .pdf, .doc, .docx