Logo
Presidio Consulting

Presidio Consulting is hiring: Senior Data Integration and Data Quality Develope

Presidio Consulting, San Francisco, CA, US


Job Description

Job Description

We are looking for a Senior Data Integration and Data Quality Developer for a data migration project. The technology stack is Azure Data Factory (ADF) with a Snowflake backend, and Salesforce, Oracle, and Zuora data sources and targets.

Responsibilities

  • Day to day development work involves
    • Ingestion of data sources into Snowflake
    • Defining and implementing data cleansing approaches  
    • Implementing transformation logic into ADF
    • Loading data into target systems
  • In depth profiling and evaluation of data sources using SQL and data profiling tools.
  • Defining and implementing data source to target data mappings and transformation logic
  • Working with business users to elicit mapping logic and identify conflicts across data sources and with target design.
  • Work across data source and target owners to resolve conflicting logic.
  • Evaluating data quality and establishing cleansing and monitoring approaches.
  • Ensuring development priorities are aligned with business priorities and project roadmap
  • Implementing efficient, performant, and cost effective ETL and Data Quality processes.
  • Establishing and following consistent transformation and quality patterns.

Requirements

  • Full lifecycle experience on at least one long term ADF project. Preference is for a data migration project, but similar batch-oriented data patterns such as ETL pipelines, data warehouse, etc. are acceptable.
  • 2+ Years of hands on in-depth experience with Azure Data Factory
  • 5+ years of experience with major ETL platforms. 5+ years of experience with Azure Data Factory is preferred, but 2+ with ADF and an additional 3+ with another vendor’s platform such as Informatica, SSIS, Talend, IBM DataStage, Pentaho, etc. is ok.
  • In depth understanding of ETL best practices
  • 5+ years of SQL development experience.
  • Experience with an MPP data warehouse platform. Experience with Snowflake is preferred, but experience with Redshift, Netezza, Azure Data Warehouse, Vertica, etc. will suffice.
  • Self-starter with strong communication skills. You will regularly be interfacing with business users and owners of source application and database systems.
  • Strong analysis skills. You will be responsible for understanding business processes, analyzing data, and determining transformation and quality required for the target systems.

Bonus

  • Experience with Salesforce data.
  • In depth experience with Snowflake.
Company Description
We are a consulting company providing Data Strategy Consulting. This is a long term contract or contract-to-hire at one of our clients, a globally recognized technology company.

Company Description

We are a consulting company providing Data Strategy Consulting. This is a long term contract or contract-to-hire at one of our clients, a globally recognized technology company.