Presidio Consulting
Presidio Consulting is hiring: Senior Data Integration and Data Quality Develope
Presidio Consulting, San Francisco, CA, US
Job Description
Job DescriptionCompany Description
We are looking for a Senior Data Integration and Data Quality Developer for a data migration project. The technology stack is Azure Data Factory (ADF) with a Snowflake backend, and Salesforce, Oracle, and Zuora data sources and targets.
Responsibilities
- Day to day development work involves
- Ingestion of data sources into Snowflake
- Defining and implementing data cleansing approaches
- Implementing transformation logic into ADF
- Loading data into target systems
- In depth profiling and evaluation of data sources using SQL and data profiling tools.
- Defining and implementing data source to target data mappings and transformation logic
- Working with business users to elicit mapping logic and identify conflicts across data sources and with target design.
- Work across data source and target owners to resolve conflicting logic.
- Evaluating data quality and establishing cleansing and monitoring approaches.
- Ensuring development priorities are aligned with business priorities and project roadmap
- Implementing efficient, performant, and cost effective ETL and Data Quality processes.
- Establishing and following consistent transformation and quality patterns.
Requirements
- Full lifecycle experience on at least one long term ADF project. Preference is for a data migration project, but similar batch-oriented data patterns such as ETL pipelines, data warehouse, etc. are acceptable.
- 2+ Years of hands on in-depth experience with Azure Data Factory
- 5+ years of experience with major ETL platforms. 5+ years of experience with Azure Data Factory is preferred, but 2+ with ADF and an additional 3+ with another vendor’s platform such as Informatica, SSIS, Talend, IBM DataStage, Pentaho, etc. is ok.
- In depth understanding of ETL best practices
- 5+ years of SQL development experience.
- Experience with an MPP data warehouse platform. Experience with Snowflake is preferred, but experience with Redshift, Netezza, Azure Data Warehouse, Vertica, etc. will suffice.
- Self-starter with strong communication skills. You will regularly be interfacing with business users and owners of source application and database systems.
- Strong analysis skills. You will be responsible for understanding business processes, analyzing data, and determining transformation and quality required for the target systems.
Bonus
- Experience with Salesforce data.
- In depth experience with Snowflake.
We are a consulting company providing Data Strategy Consulting. This is a long term contract or contract-to-hire at one of our clients, a globally recognized technology company.
Company Description
We are a consulting company providing Data Strategy Consulting. This is a long term contract or contract-to-hire at one of our clients, a globally recognized technology company.