ODA Senior Data Engineer

Job title: ODA Senior Data Engineer Location: Remote- Brooklyn, NY Duration: 1 Year Job Description: Client's Office of Data Analytics (ODA) works with agencies and their data to help serve New Yorkers more equitably and effectively. This work takes three main forms: analyzing data to improve agency operations; making Open Data more accessible to all New Yorkers; and advancing citywide data infrastructure, integration, and sharing. ODA seeks a Data Engineer role to ensure the efficient and successful implementation and support of complex data engineering solutions for agencies. This resource should demonstrate a solid understanding of industry-standard implementation methodologies using data engineering technologies, tools, and processes. TASKS: Create and maintain optimal data pipeline architecture that is coherent and scalable, based on best practices of integrating data into a consolidated repository. Perform the technical design, development, and component testing of repository changes. Build analytics tools that utilize the data pipeline to provide actionable insights into customer engagement and experience, operational efficiency, and other key business performance metrics. Build the infrastructure required for optimal extraction, transformation, and loading (ETL) of data from a wide variety of data sources using SQL, cloud, and 'big data' technologies. Develop ETLs to move data securely from source to target systems. Create, update, and maintain system documentation. Develop new or build against existing APIs for data access or landing data as output for further downstream consumption in the appropriate target data store. Perform special projects and initiatives as assigned. MANDATORY SKILLS/EXPERIENCE Note: Candidates who do not have the mandatory skills will not be considered t least 8 years of experience in writing SQL. minimum of 8 years of experience in copying, transferring, manipulating, and automating data operations that were manual processes. Experience with tools and components of data architecture such as Informatica Power Center, IICS, SSIS, or similar ETL tools. Experience working with Amazon Web Services or Microsoft Azure cloud computing platform and services. In-depth knowledge of SQL and other database solutions. Experience with data warehousing (Snowflake, Redshift etc.). Knowledge of modeling database schemas for large datasets. Experience developing cloud-ready applications. Experience working with programming languages like Python, Java, and Perl DESIRABLE SKILLS/EXPERIENCE: Hands on experience developing Microsoft PowerBI solutions. 5 years hands-on experience in development with the suite of tools from Informatica PowerCenter and B2B Data Transformation. Experience using Oracle 10g/11g, SQL Server and/or a database appliance. Knowledge of metadata-driven enterprise reporting platforms.