IS3 Solutions
ODA Sr. Data Engineer
IS3 Solutions, Brooklyn, New York, United States, 11210
IS3 is looking for a Data Engineer to ensure the efficient and successful implementation and support of complex data engineering solutions for City agencies. This resource should demonstrate a solid understanding of industry-standard implementation methodologies using data engineering technologies, tools, and processes.
TASKS: Create and maintain optimal data pipeline architecture that is coherent and scalable, based on best practices of integrating data into a consolidated repository. Perform the technical design, development, and component testing of repository changes. Build analytics tools that utilize the data pipeline to provide actionable insights into customer engagement and experience, operational efficiency, and other key business performance metrics. Build the infrastructure required for optimal extraction, transformation, and loading (ETL) of data from a wide variety of data sources using SQL, cloud, and 'big data' technologies. Develop ETLs to move data securely from source to target systems. Create, update, and maintain system documentation. Develop new or build against existing APIs for data access or landing data as output for further downstream consumption in the appropriate target data store. Perform special projects and initiatives as assigned. SKILLS/EXPERIENCE:
t least 8 years of experience in writing SQL. minimum of 8 years of experience in copying, transferring, manipulating, and automating data operations that were manual processes. Experience with tools and components of data architecture such as Informatica Power Center, IICS, SSIS, or similar ETL tools. Experience working with Amazon Web Services or Microsoft Azure cloud computing platform and services. In-depth knowledge of SQL and other database solutions. Experience with data warehousing (Snowflake, Redshift etc.). Knowledge of modeling database schemas for large datasets. Experience developing cloud-ready applications. Experience working with programming languages like Python, Java, and Perl DESIRABLE SKILLS/EXPERIENCE:
Hands on experience developing Microsoft PowerBI solutions. 5+ years hands-on experience in development with the suite of tools from Informatica PowerCenter and B2B Data Transformation. Experience using Oracle 10g/11g, SQL Server and/or a database appliance. Knowledge of metadata-driven enterprise reporting platforms.
TASKS: Create and maintain optimal data pipeline architecture that is coherent and scalable, based on best practices of integrating data into a consolidated repository. Perform the technical design, development, and component testing of repository changes. Build analytics tools that utilize the data pipeline to provide actionable insights into customer engagement and experience, operational efficiency, and other key business performance metrics. Build the infrastructure required for optimal extraction, transformation, and loading (ETL) of data from a wide variety of data sources using SQL, cloud, and 'big data' technologies. Develop ETLs to move data securely from source to target systems. Create, update, and maintain system documentation. Develop new or build against existing APIs for data access or landing data as output for further downstream consumption in the appropriate target data store. Perform special projects and initiatives as assigned. SKILLS/EXPERIENCE:
t least 8 years of experience in writing SQL. minimum of 8 years of experience in copying, transferring, manipulating, and automating data operations that were manual processes. Experience with tools and components of data architecture such as Informatica Power Center, IICS, SSIS, or similar ETL tools. Experience working with Amazon Web Services or Microsoft Azure cloud computing platform and services. In-depth knowledge of SQL and other database solutions. Experience with data warehousing (Snowflake, Redshift etc.). Knowledge of modeling database schemas for large datasets. Experience developing cloud-ready applications. Experience working with programming languages like Python, Java, and Perl DESIRABLE SKILLS/EXPERIENCE:
Hands on experience developing Microsoft PowerBI solutions. 5+ years hands-on experience in development with the suite of tools from Informatica PowerCenter and B2B Data Transformation. Experience using Oracle 10g/11g, SQL Server and/or a database appliance. Knowledge of metadata-driven enterprise reporting platforms.