Symmetrio
Data Integration Specialist (Hybrid)
Symmetrio, Phila, Pennsylvania, United States, 19117
Symmetrio is actively recruiting for a Data Integration Specialist for our customer, a large government organization in Philadelphia, PA. As a Data Integration Specialist, you will play a crucial role in the seamless migration, integration, and management of large-scale data across Amazon S3 and Redshift environments. This role demands not only technical expertise but also an in-depth understanding of data architecture, data security, and integration strategies to ensure robust data infrastructure.
This is a full-time, hybrid position requiring on-site presence in Philadelphia 2 days per week.
Responsibilities
Design, develop, and deploy ETL/ELT data pipelines to facilitate the transfer of complex datasets into Amazon S3, using tools such as Azure Data Factory, optimized for performance, resilience, and scalabilityImplement automated workflows to streamline the continuous data migration process, ensuring that data ingestion and processing run smoothly with minimal manual interventionSet up and manage Amazon S3 buckets for optimized data storage solutions, and configure data schemas and tables within Amazon Redshift to accommodate evolving business needsMigrate cleaned and preprocessed data efficiently into Amazon S3 and Redshift, ensuring data consistency and integrity throughout the processProactively monitor data pipelines for performance, identifying potential bottlenecks or failures, and implementing solutions to maintain optimal data flowRegularly assess and refine data integration processes to enhance system efficiency and scalability, leveraging best practices in cloud and data engineeringMaintain meticulous documentation for all data integration processes and ensure all activities comply with data governance standards, security protocols, and company policiesRequirements
Minimum of 3 years of experience working as a Data Integration SpecialistProficiency with cloud platforms, particularly AWS (S3, Redshift, Lambda) and Azure Data FactoryStrong skills in SQL and experience with ETL toolsDemonstrated expertise in data security and integrity measures, including encryption and secure data transferExcellent problem-solving and analytical abilities for troubleshooting data integration challengesEffective communication and documentation skills, with the ability to clearly document technical processesPreferred experience with AWS Glue, Python, C#, and SparkSQLBenefits
Health Care Plan (Medical, Dental & Vision)Retirement Plan (401k, IRA)Paid Time Off (Vacation, Sick & Public Holidays)
This is a full-time, hybrid position requiring on-site presence in Philadelphia 2 days per week.
Responsibilities
Design, develop, and deploy ETL/ELT data pipelines to facilitate the transfer of complex datasets into Amazon S3, using tools such as Azure Data Factory, optimized for performance, resilience, and scalabilityImplement automated workflows to streamline the continuous data migration process, ensuring that data ingestion and processing run smoothly with minimal manual interventionSet up and manage Amazon S3 buckets for optimized data storage solutions, and configure data schemas and tables within Amazon Redshift to accommodate evolving business needsMigrate cleaned and preprocessed data efficiently into Amazon S3 and Redshift, ensuring data consistency and integrity throughout the processProactively monitor data pipelines for performance, identifying potential bottlenecks or failures, and implementing solutions to maintain optimal data flowRegularly assess and refine data integration processes to enhance system efficiency and scalability, leveraging best practices in cloud and data engineeringMaintain meticulous documentation for all data integration processes and ensure all activities comply with data governance standards, security protocols, and company policiesRequirements
Minimum of 3 years of experience working as a Data Integration SpecialistProficiency with cloud platforms, particularly AWS (S3, Redshift, Lambda) and Azure Data FactoryStrong skills in SQL and experience with ETL toolsDemonstrated expertise in data security and integrity measures, including encryption and secure data transferExcellent problem-solving and analytical abilities for troubleshooting data integration challengesEffective communication and documentation skills, with the ability to clearly document technical processesPreferred experience with AWS Glue, Python, C#, and SparkSQLBenefits
Health Care Plan (Medical, Dental & Vision)Retirement Plan (401k, IRA)Paid Time Off (Vacation, Sick & Public Holidays)