Collabera
Data Engineer
Collabera, Reston, Virginia, United States, 22090
Description
HomeSearch JobsJob Description
Data Engineer
Contract: Reston, Virginia, US
Salary: $75.00 Per Hour
Job Code: 355112
End Date: 2024-11-20Days Left: 21 hours left
Apply
Position Details:
Industry: Health Insurance Industry
Job title: Sr. Data Engineer
Location: Reston, VA 20191 (Hybrid)
Duration: 12 months of Contract
Start date: ASAP
Job Description:The Senior Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged) with emphasis on reliability, automation and performance.This role will focus on developing solutions and helping transform the company's platforms deliver data-driven, meaningful insights and value to company.Essential Functions:
Work with Business Analysts and Product team to gather data requirementsDesign and Build AbInitio data graphs and data pipelines to extract the data various databases/flat files/message queuesTransform the data to create a consumable data layer for various application usesSupport Data pipeline with bug fixes, and additional enhancementsDocument Technical design , Operational Runbook etcQualifications:
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily.The requirements listed below are representative of the knowledge, skill, and/or ability required.Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.Education:
Education Level: Bachelor's DegreeEducation Details: Computer Science, Information Technology or Engineering or related fieldExperience:
Total of 10+ Years of IT Experience predominantly in Data Integration/ Data Warehouse areaMust have at least 5 years of ETL Design and Development experience using Ab Initio1-2 years of Data Integration project experience on Hadoop Platform, preferably ClouderaAbInitio CDC ( Change Data Capture ) experience in a Data Integration/ETL project setting is great to haveWorking knowledge of HDFS, Hive, Impala and other related Hadoop technologiesWorking knowledge in various AWS services is nice to haveSound understanding of SQL and ability to write well performing SQL queriesGood knowledge of OLTP and OLAP data models and other data warehouse fundamentalsRigor in high code quality, automated testing, and other engineering best practices, ability to write reusable code componentsAbility to unit test the code thoroughly and to troubleshoot issues in production environmentsMust have some working experience with Unix/Linux shell scriptingMust be able to work independently and support other junior developers as neededSome Java development experience is nice to haveKnowledge of Agile Development practices is requiredJob Requirement
Data integrationData warehouseHadoopClouderaETLHeathcareOLTPOLAPAWSUnixLinuxReach Out to a RecruiterRecruiterEmailPhoneSwarit Gujratiswarit.gujrati@collabera.com
Apply Now
HomeSearch JobsJob Description
Data Engineer
Contract: Reston, Virginia, US
Salary: $75.00 Per Hour
Job Code: 355112
End Date: 2024-11-20Days Left: 21 hours left
Apply
Position Details:
Industry: Health Insurance Industry
Job title: Sr. Data Engineer
Location: Reston, VA 20191 (Hybrid)
Duration: 12 months of Contract
Start date: ASAP
Job Description:The Senior Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged) with emphasis on reliability, automation and performance.This role will focus on developing solutions and helping transform the company's platforms deliver data-driven, meaningful insights and value to company.Essential Functions:
Work with Business Analysts and Product team to gather data requirementsDesign and Build AbInitio data graphs and data pipelines to extract the data various databases/flat files/message queuesTransform the data to create a consumable data layer for various application usesSupport Data pipeline with bug fixes, and additional enhancementsDocument Technical design , Operational Runbook etcQualifications:
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily.The requirements listed below are representative of the knowledge, skill, and/or ability required.Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.Education:
Education Level: Bachelor's DegreeEducation Details: Computer Science, Information Technology or Engineering or related fieldExperience:
Total of 10+ Years of IT Experience predominantly in Data Integration/ Data Warehouse areaMust have at least 5 years of ETL Design and Development experience using Ab Initio1-2 years of Data Integration project experience on Hadoop Platform, preferably ClouderaAbInitio CDC ( Change Data Capture ) experience in a Data Integration/ETL project setting is great to haveWorking knowledge of HDFS, Hive, Impala and other related Hadoop technologiesWorking knowledge in various AWS services is nice to haveSound understanding of SQL and ability to write well performing SQL queriesGood knowledge of OLTP and OLAP data models and other data warehouse fundamentalsRigor in high code quality, automated testing, and other engineering best practices, ability to write reusable code componentsAbility to unit test the code thoroughly and to troubleshoot issues in production environmentsMust have some working experience with Unix/Linux shell scriptingMust be able to work independently and support other junior developers as neededSome Java development experience is nice to haveKnowledge of Agile Development practices is requiredJob Requirement
Data integrationData warehouseHadoopClouderaETLHeathcareOLTPOLAPAWSUnixLinuxReach Out to a RecruiterRecruiterEmailPhoneSwarit Gujratiswarit.gujrati@collabera.com
Apply Now