Diverse Lynx
Developer
Diverse Lynx, Malvern, Arkansas, United States, 72104
Job DetailsJob Title : AWS Data EngineerJob Location : Iselin, NJ(South) / Malvern, PA - OnsiteJob Type : ContractRole Description:
We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Your work will be to: Design and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics and reporting. Implement ETL/ELT Processes: Develop Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data Warehouses, Data Lakes, and Lake Houses using Open Source and AWS tools. Worked on DBT (Data Build Tool) to perform transformations on Snowflake data. Worked on Extracting, Transforming and Loading data into Snowflake. Created complex queries to pull data from multiple source tables and created testing scripts to verify the data quality accuracy in the target tables Adopt DevOps Practices: Utilize DevOps methodologies and tools for continuous integration and deployment (CI/CD), infrastructure as code (IaC), and automation to streamline and enhance our data engineering processes. Design Data Solutions: Leverage your analytical skills to design innovative data solutions that address complex business requirements and drive decision-makingCompetencies:
Digital : Amazon Web Service(AWS) Cloud Computing, Data Build Tool
Experience (Years):
6-8
Essential Skills:
WS concepts (S3, Lambda, Glue ETL, Cloud Watch).GCP concepts (Big Query, Vertex-AI, Cloud Storage, Composer, Pub/Sub)Python, Shell scripting, Spark, Jupiter Notebook. Programming Skills: Strong experience with modern programming languages such as Python, Java, and Scala.Desirable Skills:
Expertise in Data Storage Technologies: In-depth knowledge of Data Warehouse, Database technologies, and Big Data Eco-system technologies such as AWS Redshift, AWS RDS, and Hadoop. Experience with AWS Data Lakes: Proven experience working with AWS data lakes on AWS S3 to store and process both structured and unstructured data sets.
Keywords:
ETL, AWS Glue, AWS Lambda, Amazon Kinesis, Amazon EMR , Amazon Athena, Amazon DynamoDB, Amazon CloudWatch, Amazon SNS and AWS Step Functions
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Your work will be to: Design and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics and reporting. Implement ETL/ELT Processes: Develop Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data Warehouses, Data Lakes, and Lake Houses using Open Source and AWS tools. Worked on DBT (Data Build Tool) to perform transformations on Snowflake data. Worked on Extracting, Transforming and Loading data into Snowflake. Created complex queries to pull data from multiple source tables and created testing scripts to verify the data quality accuracy in the target tables Adopt DevOps Practices: Utilize DevOps methodologies and tools for continuous integration and deployment (CI/CD), infrastructure as code (IaC), and automation to streamline and enhance our data engineering processes. Design Data Solutions: Leverage your analytical skills to design innovative data solutions that address complex business requirements and drive decision-makingCompetencies:
Digital : Amazon Web Service(AWS) Cloud Computing, Data Build Tool
Experience (Years):
6-8
Essential Skills:
WS concepts (S3, Lambda, Glue ETL, Cloud Watch).GCP concepts (Big Query, Vertex-AI, Cloud Storage, Composer, Pub/Sub)Python, Shell scripting, Spark, Jupiter Notebook. Programming Skills: Strong experience with modern programming languages such as Python, Java, and Scala.Desirable Skills:
Expertise in Data Storage Technologies: In-depth knowledge of Data Warehouse, Database technologies, and Big Data Eco-system technologies such as AWS Redshift, AWS RDS, and Hadoop. Experience with AWS Data Lakes: Proven experience working with AWS data lakes on AWS S3 to store and process both structured and unstructured data sets.
Keywords:
ETL, AWS Glue, AWS Lambda, Amazon Kinesis, Amazon EMR , Amazon Athena, Amazon DynamoDB, Amazon CloudWatch, Amazon SNS and AWS Step Functions
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.