SysMind Tech
GCP Data Engineer
SysMind Tech, Dearborn, Michigan, United States, 48120
Role: GCP Data Engineer
Location: Dearborn, MI (Remote)
Long Term Contract - W2
Position Description: Data Engineers will be responsible for designing the transformation and modernization of big data solutions on GCP cloud integrating native GCP services and 3rd party data technologies Experience with large scale solutioning and operationalization of data warehouses, data lakes and analytics platforms on GCP is a must. Looking for candidates who have a broad set of technology skills across these areas and who can demonstrate an ability to design right solutions with appropriate combination of GCP and 3rd party technologies for deploying on GCP cloud. Work as part of an implementation team from concept to operations, providing deep technical subject matter expertise for successfully deployment of Data Platform Implement methods for automation of all parts of the pipeline to minimize labor in development and production. Identify, develop, evaluate and summarize Proof of Concepts to prove out solutions Test and compare competing solutions and report out a point of view on the best solution Design and build production data engineering solutions to deliver our pipeline patterns using Google Cloud Platform (GCP) services: Skills Required:
Tools and Technologies:
Google Cloud Platform Data Flow, Cloud Run, Big Query, Pub/Sub, Cloud Logging and cloud Monitoring etc. Infrastructure as code: Terraform / GitHub ELT Framework: DBT Orchestrator/ Schedule: Astronomer/Airflow Programming Language/ Scripting Java/ python, Shell scripting IDE: VS code/ Eclipse etc. Agile Software: Rally Java,Spring boot, PCF Experience Required:
Google Cloud Platform (GCP) Certification preferred. 4+ years of Software Engineering experience developing applications w/Java and Python 3+ years of GCP experience 5 yrs. of data engineering pipelines/ building data warehouse systems with ability to understand ETL principles and write complex sql queries. 3 years of GCP experience working in GCP based Big Data deployments (Batch/Real-Time) leveraging Big Query, Big Table, Google Cloud Storage, Pub Sub, Data Fusion, Dataflow, Dataproc, etc. 1 Year experience of deploying google cloud services using Terraform 1 Yr. or more experience in ELT framework DBT
Best Regards,
Bishnu Upadhyay
IT Recruiter | SysMind, LLC
Desk: 609-897-9670 Ext. 2216
Direct/SMS: 203-864-9695
Email: BishnuK@sysmind.com
Website: www.sysmind.com
Address: 400 Alexander Park Dr., Suite 103, Princeton, NJ 08540
LinkedIn: https://www.linkedin.com/in/bishnu-upadhyay-1b7a44193/
Location: Dearborn, MI (Remote)
Long Term Contract - W2
Position Description: Data Engineers will be responsible for designing the transformation and modernization of big data solutions on GCP cloud integrating native GCP services and 3rd party data technologies Experience with large scale solutioning and operationalization of data warehouses, data lakes and analytics platforms on GCP is a must. Looking for candidates who have a broad set of technology skills across these areas and who can demonstrate an ability to design right solutions with appropriate combination of GCP and 3rd party technologies for deploying on GCP cloud. Work as part of an implementation team from concept to operations, providing deep technical subject matter expertise for successfully deployment of Data Platform Implement methods for automation of all parts of the pipeline to minimize labor in development and production. Identify, develop, evaluate and summarize Proof of Concepts to prove out solutions Test and compare competing solutions and report out a point of view on the best solution Design and build production data engineering solutions to deliver our pipeline patterns using Google Cloud Platform (GCP) services: Skills Required:
Tools and Technologies:
Google Cloud Platform Data Flow, Cloud Run, Big Query, Pub/Sub, Cloud Logging and cloud Monitoring etc. Infrastructure as code: Terraform / GitHub ELT Framework: DBT Orchestrator/ Schedule: Astronomer/Airflow Programming Language/ Scripting Java/ python, Shell scripting IDE: VS code/ Eclipse etc. Agile Software: Rally Java,Spring boot, PCF Experience Required:
Google Cloud Platform (GCP) Certification preferred. 4+ years of Software Engineering experience developing applications w/Java and Python 3+ years of GCP experience 5 yrs. of data engineering pipelines/ building data warehouse systems with ability to understand ETL principles and write complex sql queries. 3 years of GCP experience working in GCP based Big Data deployments (Batch/Real-Time) leveraging Big Query, Big Table, Google Cloud Storage, Pub Sub, Data Fusion, Dataflow, Dataproc, etc. 1 Year experience of deploying google cloud services using Terraform 1 Yr. or more experience in ELT framework DBT
Best Regards,
Bishnu Upadhyay
IT Recruiter | SysMind, LLC
Desk: 609-897-9670 Ext. 2216
Direct/SMS: 203-864-9695
Email: BishnuK@sysmind.com
Website: www.sysmind.com
Address: 400 Alexander Park Dr., Suite 103, Princeton, NJ 08540
LinkedIn: https://www.linkedin.com/in/bishnu-upadhyay-1b7a44193/