Logo
Damco Solutions

Data Engineer Lead

Damco Solutions, Dearborn, Michigan, United States, 48120


Position Description: The GDIA Data Factory Platform covers all business processes and technical components involved in ingesting a wide range of enterprise data into the GDIA Data Factory (Data Lake) and the transformation of that data into consumable data sets in support of analytics. The Data Factory Enablement Team, as the name suggests enables teams build their solutions in the GCP Data Factory Platform by proving Tools, Guidelines, processes and support. We are looking for candidates who have a broad set of technology skills across areas and come from a background of DevOps, with exposure to infrastructure and solution monitoring. This person will be expected to provide consultative services to the Software Development and Database Engineering teams. Key responsibilities include: Work as part of an implementation team from concept to operations, providing deep technical subject matter expertise for successfully deployment of Ford's Data Platform Implement methods for standardization of all parts of the pipeline to maximize data usability and consistency Test and compare competing solutions and report out a point of view on the best solution Design and Build CICD Pipelines for Google Cloud Platform (GCP) services: BigQuery,DataFlow,Pub/Sub, Data Fusion and others Work with stakeholders including Analytics, Product, and Design teams to assist with data related technical issues and support their data infrastructure needs Develop IAC tekton pipelines to execute pattern playbooks and templates Designing cloud performance and monitoring strategies Designing and implementing workflows to automate the infrastructure release and upgrade process for applications in Dev, UAT and Production environments Mentor and grow technical skills of engineers across multiple sprint teams by giving high quality feedback in design and code reviews and providing training for new methods, tools, and patterns Skills Required: Someone who understands Cloud as being a way to operate and not a place to host systems In-depth understanding of GCP product technology and underlying architectures. Experience and very strong with development eco-system such as Git, Jenkins, Terraform and Tekton for CI/CD Experience in working with Agile and Lean methodologies Experience Required: 1. At least 2 years of tekton experience 2. At least 5 years of Terraform experience or 3 years with terraform certification 3. At least 3 years of experience in Google cloud and Google cloud professional architect certification Education Preferred: MINIMUM BACHELORS in CS/IT Certifications: 1. HashiCorp Certified: Terraform Associate 2. Google Cloud Certified Associate Cloud Engineer 3. Google Cloud Certified NOTE: MUST HAVE SKILLS Google Cloud experience of 3 years. t least 2 years of Tekton. Experience with Terraform. Good Communication as this will be a Lead Role