Ciber
Data Engineer GCP
Ciber, Allen Park, Michigan, United States, 48102
HTC Global Services wants you. Come build new things with us and advance your career. At HTC Global you'll collaborate with experts. You'll join successful teams contributing to our clients' success. You'll work side by side with our clients and have long-term opportunities to advance your career with the latest emerging technologies.
At HTC Global Services our consultants have access to a comprehensive benefits package. Benefits can include Paid-Time-Off, Paid Holidays, 401K matching, Life and Accidental Death Insurance, Short & Long Term Disability Insurance, and a variety of other perks.
Job Description:
Materials Management Platform (MMP) is a multi-year transformation initiative aimed at transforming Materials Requirement Planning & Inventory Management capabilities. This is part of a larger Industrial Systems IT Transformation effort. This position responsibility is to design & deploy Data Centric Architecture in GCP for Materials Management platform which would get / give data from multiple applications modern & Legacy in Product Development, Manufacturing, Finance, Purchasing, N-Tier Supply Chain, Supplier Collaboration
Skills Required:
Design and implement data-centric solutions on Google Cloud Platform (GCP) using various GCP tools like Big Query, Google Cloud Storage, Cloud SQL, Memory Store, Dataflow, Dataproc, Artifact Registry, Cloud Build, Cloud Run, Vertex AI, Pub/Sub, GCP APIs.Build ETL pipelines to ingest the data from heterogeneous sources into our systemDevelop data processing pipelines using programming languages like Java and Python to extract, transform, and load (ETL) dataCreate and maintain data models, ensuring efficient storage, retrieval, and analysis of large datasetsDeploy and manage databases, both SQL and NoSQL, such as Bigtable, Firestore, or Cloud SQL, based on project requirementsOptimize data workflows for performance, reliability, and cost-effectiveness on the GCP infrastructure.Implement version control and CI/CD practices for data engineering workflows to ensure reliable and efficient deployments.Utilize GCP monitoring and logging tools to proactively identify and address performance bottlenecks and system failuresTroubleshoot and resolve issues related to data processing, storage, and retrieval.Promptly address code quality issues using SonarQube, Checkmarx, Fossa, and Cycode throughout the development lifecycleImplement security measures and data governance policies to ensure the integrity and confidentiality of dataCollaborate with stakeholders to gather and define data requirements, ensuring alignment with business objectives.Develop and maintain documentation for data engineering processes, ensuring knowledge transfer and ease of system maintenance.Participate in on-call rotations to address critical issues and ensure the reliability of data engineering systems.Provide mentorship and guidance to junior team members, fostering a collaborative and knowledge-sharing environment.Experience Required:
8 years of professional experience in: o Data engineering, data product development and software product launches o At least three of the following languages: Java, Python, Spark, Scala, SQL and experience performance tuning.4 years of cloud data/software engineering experience building scalable, reliable, and cost-effective production batch and streaming data pipelines using:
Data warehouses like Google BigQuery.Workflow orchestration tools like Airflow.Relational Database Management System like MySQL, PostgreSQL, and SQL Server.Real-Time data streaming platform like Apache Kafka, GCP Pub/Sub o Microservices architecture to deliver large-scale real-time data processing application.REST APIs for compute, storage, operations, and security.DevOps tools such as Tekton, GitHub Actions, Git, GitHub, Terraform, Docker.Project management tools like Atlassian JIRA
Automotive experience is preferredSupport in an onshore/offshore model is preferredExcellent at problem solving and prevention.Knowledge and practical experience of agile deliveryExperience Preferred:
Experience in IDOC processing, APIs and SAP data migration projects.Experience working in SAP S4 Hana environmentEducation Required:
Requires a bachelor's or foreign equivalent degree in computer science, information technology or a technology related fieldEducation Preferred:
Master's preferred.
Our success as a company is built on practicing inclusion and embracing diversity. HTC Global Services is committed to providing a work environment free from discrimination and harassment, where all employees are treated with respect and dignity. Together we work to create and maintain an environment where everyone feels valued, included, and respected. At HTC Global Services, our differences are embraced and celebrated. HTC is an Equal Opportunity Employer. We respect and seek to empower each individual and support the diverse cultures, perspectives, skills, and experiences within our workforce. HTC is proud to be recognized as a National Minority Supplier.
At HTC Global Services our consultants have access to a comprehensive benefits package. Benefits can include Paid-Time-Off, Paid Holidays, 401K matching, Life and Accidental Death Insurance, Short & Long Term Disability Insurance, and a variety of other perks.
Job Description:
Materials Management Platform (MMP) is a multi-year transformation initiative aimed at transforming Materials Requirement Planning & Inventory Management capabilities. This is part of a larger Industrial Systems IT Transformation effort. This position responsibility is to design & deploy Data Centric Architecture in GCP for Materials Management platform which would get / give data from multiple applications modern & Legacy in Product Development, Manufacturing, Finance, Purchasing, N-Tier Supply Chain, Supplier Collaboration
Skills Required:
Design and implement data-centric solutions on Google Cloud Platform (GCP) using various GCP tools like Big Query, Google Cloud Storage, Cloud SQL, Memory Store, Dataflow, Dataproc, Artifact Registry, Cloud Build, Cloud Run, Vertex AI, Pub/Sub, GCP APIs.Build ETL pipelines to ingest the data from heterogeneous sources into our systemDevelop data processing pipelines using programming languages like Java and Python to extract, transform, and load (ETL) dataCreate and maintain data models, ensuring efficient storage, retrieval, and analysis of large datasetsDeploy and manage databases, both SQL and NoSQL, such as Bigtable, Firestore, or Cloud SQL, based on project requirementsOptimize data workflows for performance, reliability, and cost-effectiveness on the GCP infrastructure.Implement version control and CI/CD practices for data engineering workflows to ensure reliable and efficient deployments.Utilize GCP monitoring and logging tools to proactively identify and address performance bottlenecks and system failuresTroubleshoot and resolve issues related to data processing, storage, and retrieval.Promptly address code quality issues using SonarQube, Checkmarx, Fossa, and Cycode throughout the development lifecycleImplement security measures and data governance policies to ensure the integrity and confidentiality of dataCollaborate with stakeholders to gather and define data requirements, ensuring alignment with business objectives.Develop and maintain documentation for data engineering processes, ensuring knowledge transfer and ease of system maintenance.Participate in on-call rotations to address critical issues and ensure the reliability of data engineering systems.Provide mentorship and guidance to junior team members, fostering a collaborative and knowledge-sharing environment.Experience Required:
8 years of professional experience in: o Data engineering, data product development and software product launches o At least three of the following languages: Java, Python, Spark, Scala, SQL and experience performance tuning.4 years of cloud data/software engineering experience building scalable, reliable, and cost-effective production batch and streaming data pipelines using:
Data warehouses like Google BigQuery.Workflow orchestration tools like Airflow.Relational Database Management System like MySQL, PostgreSQL, and SQL Server.Real-Time data streaming platform like Apache Kafka, GCP Pub/Sub o Microservices architecture to deliver large-scale real-time data processing application.REST APIs for compute, storage, operations, and security.DevOps tools such as Tekton, GitHub Actions, Git, GitHub, Terraform, Docker.Project management tools like Atlassian JIRA
Automotive experience is preferredSupport in an onshore/offshore model is preferredExcellent at problem solving and prevention.Knowledge and practical experience of agile deliveryExperience Preferred:
Experience in IDOC processing, APIs and SAP data migration projects.Experience working in SAP S4 Hana environmentEducation Required:
Requires a bachelor's or foreign equivalent degree in computer science, information technology or a technology related fieldEducation Preferred:
Master's preferred.
Our success as a company is built on practicing inclusion and embracing diversity. HTC Global Services is committed to providing a work environment free from discrimination and harassment, where all employees are treated with respect and dignity. Together we work to create and maintain an environment where everyone feels valued, included, and respected. At HTC Global Services, our differences are embraced and celebrated. HTC is an Equal Opportunity Employer. We respect and seek to empower each individual and support the diverse cultures, perspectives, skills, and experiences within our workforce. HTC is proud to be recognized as a National Minority Supplier.