Tekfortune Inc
Data Engineer
Tekfortune Inc, Dearborn, Michigan, United States, 48120
Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries. In this quickly changing economic landscape, virtual recruiting and remote work are critical for the future of work. To support the active project demands and skills gaps, our staffing experts can help you find the best job for you.
Data EngineerHybrid onsite; Dearborn MI12 month rolling contract
Project Scope:MMP - Materials Management Platform
Been there for 30 - 40 yearsModernizing the platform
High-Level Individual Duties:
Design and develop data solutions in GCPBuild ETL Pipelines for data ingestionMust-Haves (Concepts & Tools):
8 - 10 years IT Industry experienceGCP tools - Big Query, Google Cloud Storage, Cloud SQL, Memory Store, Dataflow, Dataproc, Pub/Sub, GCP APIs
Since the team is working with 300 - 400 data sources, different tools need to be utilized depending on the source/architecture. The more of these tools candidates have the better
Programming background in 3 of the following: Java, Python, Scala, Spark, SQLReal time streaming: Kafka, Pub/Sub, etc.What will win:•
Previous Ford experience
Position Description:Materials Management Platform (MMP) is a multi-year transformation initiative aimed at transforming Ford's Materials Requirement Planning & Inventory Management capabilities. This is part of a larger Industrial Systems IT Transformation effort. This position responsibility is to design & deploy Data Centric Architecture in GCP for Materials Management platform which would get / give data from multiple applications modern & Legacy in Product Development, Manufacturing, Finance, Purchasing, N-Tier Supply Chain, Supplier Collaboration
Skills Required:• Design and implement data-centric solutions on Google Cloud Platform (GCP) using various GCP tools like Big Query, Google Cloud Storage, Cloud SQL, Memory Store, Dataflow, Dataproc, Artifact Registry, Cloud Build, Cloud Run, Vertex AI, Pub/Sub, GCP APIs.• Build ETL pipelines to ingest the data from heterogeneous sources into our system• Develop data processing pipelines using programming languages like Java and Python to extract, transform, and load (ETL) data• Create and maintain data models, ensuring efficient storage, retrieval, and analysis of large datasets• Deploy and manage databases, both SQL and NoSQL, such as Bigtable, Firestore, or Cloud SQL, based on project requirements• Optimize data workflows for performance, reliability, and cost-effectiveness on the GCP infrastructure.• Implement version control and CI/CD practices for data engineering workflows to ensure reliable and efficient deployments.• Utilize GCP monitoring and logging tools to proactively identify and address performance bottlenecks and system failures• Troubleshoot and resolve issues related to data processing, storage, and retrieval.• Promptly address code quality issues using SonarQube, Checkmarx, Fossa, and Cycode throughout the development lifecycle• Implement security measures and data governance policies to ensure the integrity and confidentiality of data• Collaborate with stakeholders to gather and define data requirements, ensuring alignment with business objectives.• Develop and maintain documentation for data engineering processes, ensuring knowledge transfer and ease of system maintenance.• Participate in on-call rotations to address critical issues and ensure the reliability of data engineering systems.• Provide mentorship and guidance to junior team members, fostering a collaborative and knowledge-sharing environment.
Experience Required:• 8 years of professional experience in: o Data engineering, data product development and software product launcheso At least three of the following languages: Java, Python, Spark, Scala, SQL and experience performance tuning.• 4 years of cloud data/software engineering experience building scalable, reliable, and cost-effective production batch and streaming data pipelines using:o Data warehouses like Google BigQuery.o Workflow orchestration tools like Airflow.o Relational Database Management System like MySQL, PostgreSQL, and SQL Server.o Real-Time data streaming platform like Apache Kafka, GCP Pub/Subo Microservices architecture to deliver large-scale real-time data processing application.o REST APIs for compute, storage, operations, and security.o DevOps tools such as Tekton, GitHub Actions, Git, GitHub, Terraform, Docker.o Project management tools like Atlassian JIRA• Automotive experience is preferred• Support in an onshore/offshore model is preferred• Excellent at problem solving and prevention.• Knowledge and practical experience of agile delivery
Experience Preferred:• Experience in IDOC processing, APIs and SAP data migration projects.• Experience working in SAP S4 Hana environment
Education Required:• Requires a bachelor's or foreign equivalent degree in computer science, information technology or a technology related field
Education Preferred:Master's preferred
Additional Information :
GCP Certification preferredFord Experience preferredHybrid with up to 4 days a week on site.
For more information and other jobs available please contact our recruitment team at careers@tekfortune.com . To view all the jobs available in the USA and Asia please visit our website at https://www.tekfortune.com/careers/ .
Data EngineerHybrid onsite; Dearborn MI12 month rolling contract
Project Scope:MMP - Materials Management Platform
Been there for 30 - 40 yearsModernizing the platform
High-Level Individual Duties:
Design and develop data solutions in GCPBuild ETL Pipelines for data ingestionMust-Haves (Concepts & Tools):
8 - 10 years IT Industry experienceGCP tools - Big Query, Google Cloud Storage, Cloud SQL, Memory Store, Dataflow, Dataproc, Pub/Sub, GCP APIs
Since the team is working with 300 - 400 data sources, different tools need to be utilized depending on the source/architecture. The more of these tools candidates have the better
Programming background in 3 of the following: Java, Python, Scala, Spark, SQLReal time streaming: Kafka, Pub/Sub, etc.What will win:•
Previous Ford experience
Position Description:Materials Management Platform (MMP) is a multi-year transformation initiative aimed at transforming Ford's Materials Requirement Planning & Inventory Management capabilities. This is part of a larger Industrial Systems IT Transformation effort. This position responsibility is to design & deploy Data Centric Architecture in GCP for Materials Management platform which would get / give data from multiple applications modern & Legacy in Product Development, Manufacturing, Finance, Purchasing, N-Tier Supply Chain, Supplier Collaboration
Skills Required:• Design and implement data-centric solutions on Google Cloud Platform (GCP) using various GCP tools like Big Query, Google Cloud Storage, Cloud SQL, Memory Store, Dataflow, Dataproc, Artifact Registry, Cloud Build, Cloud Run, Vertex AI, Pub/Sub, GCP APIs.• Build ETL pipelines to ingest the data from heterogeneous sources into our system• Develop data processing pipelines using programming languages like Java and Python to extract, transform, and load (ETL) data• Create and maintain data models, ensuring efficient storage, retrieval, and analysis of large datasets• Deploy and manage databases, both SQL and NoSQL, such as Bigtable, Firestore, or Cloud SQL, based on project requirements• Optimize data workflows for performance, reliability, and cost-effectiveness on the GCP infrastructure.• Implement version control and CI/CD practices for data engineering workflows to ensure reliable and efficient deployments.• Utilize GCP monitoring and logging tools to proactively identify and address performance bottlenecks and system failures• Troubleshoot and resolve issues related to data processing, storage, and retrieval.• Promptly address code quality issues using SonarQube, Checkmarx, Fossa, and Cycode throughout the development lifecycle• Implement security measures and data governance policies to ensure the integrity and confidentiality of data• Collaborate with stakeholders to gather and define data requirements, ensuring alignment with business objectives.• Develop and maintain documentation for data engineering processes, ensuring knowledge transfer and ease of system maintenance.• Participate in on-call rotations to address critical issues and ensure the reliability of data engineering systems.• Provide mentorship and guidance to junior team members, fostering a collaborative and knowledge-sharing environment.
Experience Required:• 8 years of professional experience in: o Data engineering, data product development and software product launcheso At least three of the following languages: Java, Python, Spark, Scala, SQL and experience performance tuning.• 4 years of cloud data/software engineering experience building scalable, reliable, and cost-effective production batch and streaming data pipelines using:o Data warehouses like Google BigQuery.o Workflow orchestration tools like Airflow.o Relational Database Management System like MySQL, PostgreSQL, and SQL Server.o Real-Time data streaming platform like Apache Kafka, GCP Pub/Subo Microservices architecture to deliver large-scale real-time data processing application.o REST APIs for compute, storage, operations, and security.o DevOps tools such as Tekton, GitHub Actions, Git, GitHub, Terraform, Docker.o Project management tools like Atlassian JIRA• Automotive experience is preferred• Support in an onshore/offshore model is preferred• Excellent at problem solving and prevention.• Knowledge and practical experience of agile delivery
Experience Preferred:• Experience in IDOC processing, APIs and SAP data migration projects.• Experience working in SAP S4 Hana environment
Education Required:• Requires a bachelor's or foreign equivalent degree in computer science, information technology or a technology related field
Education Preferred:Master's preferred
Additional Information :
GCP Certification preferredFord Experience preferredHybrid with up to 4 days a week on site.
For more information and other jobs available please contact our recruitment team at careers@tekfortune.com . To view all the jobs available in the USA and Asia please visit our website at https://www.tekfortune.com/careers/ .