Experis
Lead Data engineer
Experis, Houston, Texas, United States, 77246
Job Title: Lead Data engineer
Location: Houston,TXonsiteFulltime (PERM)
As a Lead Data Engineer you will: 10 + yrs expDesign and implement scalable and reliable data pipelines to ingest, process, and store diverse data at scale, using technologies such as Apache Spark, Hadoop, and Kafka.Work within cloud environments like AWS or Azure to leverage services including but not limited to EC2, RDS, S3, Lambda, and Azure Data Lake for efficient data handling and processing.Develop and optimize data models and storage solutions (SQL, NoSQL, Data Lakes) to support operational and analytical applications, ensuring data quality and accessibility.Utilize ETL tools and frameworks (e.g., Apache Airflow, Talend) to automate data workflows, ensuring efficient data integration and timely availability of data for analytics.Collaborate closely with data scientists, providing the data infrastructure and tools needed for complex analytical models, leveraging Python or R for data processing scripts.Ensure compliance with data governance and security policies, implementing best practices in data encryption, masking, and access controls within a cloud environment.Monitor and troubleshoot data pipelines and databases for performance issues, applying tuning techniques to optimize data access and throughput.Stay abreast of emerging technologies and methodologies in data engineering, advocating for and implementing improvements to the data ecosystem.What We Need From You
Bachelor's Degree computer science, MIS, or other business discipline and 10+ years of experience in data engineering, with a proven track record in designing and operating large-scale data pipelines and architectures Req orMaster's Degree computer science, MIS, or other business discipline and 5+ years of experience in data engineering, with a proven track record in designing and operating large-scale data pipelines and architectures ReqExpertise in developing ETL/ELT workflowsComprehensive knowledge of platforms and services like Databricks, Dataiku, and AWS native data offeringsSolid experience with big data technologies (Apache Spark, Hadoop, Kafka) and cloud services (AWS, Azure) related to data processing and storageStrong experience in AWS and Azure cloud services, with hands-on experience in integrating cloud storage and compute services with DatabricksProficient in SQL and programming languages relevant to data engineering (Python, Java, Scala)Hands on RDBMS experience (data modeling, analysis, programming, stored procedures)Familiarity with machine learning model deployment and management practices is a plusStrong communication skills, capable of collaborating effectively across technical and non-technical teamsAWS Certified Solution Architect PreferredDatabricks Certified Associate Developer for Apache Spark PreferredAzure Data Engineer Associate Preferredor other relevant certifications. Preferred
If this is a role that interests you and you'd like to learn more, click apply now and a recruiter will be in touch with you to discuss this great opportunity. We look forward to speaking with you!
About ManpowerGroup, Parent Company of:
Manpower, Experis, Talent Solutions, and Jefferson Wells
ManpowerGroup® (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands -
Manpower, Experis, Talent Solutions, and Jefferson Wells
- creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2022 ManpowerGroup was named one of the World's Most Ethical Companies for the 13th year - all confirming our position as the brand of choice for in-demand talent.
Location: Houston,TXonsiteFulltime (PERM)
As a Lead Data Engineer you will: 10 + yrs expDesign and implement scalable and reliable data pipelines to ingest, process, and store diverse data at scale, using technologies such as Apache Spark, Hadoop, and Kafka.Work within cloud environments like AWS or Azure to leverage services including but not limited to EC2, RDS, S3, Lambda, and Azure Data Lake for efficient data handling and processing.Develop and optimize data models and storage solutions (SQL, NoSQL, Data Lakes) to support operational and analytical applications, ensuring data quality and accessibility.Utilize ETL tools and frameworks (e.g., Apache Airflow, Talend) to automate data workflows, ensuring efficient data integration and timely availability of data for analytics.Collaborate closely with data scientists, providing the data infrastructure and tools needed for complex analytical models, leveraging Python or R for data processing scripts.Ensure compliance with data governance and security policies, implementing best practices in data encryption, masking, and access controls within a cloud environment.Monitor and troubleshoot data pipelines and databases for performance issues, applying tuning techniques to optimize data access and throughput.Stay abreast of emerging technologies and methodologies in data engineering, advocating for and implementing improvements to the data ecosystem.What We Need From You
Bachelor's Degree computer science, MIS, or other business discipline and 10+ years of experience in data engineering, with a proven track record in designing and operating large-scale data pipelines and architectures Req orMaster's Degree computer science, MIS, or other business discipline and 5+ years of experience in data engineering, with a proven track record in designing and operating large-scale data pipelines and architectures ReqExpertise in developing ETL/ELT workflowsComprehensive knowledge of platforms and services like Databricks, Dataiku, and AWS native data offeringsSolid experience with big data technologies (Apache Spark, Hadoop, Kafka) and cloud services (AWS, Azure) related to data processing and storageStrong experience in AWS and Azure cloud services, with hands-on experience in integrating cloud storage and compute services with DatabricksProficient in SQL and programming languages relevant to data engineering (Python, Java, Scala)Hands on RDBMS experience (data modeling, analysis, programming, stored procedures)Familiarity with machine learning model deployment and management practices is a plusStrong communication skills, capable of collaborating effectively across technical and non-technical teamsAWS Certified Solution Architect PreferredDatabricks Certified Associate Developer for Apache Spark PreferredAzure Data Engineer Associate Preferredor other relevant certifications. Preferred
If this is a role that interests you and you'd like to learn more, click apply now and a recruiter will be in touch with you to discuss this great opportunity. We look forward to speaking with you!
About ManpowerGroup, Parent Company of:
Manpower, Experis, Talent Solutions, and Jefferson Wells
ManpowerGroup® (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands -
Manpower, Experis, Talent Solutions, and Jefferson Wells
- creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2022 ManpowerGroup was named one of the World's Most Ethical Companies for the 13th year - all confirming our position as the brand of choice for in-demand talent.