Dice
Data Platform Engineer
Dice, Little Ferry, New Jersey, us, 07643
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Mindsource Inc, is seeking the following. Apply via Dice today!
Data Platform Engineer
Location: 100% remote
Duration: Quarterly extensions, based on performance and budget
Start Date: 05/13/2024
Estimated End Date: 06/28/2024
Must have:
AWS experience with kubernetes operating knowledge.Working with data pipelines and experience with Spark and FlinkExcellent communication skills
Nice to have:
Programming experience in Scala, Java and Python
Knowledge on Machine Learning (Client)
Job description:
Client seeks to improve products by using data as the voice of our customers. We are looking for engineers to collaborate with users of our infrastructure and architect new pipelines to improve the user onboarding experience. As part of this group, you will work with petabytes of data daily using diverse technologies like Spark, Flink, Kafka, Hadoop and others. You will be expected to effectively partner with upstream engineering teams and downstream analytical & product consumers.
Experience:
10+ YOE, with 5+ years of experience designing and implementing batch or real-time data pipelinesHands-on experience on batch processing (Spark, Presto, Hive) or streaming (Flink, Beam, Spark Streaming)Experience in AWS and knowledge in its ecosystem. Experience in scaling and operating kubernetes.Excellent communication skills is a must, experience working with customers directly to explain how they would use the infrastructure to build complex data pipelinesProven ability to work in an agile environment, flexible to adapt to changesAble to work independently, research on possible solutions to unblock customerProgramming experience in Scala, Java, or PythonFast learner and experience with other common big data open source technologies is a big plusKnowledge on machine learning (Client) is a nice-to-have
Company informationDice’s tech-focused career marketplace enables direct, meaningful connections between recruiters and technologists. Our connection tools, unrivaled matching capabilities, and branding opportunities speed up the vetting process, reduce time-to-hire and establish trust, making it easy to build a talent pipeline for current and future roles.We empower you with:- Real-time connections via instant messaging. Connect with job applicants and target profiles in TalentSearch to immediately reach the most suitable tech candidates.- Powerful tools including branded company pages, targeted marketing efforts, and a recruiter profile to detail your corporate and hiring philosophy, areas of strength in tech, status updates, upcoming events, and additional hiring needs.- The most complete technologist information to assist in sourcing, featuring the most detailed candidate profiles with an overview of skills, experiences, titles and preferences.- Best-in-class AI, personalized to your company and hiring requirements, designed to filter candidates to deliver the best matches.- More transparency in your interactions with our user-friendly layout, which enables you to quickly understand a technologist’s experience and goals, while also sharing your background and building credibility with your recruiter profile.Digital Marketing, Employment, Recruiting, Information Services, Software, Information Technology, Financial Services, Marketing, Mobile, Professional ServicesPublic CompanyFounded: 1990Company Specialties:Technology and engineering recruitment solutions, Employment, Hiring, Job search, Postings, Resume Search, Open Web, Social Recruiting, Recruitment, Technical Recruiting, Talent Pipeline Management, Career Management, and Sourcing
#J-18808-Ljbffr
Data Platform Engineer
Location: 100% remote
Duration: Quarterly extensions, based on performance and budget
Start Date: 05/13/2024
Estimated End Date: 06/28/2024
Must have:
AWS experience with kubernetes operating knowledge.Working with data pipelines and experience with Spark and FlinkExcellent communication skills
Nice to have:
Programming experience in Scala, Java and Python
Knowledge on Machine Learning (Client)
Job description:
Client seeks to improve products by using data as the voice of our customers. We are looking for engineers to collaborate with users of our infrastructure and architect new pipelines to improve the user onboarding experience. As part of this group, you will work with petabytes of data daily using diverse technologies like Spark, Flink, Kafka, Hadoop and others. You will be expected to effectively partner with upstream engineering teams and downstream analytical & product consumers.
Experience:
10+ YOE, with 5+ years of experience designing and implementing batch or real-time data pipelinesHands-on experience on batch processing (Spark, Presto, Hive) or streaming (Flink, Beam, Spark Streaming)Experience in AWS and knowledge in its ecosystem. Experience in scaling and operating kubernetes.Excellent communication skills is a must, experience working with customers directly to explain how they would use the infrastructure to build complex data pipelinesProven ability to work in an agile environment, flexible to adapt to changesAble to work independently, research on possible solutions to unblock customerProgramming experience in Scala, Java, or PythonFast learner and experience with other common big data open source technologies is a big plusKnowledge on machine learning (Client) is a nice-to-have
Company informationDice’s tech-focused career marketplace enables direct, meaningful connections between recruiters and technologists. Our connection tools, unrivaled matching capabilities, and branding opportunities speed up the vetting process, reduce time-to-hire and establish trust, making it easy to build a talent pipeline for current and future roles.We empower you with:- Real-time connections via instant messaging. Connect with job applicants and target profiles in TalentSearch to immediately reach the most suitable tech candidates.- Powerful tools including branded company pages, targeted marketing efforts, and a recruiter profile to detail your corporate and hiring philosophy, areas of strength in tech, status updates, upcoming events, and additional hiring needs.- The most complete technologist information to assist in sourcing, featuring the most detailed candidate profiles with an overview of skills, experiences, titles and preferences.- Best-in-class AI, personalized to your company and hiring requirements, designed to filter candidates to deliver the best matches.- More transparency in your interactions with our user-friendly layout, which enables you to quickly understand a technologist’s experience and goals, while also sharing your background and building credibility with your recruiter profile.Digital Marketing, Employment, Recruiting, Information Services, Software, Information Technology, Financial Services, Marketing, Mobile, Professional ServicesPublic CompanyFounded: 1990Company Specialties:Technology and engineering recruitment solutions, Employment, Hiring, Job search, Postings, Resume Search, Open Web, Social Recruiting, Recruitment, Technical Recruiting, Talent Pipeline Management, Career Management, and Sourcing
#J-18808-Ljbffr