IDR, Inc.
Data Engineer
IDR, Inc., Dallas, Texas, United States, 75215
IDR is seeking a
Data Engineer
to join one of our top clients in the North Dallas area.
If you are looking for an opportunity to join a large organization and work within an ever-growing, team-oriented culture, please apply today!Responsibilities For The Data Engineer
We are looking for a Data Engineer to help setup a new service our client is calling "Data as a Service." The Data Engineer will be working to get API data from different sources/vendors. They will use that along with internal data to start enriching and anonymizing the data. Then start prepping/transforming the data into a readable format (gold) for visualizations, and maintaining current data feeds using streaming practices.It is important that the Data Engineer has a good understanding of streaming, spark, and architecture concepts (following medallion architecture - bronze/silver/gold). They will be operating in AWS (S3) and potentially Azure (blob).Required Skills For The Data Engineer
Bachelor’s Degree Computer Science, Information Management, or related field; Masters preferred.7+ years relevant experience or 4+ years with MastersDatabricks experience building data pipelines and workflowsExperience working with Spark and Python/ScalaExperience as a sole contributor working on stand alone projectsWhat’s in it for you?
Competitive compensation packageFull Benefits; Medical, Vision, Dental, and more!Opportunity to get in with an industry leading organizationClose-knit and team-oriented cultureWhy IDR?
20+ Years of Proven Industry Experience in 4 major marketsEmployee Stock Ownership ProgramDedicated Engagement Manager who is committed to you and your successMedical, Dental, Vision, and Life InsuranceClearlyRated’s Best of Staffing Client and Talent Award winner 10 years in a row
#J-18808-Ljbffr
Data Engineer
to join one of our top clients in the North Dallas area.
If you are looking for an opportunity to join a large organization and work within an ever-growing, team-oriented culture, please apply today!Responsibilities For The Data Engineer
We are looking for a Data Engineer to help setup a new service our client is calling "Data as a Service." The Data Engineer will be working to get API data from different sources/vendors. They will use that along with internal data to start enriching and anonymizing the data. Then start prepping/transforming the data into a readable format (gold) for visualizations, and maintaining current data feeds using streaming practices.It is important that the Data Engineer has a good understanding of streaming, spark, and architecture concepts (following medallion architecture - bronze/silver/gold). They will be operating in AWS (S3) and potentially Azure (blob).Required Skills For The Data Engineer
Bachelor’s Degree Computer Science, Information Management, or related field; Masters preferred.7+ years relevant experience or 4+ years with MastersDatabricks experience building data pipelines and workflowsExperience working with Spark and Python/ScalaExperience as a sole contributor working on stand alone projectsWhat’s in it for you?
Competitive compensation packageFull Benefits; Medical, Vision, Dental, and more!Opportunity to get in with an industry leading organizationClose-knit and team-oriented cultureWhy IDR?
20+ Years of Proven Industry Experience in 4 major marketsEmployee Stock Ownership ProgramDedicated Engagement Manager who is committed to you and your successMedical, Dental, Vision, and Life InsuranceClearlyRated’s Best of Staffing Client and Talent Award winner 10 years in a row
#J-18808-Ljbffr