Randstad
Big data hadoop/kafka engineer
Randstad, Plano, Texas, us, 75086
job summary:- 10+ years of total IT experience
- At least 5 years of experience developing for Data Warehousing, Data Marts, and/or Master Data Management
- Deep experience on Hadoop including Confluent Kafka, Python, Spark, HIVE, HBase and HDFS with an emphasis on strategic future forward architecture.
- Programming experience Python, PySpark, Spark SQL.
- Exposure to Relational Database Management Systems using Oracle, DB2 or SQL Server
- Possesses and demonstrates deep knowledge of the Hadoop Ecosystem
- Experienced exposure to Hadoop ecosystem including but not limited to: HDFS, Spark, Sqoop, Oozie, Kafka, Hive (Managed & Iceberg formats), Phoenix, HBase
- Object oriented programming concepts
- Expert SQL skills
- Experience in SDLC and best practices for development
- Ability to work against mid-level design documentation, take it to a low-level design, and deliver a solution that meets the success criteria
- Knowledge of packaging and promotion practices for maintaining code in development, test, and production
Desired Skills
- Experience with Trino
- Experience with Apache Flinklocation: Plano, Texasjob type: Contractsalary: $63.68 - 68.00 per hourwork hours: 8am to 5pmeducation: Bachelors
responsibilities:- Analyze current Hadoop based Master Data Management platform including orchestrations, workflows, transformations and help to design a scalable platform based on streaming data pipelines for structured and semi-structure big data.
- Ability to reengineer traditional database system and stored procedures using Big Data services.
- Expert experience in developing and implementing solutions using Confluent Kafka including connectors, Kafka Streams & KSQL
- Accomplished development experience using Spark and Spark SQL
- Expert level skills for evaluating, developing and performance tuning existing HIVE Managed Tables and PySpark implementation.
- Experience with shell scripting. (e.g. bash, Python, etc.)
- Apache Phoenix and HBase design, implementation and tuning.
- Ability to manage multiple priorities
qualifications:
Experience level: ExperiencedMinimum 10 years of experienceEducation: Bachelors
skills:
HadoopKafkaPythonETL
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.
Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).
This posting is open for thirty (30) days.
- At least 5 years of experience developing for Data Warehousing, Data Marts, and/or Master Data Management
- Deep experience on Hadoop including Confluent Kafka, Python, Spark, HIVE, HBase and HDFS with an emphasis on strategic future forward architecture.
- Programming experience Python, PySpark, Spark SQL.
- Exposure to Relational Database Management Systems using Oracle, DB2 or SQL Server
- Possesses and demonstrates deep knowledge of the Hadoop Ecosystem
- Experienced exposure to Hadoop ecosystem including but not limited to: HDFS, Spark, Sqoop, Oozie, Kafka, Hive (Managed & Iceberg formats), Phoenix, HBase
- Object oriented programming concepts
- Expert SQL skills
- Experience in SDLC and best practices for development
- Ability to work against mid-level design documentation, take it to a low-level design, and deliver a solution that meets the success criteria
- Knowledge of packaging and promotion practices for maintaining code in development, test, and production
Desired Skills
- Experience with Trino
- Experience with Apache Flinklocation: Plano, Texasjob type: Contractsalary: $63.68 - 68.00 per hourwork hours: 8am to 5pmeducation: Bachelors
responsibilities:- Analyze current Hadoop based Master Data Management platform including orchestrations, workflows, transformations and help to design a scalable platform based on streaming data pipelines for structured and semi-structure big data.
- Ability to reengineer traditional database system and stored procedures using Big Data services.
- Expert experience in developing and implementing solutions using Confluent Kafka including connectors, Kafka Streams & KSQL
- Accomplished development experience using Spark and Spark SQL
- Expert level skills for evaluating, developing and performance tuning existing HIVE Managed Tables and PySpark implementation.
- Experience with shell scripting. (e.g. bash, Python, etc.)
- Apache Phoenix and HBase design, implementation and tuning.
- Ability to manage multiple priorities
qualifications:
Experience level: ExperiencedMinimum 10 years of experienceEducation: Bachelors
skills:
HadoopKafkaPythonETL
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.
Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).
This posting is open for thirty (30) days.