Collabera
Big data engineer
Collabera, Chicago, Illinois, United States, 60290
Description
HomeSearch JobsJob Description
Big data engineer
Contract: Chicago, Illinois, US
Salary: $68.00 Per Hour
Job Code: 353573
End Date: 2024-10-09Days Left: 15 days, 3 hours left
Apply
Position Details:
Title:
Big Data Engineer
Location:
Chicago, IL- Hybrid - 3x/week onsite
Compensation:
$65-$68.26/hour
Interview Process:
One Inperson round
Why open:
New project
Scope of role:
Experience with Kafka, Pyspark and real-time data processing, Elastic Search, Kibana (nice to have)
Project:
Dealing with streaming data
Expected to accomplish:Processing Data in Real-timeBuilding system from scratchDesigning abstract layersMust have:
Strong communication skillsKafkaPysparkReal time data processingSQLSparkCoding/ development in PythonNice to have:
Elastic SearchKibanaDesigning system from scratch/ designing abstract layersRequired Skills:
Strong SQL Skills - one or more of MySQL, HIVE, Impala, SPARK SQLData ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xmlExperience working with SPARK Structured steamingExperience working with Hadoop/Big Data and Distributed SystemsWorking experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc.Hands on programming experience in at least one of Scala, Python, PHP, or Shell Scripting, to name a fewPerformance tuning experience with spark /MapReduce or SQL jobsExperience and proficiency with Linux operating system is a mustExperience in end-to-end design and build process of Near-Real Time and Batch Data PipelinesExperience working in Agile development process and deep understanding of various phases of the Software Development Life CycleExperience using Source Code and Version Control systems like SVN, Git, Bit Bucket etc.Experience working with Jenkins and Jar managementSelf-starter who works with minimal supervision and the ability to work in a team of diverse skill setsAbility to comprehend customer requests and provide the correct solutionStrong analytical mind to help take on complicated problemsDesire to resolve issues and dive into potential issuesAbility to adapt and continue to learn new technologies is importantJob Requirement
PythonPysparkHadoopHadoop componentsReal time datareal time processingHiveBig dataMysqlsqlImpalaSparkHybrid in chicagoHybrid in denverGitBit bucketReach Out to a RecruiterRecruiterEmailPhoneKavin Nilavu Thatha Manji Sivananthankavin.nilavu@collabera.com9738595453
Apply Now
HomeSearch JobsJob Description
Big data engineer
Contract: Chicago, Illinois, US
Salary: $68.00 Per Hour
Job Code: 353573
End Date: 2024-10-09Days Left: 15 days, 3 hours left
Apply
Position Details:
Title:
Big Data Engineer
Location:
Chicago, IL- Hybrid - 3x/week onsite
Compensation:
$65-$68.26/hour
Interview Process:
One Inperson round
Why open:
New project
Scope of role:
Experience with Kafka, Pyspark and real-time data processing, Elastic Search, Kibana (nice to have)
Project:
Dealing with streaming data
Expected to accomplish:Processing Data in Real-timeBuilding system from scratchDesigning abstract layersMust have:
Strong communication skillsKafkaPysparkReal time data processingSQLSparkCoding/ development in PythonNice to have:
Elastic SearchKibanaDesigning system from scratch/ designing abstract layersRequired Skills:
Strong SQL Skills - one or more of MySQL, HIVE, Impala, SPARK SQLData ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xmlExperience working with SPARK Structured steamingExperience working with Hadoop/Big Data and Distributed SystemsWorking experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc.Hands on programming experience in at least one of Scala, Python, PHP, or Shell Scripting, to name a fewPerformance tuning experience with spark /MapReduce or SQL jobsExperience and proficiency with Linux operating system is a mustExperience in end-to-end design and build process of Near-Real Time and Batch Data PipelinesExperience working in Agile development process and deep understanding of various phases of the Software Development Life CycleExperience using Source Code and Version Control systems like SVN, Git, Bit Bucket etc.Experience working with Jenkins and Jar managementSelf-starter who works with minimal supervision and the ability to work in a team of diverse skill setsAbility to comprehend customer requests and provide the correct solutionStrong analytical mind to help take on complicated problemsDesire to resolve issues and dive into potential issuesAbility to adapt and continue to learn new technologies is importantJob Requirement
PythonPysparkHadoopHadoop componentsReal time datareal time processingHiveBig dataMysqlsqlImpalaSparkHybrid in chicagoHybrid in denverGitBit bucketReach Out to a RecruiterRecruiterEmailPhoneKavin Nilavu Thatha Manji Sivananthankavin.nilavu@collabera.com9738595453
Apply Now