ShiftCode Analytics
Big Data Engineer : Dell
ShiftCode Analytics, Austin, Texas, us, 78716
Interview : Video
Visa : All apart from H1b , cpt and TN
This is hybrid from day-1.
Description :
Requirements:5+ years' experience in data engineering workPrevious experience as a Big Data EngineerIn-depth knowledge of Hadoop, Spark, AirflowTechnical expertise with data models, data mining, and segmentation techniquesHands-on experience with SQL database, RedisFamiliarity with Kubernetes and Docker toolsFamiliarity with S3, Apache Parquet and Apache IcebergUnderstand how to extract dataExperience with Graph databasesKnowledge of programming languages (e.g. Python)Experience with Streaming - Kafka or RMQExperience with Gitlab based CI/CDExperience with Data catalog
Added advantage:
AI/Client EngineerClient Pipelines
Responsibilities:
Analyze and organize raw dataBuild data systems and pipelinesInterpret trends and patterns in enterprise dataConduct complex data analysis and report on resultsPrepare data for prescriptive and predictive modelingCombine raw information from different sourcesExplore ways to enhance data quality and reliabilityIdentify opportunities for data acquisitionCollaborate with data scientists and architects on several projectsWork independently with different data owners and design data flows
Visa : All apart from H1b , cpt and TN
This is hybrid from day-1.
Description :
Requirements:5+ years' experience in data engineering workPrevious experience as a Big Data EngineerIn-depth knowledge of Hadoop, Spark, AirflowTechnical expertise with data models, data mining, and segmentation techniquesHands-on experience with SQL database, RedisFamiliarity with Kubernetes and Docker toolsFamiliarity with S3, Apache Parquet and Apache IcebergUnderstand how to extract dataExperience with Graph databasesKnowledge of programming languages (e.g. Python)Experience with Streaming - Kafka or RMQExperience with Gitlab based CI/CDExperience with Data catalog
Added advantage:
AI/Client EngineerClient Pipelines
Responsibilities:
Analyze and organize raw dataBuild data systems and pipelinesInterpret trends and patterns in enterprise dataConduct complex data analysis and report on resultsPrepare data for prescriptive and predictive modelingCombine raw information from different sourcesExplore ways to enhance data quality and reliabilityIdentify opportunities for data acquisitionCollaborate with data scientists and architects on several projectsWork independently with different data owners and design data flows