Logo
ShiftCode Analytics

Big Data Engineer : Dell

ShiftCode Analytics, Austin, Texas, us, 78716


Interview : Video

Visa : All apart from H1b , cpt and TN

This is hybrid from day-1.

Description :

Requirements: 5+ years' experience in data engineering work Previous experience as a Big Data Engineer In-depth knowledge of Hadoop, Spark, Airflow Technical expertise with data models, data mining, and segmentation techniques Hands-on experience with SQL database, Redis Familiarity with Kubernetes and Docker tools Familiarity with S3, Apache Parquet and Apache Iceberg Understand how to extract data Experience with Graph databases Knowledge of programming languages (e.g. Python) Experience with Streaming - Kafka or RMQ Experience with Gitlab based CI/CD Experience with Data catalog

Added advantage:

AI/Client Engineer Client Pipelines

Responsibilities:

Analyze and organize raw data Build data systems and pipelines Interpret trends and patterns in enterprise data Conduct complex data analysis and report on results Prepare data for prescriptive and predictive modeling Combine raw information from different sources Explore ways to enhance data quality and reliability Identify opportunities for data acquisition Collaborate with data scientists and architects on several projects Work independently with different data owners and design data flows