SysMind Tech
Bigdata Developer
SysMind Tech, Costa Mesa, CA, United States
Role : Spark, Scala, Big data developer
Location : Costa Mesa, CA
Job Description :
Technical/Functional Skills
Experienced engineer with hands on and strong coding skills, preferably with Java, Scala, Python.
AWS Cloud experience - S3, EFS, ECS, EMR, etc.
Knowledge of Hadoop/Spark and various data formats like Parquet, AVRO, CSV, etc.
Knowledge and experience with RDBMS (Aurora MySQL) and No-SQL (Cassandra) is a plus.
Great attention to details with analytical/curious mind.
Organizational and communication skills
Experience Required
8 - 10 years
Roles & Responsibilities
• Perform large-scale data processing using Python and Apache Spark.
• Utilize AWS services like S3, EMR, EC2 for data storage and processing.
• Schedule, monitor, and troubleshoot data pipelines with Apache Airflow.
• Ensure the data quality, observability, and integrity across all our data infrastructure.
Location : Costa Mesa, CA
Job Description :
Technical/Functional Skills
Experienced engineer with hands on and strong coding skills, preferably with Java, Scala, Python.
AWS Cloud experience - S3, EFS, ECS, EMR, etc.
Knowledge of Hadoop/Spark and various data formats like Parquet, AVRO, CSV, etc.
Knowledge and experience with RDBMS (Aurora MySQL) and No-SQL (Cassandra) is a plus.
Great attention to details with analytical/curious mind.
Organizational and communication skills
Experience Required
8 - 10 years
Roles & Responsibilities
• Perform large-scale data processing using Python and Apache Spark.
• Utilize AWS services like S3, EMR, EC2 for data storage and processing.
• Schedule, monitor, and troubleshoot data pipelines with Apache Airflow.
• Ensure the data quality, observability, and integrity across all our data infrastructure.