Logo
JobRialto

Big Data Engineer

JobRialto, Costa Mesa, CA, United States


Job description-

  • A Bachelor's or master's degree in computer science, Engineering, or a related field is required.
  • - 8 to 10 years of professional development experience in cloud-based distributed systems.
  • - Hands-on experience with AWS services (such as S3, EMR, EC2, Glue, DynamoDB, RDS) or other cloud platforms.
  • - Proficiency in programming languages such as Python, Scala, or Java.
  • - Desired experience with Big Data tools, including Spark/PySpark, Hadoop, Hive, and NoSQL/SQL, as well as scripting languages.
  • - Experience with Snowflake or any relational database management system (RDBMS), including hands-on skills in writing complex queries.
  • - Practical experience in workflow orchestration tools like Airflow or Oozie.
  • - Proficiency in enterprise security, agile methodologies, and change management standards.
  • - Good understanding of distributed software applications, including system integration, testing, and troubleshooting.
  • - Experience in monitoring the health of distributed systems and developing strategies for error detection and recovery.
  • - Systems integration experience is essential.
  • - Ability to work with version control systems, such as GIT, including tasks like branching and merging.


Education: Bachelors Degree