JobRialto
Big Data Engineer
JobRialto, Costa Mesa, CA, United States
Job description-
- A Bachelor's or master's degree in computer science, Engineering, or a related field is required.
- - 8 to 10 years of professional development experience in cloud-based distributed systems.
- - Hands-on experience with AWS services (such as S3, EMR, EC2, Glue, DynamoDB, RDS) or other cloud platforms.
- - Proficiency in programming languages such as Python, Scala, or Java.
- - Desired experience with Big Data tools, including Spark/PySpark, Hadoop, Hive, and NoSQL/SQL, as well as scripting languages.
- - Experience with Snowflake or any relational database management system (RDBMS), including hands-on skills in writing complex queries.
- - Practical experience in workflow orchestration tools like Airflow or Oozie.
- - Proficiency in enterprise security, agile methodologies, and change management standards.
- - Good understanding of distributed software applications, including system integration, testing, and troubleshooting.
- - Experience in monitoring the health of distributed systems and developing strategies for error detection and recovery.
- - Systems integration experience is essential.
- - Ability to work with version control systems, such as GIT, including tasks like branching and merging.
Education: Bachelors Degree