Data Engineer

Big Data EngineerIrving, TX - HybridW2 ContractDirect ClientQualifications:8+ years of experience in hadoop/big data technologies.3+ years of experience in spark.2+ years experience in Snowflake2+ year of experience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies (e.g. Docker, Kubernetes)Experience with all aspects of DevOps (source control, continuous integration, deployments, etc.)Comprehensive knowledge of the principles of software engineering and data analyticsAdvanced knowledge of the Hadoop ecosystem and Big Data technologies Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)Knowledge of agile (scrum) development methodology is a plusStrong development/automation skillsProficient in programming in Java or Python with prior Apache Beam/Spark experience a plus.System level understanding - Data structures, algorithms, distributed storage & computeCan-do attitude on solving complex business problems, good interpersonal and teamwork skillsThanks,Somesh