Azure Data engineer

Dear,

Big data engineer
Dallas, TX

Candidate must be proficient in Spark, Scala/Python. Please send me the resumes directly so that I can shortlist and get back to you.
• Experience with Data Extraction, Data cleaning, Data screening, Data Exploration and Data Visualization of structured and unstructured datasets
• Skilled in Big Data Technologies like Spark, Spark SQL, PySpark, HDFS (Hadoop), MapReduce
• Excellent exposure to Data Visualization tools such as Tableau, PowerBI, Looker
• Experience with one or more of the major cloud platforms & cloud services such as - Azure/AWS/GCP, Databricks, Azure HD Insights, ADF or similar, Google Dataflow, Google DataProc
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience in working with Airflow
• Experience building and optimizing 'big data' data pipelines, architectures and data sets
• Strong analytic skills related to working with unstructured datasets
• Working knowledge of highly scalable 'big data' data stores
• A successful history of manipulating, processing and extracting value from large, disconnected datasets
• Build processes supporting data transformation, data structures, metadata, dependency and workload management
• Experience developing enterprise software products
• Experience with at least one of these object-oriented/object function scripting languages: PySpark/Python, Scala, Java
• Build monitoring and automated testing to ensure data consistency and availability
• Experience supporting and working with cross-functional teams in a dynamic environment
• Experience working in an AGILE environment.

Thanks & Regards,

Saravanan.R |Infowaygroup.com|

734 550 7585
Saravanan@infowaygroup.com
Info Way Solutions LLC, Fremont, CA