Azure Data engineer

Dear, Big data engineer Dallas, TX Candidate must be proficient in Spark, Scala/Python. Please send me the resumes directly so that I can shortlist and get back to you. Experience with Data Extraction, Data cleaning, Data screening, Data Exploration and Data Visualization of structured and unstructured datasets Skilled in Big Data Technologies like Spark, Spark SQL, PySpark, HDFS (Hadoop), MapReduce Excellent exposure to Data Visualization tools such as Tableau, PowerBI, Looker Experience with one or more of the major cloud platforms & cloud services such as - Azure/AWS/GCP, Databricks, Azure HD Insights, ADF or similar, Google Dataflow, Google DataProc Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. Experience in working with Airflow Experience building and optimizing 'big data' data pipelines, architectures and data sets Strong analytic skills related to working with unstructured datasets Working knowledge of highly scalable 'big data' data stores A successful history of manipulating, processing and extracting value from large, disconnected datasets Build processes supporting data transformation, data structures, metadata, dependency and workload management Experience developing enterprise software products Experience with at least one of these object-oriented/object function scripting languages: PySpark/Python, Scala, Java Build monitoring and automated testing to ensure data consistency and availability Experience supporting and working with cross-functional teams in a dynamic environment Experience working in an AGILE environment. Thanks & Regards, Saravanan.R |Infowaygroup.com| 734 550 7585 Saravananinfowaygroup.com Info Way Solutions LLC, Fremont, CA