Info Way Solutions
Azure Data engineer
Info Way Solutions, Fremont, California, us, 94537
Dear,
Big data engineer Dallas, TX
Candidate must be proficient in Spark, Scala/Python. Please send me the resumes directly so that I can shortlist and get back to you. • Experience with Data Extraction, Data cleaning, Data screening, Data Exploration and Data Visualization of structured and unstructured datasets • Skilled in Big Data Technologies like Spark, Spark SQL, PySpark, HDFS (Hadoop), MapReduce • Excellent exposure to Data Visualization tools such as Tableau, PowerBI, Looker • Experience with one or more of the major cloud platforms & cloud services such as - Azure/AWS/GCP, Databricks, Azure HD Insights, ADF or similar, Google Dataflow, Google DataProc • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. • Experience in working with Airflow • Experience building and optimizing 'big data' data pipelines, architectures and data sets • Strong analytic skills related to working with unstructured datasets • Working knowledge of highly scalable 'big data' data stores • A successful history of manipulating, processing and extracting value from large, disconnected datasets • Build processes supporting data transformation, data structures, metadata, dependency and workload management • Experience developing enterprise software products • Experience with at least one of these object-oriented/object function scripting languages: PySpark/Python, Scala, Java • Build monitoring and automated testing to ensure data consistency and availability • Experience supporting and working with cross-functional teams in a dynamic environment • Experience working in an AGILE environment.
Thanks & Regards,
Saravanan.R
|Infowaygroup.com|
734 550 7585 Saravanan@infowaygroup.com Info Way Solutions LLC, Fremont, CA
Big data engineer Dallas, TX
Candidate must be proficient in Spark, Scala/Python. Please send me the resumes directly so that I can shortlist and get back to you. • Experience with Data Extraction, Data cleaning, Data screening, Data Exploration and Data Visualization of structured and unstructured datasets • Skilled in Big Data Technologies like Spark, Spark SQL, PySpark, HDFS (Hadoop), MapReduce • Excellent exposure to Data Visualization tools such as Tableau, PowerBI, Looker • Experience with one or more of the major cloud platforms & cloud services such as - Azure/AWS/GCP, Databricks, Azure HD Insights, ADF or similar, Google Dataflow, Google DataProc • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. • Experience in working with Airflow • Experience building and optimizing 'big data' data pipelines, architectures and data sets • Strong analytic skills related to working with unstructured datasets • Working knowledge of highly scalable 'big data' data stores • A successful history of manipulating, processing and extracting value from large, disconnected datasets • Build processes supporting data transformation, data structures, metadata, dependency and workload management • Experience developing enterprise software products • Experience with at least one of these object-oriented/object function scripting languages: PySpark/Python, Scala, Java • Build monitoring and automated testing to ensure data consistency and availability • Experience supporting and working with cross-functional teams in a dynamic environment • Experience working in an AGILE environment.
Thanks & Regards,
Saravanan.R
|Infowaygroup.com|
734 550 7585 Saravanan@infowaygroup.com Info Way Solutions LLC, Fremont, CA