Insight Global
Data Engineer
Insight Global, Dallas, Texas, United States, 75215
Insight Global is looking for a Data Engineer Proficient in Python to support a forecasting order demand project for the World's largest retailer sitting in Dallas, TX. However, this role is fully remote. This candidate will need to have experience using Kubernetes, Micro-services, Python (scripting and coding), SQL bit query, L-flow, ETL, Spark, and PySpark is necessary in order to perform this role.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal. com.
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Past experience working in Supply ChainRedeploy from Sam's Club or WalmartProficient in PythonHands on experience in Big Data, GCP Cloud and development.Have hands on experience in writing Spark jobs in PySpark.Proficient in GCP cloud, Airflow managed scheduling tool & creating YAML template in GCP for the job.Proficient in designing MySQL & Cassandra database.Experience in importing and exporting the data using Sqoop/TDCH from HDFS to Relational Database systems and vice-versa.Good in writing shell scripts.Experience in manipulating/analyzing large datasets and finding patterns and insights within structured and unstructured data.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal. com.
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Past experience working in Supply ChainRedeploy from Sam's Club or WalmartProficient in PythonHands on experience in Big Data, GCP Cloud and development.Have hands on experience in writing Spark jobs in PySpark.Proficient in GCP cloud, Airflow managed scheduling tool & creating YAML template in GCP for the job.Proficient in designing MySQL & Cassandra database.Experience in importing and exporting the data using Sqoop/TDCH from HDFS to Relational Database systems and vice-versa.Good in writing shell scripts.Experience in manipulating/analyzing large datasets and finding patterns and insights within structured and unstructured data.