Walmart Global Tech
Data Engineer III R-1845871
Walmart Global Tech, Sunnyvale, California, United States, 94087
At Walmart, our goal is to assist individuals in saving money, enabling them to enhance their lives. This objective is the basis for all our choices and motivates us to revolutionize the retail industry. Achieving this requires the most exceptional talent – individuals who are innovative, curious, and motivated to provide extraordinary experiences for our customers.Are you filled with endless enthusiasm and dedication towards engineering data to tackle ever-changing challenges that will shape the future of retail? Walmart's extensive operations come with vast and complex sets of data, presenting unparalleled opportunities for analysis and insights.About the Data and Customer Analytics (DCA) Organization:
Our organization focuses on managing and delivering world-class data assets, including creating and maintaining data standards, driving policy compliance, creating partnerships, and developing pipelines and self-service tools. We empower our business to leverage data to fuel growth, driving revenue in our core and building new business model opportunities.About Team:
Everyone has data, but the sheer volume of data at Walmart can be limitless. In the Data Engineering team, we help Walmart manage this data by building pipelines and data lakes to prepare big data for analysis and unlocking actionable insights in real-time. We also use cross-departmental data and machine learning to build a holistic view of true profitability, saving millions of dollars across item categories and geographies while assisting our leadership in making better decisions faster.What you'll do:
Your primary responsibility will be to oversee and manage data pipeline processes that utilize cutting-edge data engineering techniques to generate critical datasets for Walmart.You will be responsible for promptly addressing any issues or failures in data streaming and batch applications, ensuring adherence to SLAs.Your role will involve acting as a gatekeeper to maintain the integrity and reliability of production data systems.You will develop automation tools to monitor and alert platform components and data pipelines.You will contribute to the ongoing design, implementation, and maintenance of systems and tools within our data platform.You will assess and provide recommendations for optimizing resource usage in data pipelines built on a big data stack.You will collaborate closely with engineering teams to contribute to their roadmap and assist in capacity planning for our big data stack.You will implement data quality checks, data validation, and data cleaning processes to ensure the accuracy and high quality of ingested and processed data.You will participate in a 12/7 on-call rotation and act as the initial responder for any issues with the data pipelines.You will lead root cause analysis (RCA) and incident management efforts.You will support and uphold company policies, procedures, mission, values, and ethical standards.What you'll bring:
At least 4+ years of experience development of
big data technologies/data pipelinesExperience with big data technologies like
Hadoop, Apache Spark
(Scala preferred), Apache Hive, or similar frameworks on the cloud ( GCP preferred , AWS, Azure etc.) to build batch data pipelines with strong focus on optimization, SLA adherence and fault tolerance.Experience in programming languages like
Java or PythonExperience in managing
Spark Streaming, Kafka, Apache Storm, Flume
etc.Experience in writing SQL to analyze, optimize, profile data preferably in
BigQuery or SPARK SQLStrong troubleshooting skills to analyze Spark Event logs and provide recommendations on Spark container optimization, Cluster configurations etc.Ability to move at a rapid pace with quality and start delivering with minimal ramp up time will be crucial to succeed in this initiative.Effective communication
and collaboration skills are necessary for working in a team environment and coordinating efforts between different stakeholders involved in the project.Nice to have from you:
Good understanding of REST APIs – working knowledge on
Apache Druid, Redis, Elastic search, GraphQL
or similar technologies. Understanding of API contracts, building telemetry, stress testing etc.Exposure in UI development using
React .Exposure in developing reports/dashboards using
Looker/TableauAbout Walmart Global Tech
Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. That’s what we do at Walmart Global Tech. We’re a team of software engineers, data scientists, cybersecurity experts and service professionals within the world’s leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered. We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.Flexible, hybrid work:
We use a hybrid way of working that is primarily in office coupled with virtual when not onsite. Our campuses serve as a hub to enhance collaboration, bring us together for purpose and deliver on business needs. This approach helps us make quicker decisions, remove location barriers across our global team and be more flexible in our personal lives.Benefits:
Benefits: Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more.Equal Opportunity Employer:
Walmart, Inc. is an Equal Opportunity Employer – By Choice. We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting and valuing diversity- unique styles, experiences, identities, ideas and opinions – while being inclusive of all people.The above information has been designed to indicate the general nature and level of work performed in the role. It is not designed to contain or be interpreted as a comprehensive inventory of all responsibilities and qualifications required of employees assigned to this job. The full Job Description can be made available as part of the hiring process.
#J-18808-Ljbffr
Our organization focuses on managing and delivering world-class data assets, including creating and maintaining data standards, driving policy compliance, creating partnerships, and developing pipelines and self-service tools. We empower our business to leverage data to fuel growth, driving revenue in our core and building new business model opportunities.About Team:
Everyone has data, but the sheer volume of data at Walmart can be limitless. In the Data Engineering team, we help Walmart manage this data by building pipelines and data lakes to prepare big data for analysis and unlocking actionable insights in real-time. We also use cross-departmental data and machine learning to build a holistic view of true profitability, saving millions of dollars across item categories and geographies while assisting our leadership in making better decisions faster.What you'll do:
Your primary responsibility will be to oversee and manage data pipeline processes that utilize cutting-edge data engineering techniques to generate critical datasets for Walmart.You will be responsible for promptly addressing any issues or failures in data streaming and batch applications, ensuring adherence to SLAs.Your role will involve acting as a gatekeeper to maintain the integrity and reliability of production data systems.You will develop automation tools to monitor and alert platform components and data pipelines.You will contribute to the ongoing design, implementation, and maintenance of systems and tools within our data platform.You will assess and provide recommendations for optimizing resource usage in data pipelines built on a big data stack.You will collaborate closely with engineering teams to contribute to their roadmap and assist in capacity planning for our big data stack.You will implement data quality checks, data validation, and data cleaning processes to ensure the accuracy and high quality of ingested and processed data.You will participate in a 12/7 on-call rotation and act as the initial responder for any issues with the data pipelines.You will lead root cause analysis (RCA) and incident management efforts.You will support and uphold company policies, procedures, mission, values, and ethical standards.What you'll bring:
At least 4+ years of experience development of
big data technologies/data pipelinesExperience with big data technologies like
Hadoop, Apache Spark
(Scala preferred), Apache Hive, or similar frameworks on the cloud ( GCP preferred , AWS, Azure etc.) to build batch data pipelines with strong focus on optimization, SLA adherence and fault tolerance.Experience in programming languages like
Java or PythonExperience in managing
Spark Streaming, Kafka, Apache Storm, Flume
etc.Experience in writing SQL to analyze, optimize, profile data preferably in
BigQuery or SPARK SQLStrong troubleshooting skills to analyze Spark Event logs and provide recommendations on Spark container optimization, Cluster configurations etc.Ability to move at a rapid pace with quality and start delivering with minimal ramp up time will be crucial to succeed in this initiative.Effective communication
and collaboration skills are necessary for working in a team environment and coordinating efforts between different stakeholders involved in the project.Nice to have from you:
Good understanding of REST APIs – working knowledge on
Apache Druid, Redis, Elastic search, GraphQL
or similar technologies. Understanding of API contracts, building telemetry, stress testing etc.Exposure in UI development using
React .Exposure in developing reports/dashboards using
Looker/TableauAbout Walmart Global Tech
Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. That’s what we do at Walmart Global Tech. We’re a team of software engineers, data scientists, cybersecurity experts and service professionals within the world’s leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered. We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.Flexible, hybrid work:
We use a hybrid way of working that is primarily in office coupled with virtual when not onsite. Our campuses serve as a hub to enhance collaboration, bring us together for purpose and deliver on business needs. This approach helps us make quicker decisions, remove location barriers across our global team and be more flexible in our personal lives.Benefits:
Benefits: Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more.Equal Opportunity Employer:
Walmart, Inc. is an Equal Opportunity Employer – By Choice. We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting and valuing diversity- unique styles, experiences, identities, ideas and opinions – while being inclusive of all people.The above information has been designed to indicate the general nature and level of work performed in the role. It is not designed to contain or be interpreted as a comprehensive inventory of all responsibilities and qualifications required of employees assigned to this job. The full Job Description can be made available as part of the hiring process.
#J-18808-Ljbffr