Walmart
Staff, Software Engineer (Data Engineer)
Walmart, Sunnyvale, California, United States, 94087
Position Summary
About The Data And Customer Analytics (DCA) OrganizationOur organization focuses on managing and delivering world-class data assets, including creating and maintaining data standards, driving policy compliance, creating partnerships, and developing pipelines and self-service tools. We empower our business to leverage data to fuel growth, driving revenue in our core and building new business model opportunities.
What You'll DoYou will use cutting-edge data engineering techniques to create critical datasets and dig into our mammoth scale of data to help unleash the power of data science by imagining, developing, and maintaining data pipelines that our Data Scientists and Analysts can rely on.You will be responsible for contributing to an orchestration layer of complex data transformations, refining raw data from source into targeted, valuable data assets for consumption in a governed way.You will partner with Data Scientists, Analysts, other engineers, and business stakeholders to solve complex and exciting challenges so that we can build out capabilities that evolve the marketplace business model while making a positive impact on our customers' and sellers' lives.You will lead the discovery phase of medium to large projects to come up with high-level design by partnering with the product management, Web Operations, project management, business, and user experience teams. Obtaining cross-function approvals, driving proof-of-concept and implementing prototypes to validate ideas.You will develop Innovation strategies, processes, and best practices by leading internal technical teams. Partnering with cross-functional teams across the business. Developing assessments of key opportunities, documenting project scopes, developing long-range plans, and project timelines. Communicating with and influencing decision-makers and executives within the organization and resolving technology differences across teams through informed discussions.Utilizes industry research to improve Wal-Mart's technology environment by analyzing industry best practices, benchmarking industry against internal processes and solutions. Researching or influencing future industry solutions for fit with internal needs and defining software development guidelines, standards, and processes.You will drive the execution of multiple business plans and projects by identifying customer and operational needs. Developing and communicating business plans and priorities, removing barriers and obstacles that impact performance. Developing contingency plans and demonstrating adaptability and supporting continuous learning.You will provide guidance and mentorship to junior data engineers.You will design, develop and maintain highly scalable and fault-tolerant real-time, near real-time, and batch data systems/pipelines that process, store, and serve large volumes of data with optimal performance.You will ensure data ingested and processed is accurate and of high quality by implementing data quality checks, data validation, and data cleaning processes.You will identify possible options to address business problems within one's discipline through analytics, big data analytics, and automation.You will build business domain expertise to support the data need for product teams, analytics, data scientists, and other data consumers.What You'll BringBachelor's/master's degree in computer science or a related field.With 8+ years' experience in development of big data technologies/data pipelines.Proficiency in managing and manipulating huge datasets in the order of terabytes (TB) is essential.Expertise in big data technologies like Hadoop, Apache Spark (Scala preferred), Apache Hive, or similar frameworks on the cloud (GCP preferred, AWS, Azure, etc.) to build batch data pipelines with strong focus on optimization, SLA adherence, and fault tolerance.Expertise in building idempotent workflows using orchestrators like Automic, Airflow, Luigi, etc.Expertise in writing SQL to analyze, optimize, and profile data preferably in BigQuery or SPARK SQL.Strong data modeling skills are necessary for designing a schema that can accommodate the evolution of data sources and facilitate seamless data joins across various datasets.Ability to work directly with stakeholders to understand data requirements and translate that to pipeline development/data solution work.Strong analytical and problem-solving skills are crucial for identifying and resolving issues that may arise during the data integration and schema evolution process.Ability to move at a rapid pace with quality and start delivering with minimal ramp-up time will be crucial to succeed in this initiative.Effective communication and collaboration skills are necessary for working in a team environment and coordinating efforts between different stakeholders involved in the project.Nice To Have From YouExperience building complex near real-time (NRT) streaming data pipelines using Apache Kafka, Spark streaming, Kafka Connect with a strong focus on stability, scalability, and SLA adherence.Good understanding of REST APIs - working knowledge on Apache Druid, Redis, Elastic search, GraphQL, or similar technologies. Understanding of API contracts, building telemetry, stress testing, etc.Exposure in developing reports/dashboards using Looker/Tableau.Experience in eCommerce domain.About Walmart Global TechImagine working in an environment where one line of code can make life easier for hundreds of millions of people. That's what we do at Walmart Global Tech. We're a team of software engineers, data scientists, cybersecurity experts, and service professionals within the world's leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered. We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.Flexible, Hybrid WorkWe use a hybrid way of working that is primarily in office coupled with virtual when not onsite. Our campuses serve as a hub to enhance collaboration, bring us together for purpose and deliver on business needs. This approach helps us make quicker decisions, remove location barriers across our global team, and be more flexible in our personal lives.BenefitsBeyond our great compensation package, you can receive incentive awards for your performance. Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more.Equal Opportunity EmployerWalmart, Inc. is an Equal Opportunity Employer - By Choice. We believe we are best equipped to help our associates, customers, and the communities we serve live better when we really know them. That means understanding, respecting, and valuing diversity - unique styles, experiences, identities, ideas, and opinions - while being inclusive of all people.Minimum QualificationsOutlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 4 years' experience in software engineering or related area. Option 2: 6 years' experience in software engineering or related area.Preferred QualificationsOutlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.Master's degree in Computer Science, Computer Engineering, Computer Information Systems, Software Engineering, or related area and 2 years' experience in software engineering or related area. We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly. The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Walmart's accessibility standards and guidelines for supporting an inclusive culture.Primary Location: 840 W California Ave, Sunnyvale, CA 94086-4828, United States of America
#J-18808-Ljbffr
About The Data And Customer Analytics (DCA) OrganizationOur organization focuses on managing and delivering world-class data assets, including creating and maintaining data standards, driving policy compliance, creating partnerships, and developing pipelines and self-service tools. We empower our business to leverage data to fuel growth, driving revenue in our core and building new business model opportunities.
What You'll DoYou will use cutting-edge data engineering techniques to create critical datasets and dig into our mammoth scale of data to help unleash the power of data science by imagining, developing, and maintaining data pipelines that our Data Scientists and Analysts can rely on.You will be responsible for contributing to an orchestration layer of complex data transformations, refining raw data from source into targeted, valuable data assets for consumption in a governed way.You will partner with Data Scientists, Analysts, other engineers, and business stakeholders to solve complex and exciting challenges so that we can build out capabilities that evolve the marketplace business model while making a positive impact on our customers' and sellers' lives.You will lead the discovery phase of medium to large projects to come up with high-level design by partnering with the product management, Web Operations, project management, business, and user experience teams. Obtaining cross-function approvals, driving proof-of-concept and implementing prototypes to validate ideas.You will develop Innovation strategies, processes, and best practices by leading internal technical teams. Partnering with cross-functional teams across the business. Developing assessments of key opportunities, documenting project scopes, developing long-range plans, and project timelines. Communicating with and influencing decision-makers and executives within the organization and resolving technology differences across teams through informed discussions.Utilizes industry research to improve Wal-Mart's technology environment by analyzing industry best practices, benchmarking industry against internal processes and solutions. Researching or influencing future industry solutions for fit with internal needs and defining software development guidelines, standards, and processes.You will drive the execution of multiple business plans and projects by identifying customer and operational needs. Developing and communicating business plans and priorities, removing barriers and obstacles that impact performance. Developing contingency plans and demonstrating adaptability and supporting continuous learning.You will provide guidance and mentorship to junior data engineers.You will design, develop and maintain highly scalable and fault-tolerant real-time, near real-time, and batch data systems/pipelines that process, store, and serve large volumes of data with optimal performance.You will ensure data ingested and processed is accurate and of high quality by implementing data quality checks, data validation, and data cleaning processes.You will identify possible options to address business problems within one's discipline through analytics, big data analytics, and automation.You will build business domain expertise to support the data need for product teams, analytics, data scientists, and other data consumers.What You'll BringBachelor's/master's degree in computer science or a related field.With 8+ years' experience in development of big data technologies/data pipelines.Proficiency in managing and manipulating huge datasets in the order of terabytes (TB) is essential.Expertise in big data technologies like Hadoop, Apache Spark (Scala preferred), Apache Hive, or similar frameworks on the cloud (GCP preferred, AWS, Azure, etc.) to build batch data pipelines with strong focus on optimization, SLA adherence, and fault tolerance.Expertise in building idempotent workflows using orchestrators like Automic, Airflow, Luigi, etc.Expertise in writing SQL to analyze, optimize, and profile data preferably in BigQuery or SPARK SQL.Strong data modeling skills are necessary for designing a schema that can accommodate the evolution of data sources and facilitate seamless data joins across various datasets.Ability to work directly with stakeholders to understand data requirements and translate that to pipeline development/data solution work.Strong analytical and problem-solving skills are crucial for identifying and resolving issues that may arise during the data integration and schema evolution process.Ability to move at a rapid pace with quality and start delivering with minimal ramp-up time will be crucial to succeed in this initiative.Effective communication and collaboration skills are necessary for working in a team environment and coordinating efforts between different stakeholders involved in the project.Nice To Have From YouExperience building complex near real-time (NRT) streaming data pipelines using Apache Kafka, Spark streaming, Kafka Connect with a strong focus on stability, scalability, and SLA adherence.Good understanding of REST APIs - working knowledge on Apache Druid, Redis, Elastic search, GraphQL, or similar technologies. Understanding of API contracts, building telemetry, stress testing, etc.Exposure in developing reports/dashboards using Looker/Tableau.Experience in eCommerce domain.About Walmart Global TechImagine working in an environment where one line of code can make life easier for hundreds of millions of people. That's what we do at Walmart Global Tech. We're a team of software engineers, data scientists, cybersecurity experts, and service professionals within the world's leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered. We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.Flexible, Hybrid WorkWe use a hybrid way of working that is primarily in office coupled with virtual when not onsite. Our campuses serve as a hub to enhance collaboration, bring us together for purpose and deliver on business needs. This approach helps us make quicker decisions, remove location barriers across our global team, and be more flexible in our personal lives.BenefitsBeyond our great compensation package, you can receive incentive awards for your performance. Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more.Equal Opportunity EmployerWalmart, Inc. is an Equal Opportunity Employer - By Choice. We believe we are best equipped to help our associates, customers, and the communities we serve live better when we really know them. That means understanding, respecting, and valuing diversity - unique styles, experiences, identities, ideas, and opinions - while being inclusive of all people.Minimum QualificationsOutlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 4 years' experience in software engineering or related area. Option 2: 6 years' experience in software engineering or related area.Preferred QualificationsOutlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.Master's degree in Computer Science, Computer Engineering, Computer Information Systems, Software Engineering, or related area and 2 years' experience in software engineering or related area. We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly. The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Walmart's accessibility standards and guidelines for supporting an inclusive culture.Primary Location: 840 W California Ave, Sunnyvale, CA 94086-4828, United States of America
#J-18808-Ljbffr