Walmart
(USA) Staff Data Engineer, Technology
Walmart, Sunnyvale, California, United States, 94087
Position Summary:
What you'll do:
About the Data and Customer Analytics (DCA) Organization:Our organization focuses on managing and delivering world-class data assets, including creating and maintaining data standards, driving policy compliance, creating partnerships, and developing pipelines and self-service tools. We empower our business to leverage data to fuel growth, driving revenue in our core and building new business model opportunities.
What you'll do:You will use cutting-edge data engineering techniques to create critical datasets and dig into our mammoth scale of data to help unleash the power of data science by imagining, developing, and maintaining data pipelines that our Data Scientists and Analysts can rely on.You will be responsible for contributing to an orchestration layer of complex data transformations, refining raw data from source into targeted, valuable data assets for consumption in a governed way.You will partner with Data Scientists, Analysts, other engineers, and business stakeholders to solve complex and exciting challenges so that we can build out capabilities that evolve the marketplace business model while making a positive impact on our customers' and sellers' lives.You will lead the discovery phase of medium to large projects to come up with high-level design by partnering with product management, Web Operations, project management, business, and user experience teams. Obtaining cross-function approvals, driving proof-of-concept, and implementing prototypes to validate ideas.You will develop Innovation strategies, processes, and best practices by leading internal technical teams. Partnering with cross-functional teams across the business. Developing assessments of key opportunities, documenting project scopes, developing long-range plans and project timelines. Communicating with and influencing decision-makers and executives within the organization and resolving technology differences across teams through informed discussions.Utilizes industry research to improve Wal-Mart's technology environment by analyzing industry best practices, benchmarking industry against internal processes and solutions. Researching or influencing future industry solutions for fit with internal needs and defining software development guidelines, standards, and processes.You will drive the execution of multiple business plans and projects by identifying customer and operational needs. Developing and communicating business plans and priorities, removing barriers and obstacles that impact performance. Developing contingency plans and demonstrating adaptability and supporting continuous learning.You will provide guidance and mentorship to junior data engineers.You will design, develop, and maintain highly scalable and fault-tolerant real-time, near real-time, and batch data systems/pipelines that process, store, and serve large volumes of data with optimal performance.You will ensure data ingested and processed is accurate and of high quality by implementing data quality checks, data validation, and data cleaning processes.You will identify possible options to address business problems within one's discipline through analytics, big data analytics, and automation.You will build business domain expertise to support the data need for product teams, analytics, data scientists, and other data consumers.
What you'll bring:Bachelor's/master's degree in computer science or a related field.8+ years' experience in the development of big data technologies/data pipelines.Proficiency in managing and manipulating huge datasets in the order of terabytes (TB) is essential.Expertise in big data technologies like Hadoop, Apache Spark (Scala preferred), Apache Hive, or similar frameworks on the cloud (GCP preferred, AWS, Azure etc.) to build batch data pipelines with a strong focus on optimization, SLA adherence, and fault tolerance.Expertise in building idempotent workflows using orchestrators like Automic, Airflow, Luigi etc.Expertise in writing SQL to analyze, optimize, and profile data preferably in BigQuery or SPARK SQL.Strong data modeling skills are necessary for designing a schema that can accommodate the evolution of data sources and facilitate seamless data joins across various datasets.Ability to work directly with stakeholders to understand data requirements and translate that to pipeline development/data solution work.Strong analytical and problem-solving skills are crucial for identifying and resolving issues that may arise during the data integration and schema evolution process.Ability to move at a rapid pace with quality and start delivering with minimal ramp-up time will be crucial to succeed in this initiative.Effective communication and collaboration skills are necessary for working in a team environment and coordinating efforts between different stakeholders involved in the project.
Nice to have from you:Experience building complex near real-time (NRT) streaming data pipelines using Apache Kafka, Spark streaming, Kafka Connect with a strong focus on stability, scalability, and SLA adherence.Good understanding of REST APIs - working knowledge of Apache Druid, Redis, Elastic search, GraphQL or similar technologies. Understanding of API contracts, building telemetry, stress testing etc.Exposure in developing reports/dashboards using Looker/Tableau.Experience in eCommerce domain.
At Walmart, we offer competitive pay as well as performance-based bonus awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision, and dental coverage. Financial benefits include 401(k), stock purchase, and company-paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting. Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.
You will also receive PTO and/or PPTO that can be used for vacation, sick leave, holidays, or other purposes. The amount you receive depends on your job classification and length of employment. It will meet or exceed the requirements of paid sick leave laws, where applicable.
For information about PTO, see
https://one.walmart.com/notices .
Live Better U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short-form certificates. Tuition, books, and fees are completely paid for by Walmart.
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific plan or program terms.
For information about benefits and eligibility, see
One.Walmart .
The annual salary range for this position is $95,000.00-$167,000.00.
Additional compensation includes annual or quarterly performance bonuses.
Additional compensation for certain positions may also include:Regional Pay Zone (RPZ) (based on location)Stock
Minimum Qualifications:Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.Option 1: Bachelor's degree in Computer Science and 4 years' experience in software engineering or related field.Option 2: 6 years' experience in software engineering or related field.Option 3: Master's degree in Computer Science and 2 years' experience in software engineering or related field.3 years' experience in data engineering, database engineering, business intelligence, or business analytics.
Preferred Qualifications:Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.Data engineering, database engineering, business intelligence, or business analytics, ETL tools and working with large data sets in the cloud, Master's degree in Computer Science or related field and 4 years' experience in software engineering.
Primary Location:840 W California Ave, Sunnyvale, CA 94086-4828, United States of America.
#J-18808-Ljbffr
What you'll do:
About the Data and Customer Analytics (DCA) Organization:Our organization focuses on managing and delivering world-class data assets, including creating and maintaining data standards, driving policy compliance, creating partnerships, and developing pipelines and self-service tools. We empower our business to leverage data to fuel growth, driving revenue in our core and building new business model opportunities.
What you'll do:You will use cutting-edge data engineering techniques to create critical datasets and dig into our mammoth scale of data to help unleash the power of data science by imagining, developing, and maintaining data pipelines that our Data Scientists and Analysts can rely on.You will be responsible for contributing to an orchestration layer of complex data transformations, refining raw data from source into targeted, valuable data assets for consumption in a governed way.You will partner with Data Scientists, Analysts, other engineers, and business stakeholders to solve complex and exciting challenges so that we can build out capabilities that evolve the marketplace business model while making a positive impact on our customers' and sellers' lives.You will lead the discovery phase of medium to large projects to come up with high-level design by partnering with product management, Web Operations, project management, business, and user experience teams. Obtaining cross-function approvals, driving proof-of-concept, and implementing prototypes to validate ideas.You will develop Innovation strategies, processes, and best practices by leading internal technical teams. Partnering with cross-functional teams across the business. Developing assessments of key opportunities, documenting project scopes, developing long-range plans and project timelines. Communicating with and influencing decision-makers and executives within the organization and resolving technology differences across teams through informed discussions.Utilizes industry research to improve Wal-Mart's technology environment by analyzing industry best practices, benchmarking industry against internal processes and solutions. Researching or influencing future industry solutions for fit with internal needs and defining software development guidelines, standards, and processes.You will drive the execution of multiple business plans and projects by identifying customer and operational needs. Developing and communicating business plans and priorities, removing barriers and obstacles that impact performance. Developing contingency plans and demonstrating adaptability and supporting continuous learning.You will provide guidance and mentorship to junior data engineers.You will design, develop, and maintain highly scalable and fault-tolerant real-time, near real-time, and batch data systems/pipelines that process, store, and serve large volumes of data with optimal performance.You will ensure data ingested and processed is accurate and of high quality by implementing data quality checks, data validation, and data cleaning processes.You will identify possible options to address business problems within one's discipline through analytics, big data analytics, and automation.You will build business domain expertise to support the data need for product teams, analytics, data scientists, and other data consumers.
What you'll bring:Bachelor's/master's degree in computer science or a related field.8+ years' experience in the development of big data technologies/data pipelines.Proficiency in managing and manipulating huge datasets in the order of terabytes (TB) is essential.Expertise in big data technologies like Hadoop, Apache Spark (Scala preferred), Apache Hive, or similar frameworks on the cloud (GCP preferred, AWS, Azure etc.) to build batch data pipelines with a strong focus on optimization, SLA adherence, and fault tolerance.Expertise in building idempotent workflows using orchestrators like Automic, Airflow, Luigi etc.Expertise in writing SQL to analyze, optimize, and profile data preferably in BigQuery or SPARK SQL.Strong data modeling skills are necessary for designing a schema that can accommodate the evolution of data sources and facilitate seamless data joins across various datasets.Ability to work directly with stakeholders to understand data requirements and translate that to pipeline development/data solution work.Strong analytical and problem-solving skills are crucial for identifying and resolving issues that may arise during the data integration and schema evolution process.Ability to move at a rapid pace with quality and start delivering with minimal ramp-up time will be crucial to succeed in this initiative.Effective communication and collaboration skills are necessary for working in a team environment and coordinating efforts between different stakeholders involved in the project.
Nice to have from you:Experience building complex near real-time (NRT) streaming data pipelines using Apache Kafka, Spark streaming, Kafka Connect with a strong focus on stability, scalability, and SLA adherence.Good understanding of REST APIs - working knowledge of Apache Druid, Redis, Elastic search, GraphQL or similar technologies. Understanding of API contracts, building telemetry, stress testing etc.Exposure in developing reports/dashboards using Looker/Tableau.Experience in eCommerce domain.
At Walmart, we offer competitive pay as well as performance-based bonus awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision, and dental coverage. Financial benefits include 401(k), stock purchase, and company-paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting. Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.
You will also receive PTO and/or PPTO that can be used for vacation, sick leave, holidays, or other purposes. The amount you receive depends on your job classification and length of employment. It will meet or exceed the requirements of paid sick leave laws, where applicable.
For information about PTO, see
https://one.walmart.com/notices .
Live Better U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short-form certificates. Tuition, books, and fees are completely paid for by Walmart.
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific plan or program terms.
For information about benefits and eligibility, see
One.Walmart .
The annual salary range for this position is $95,000.00-$167,000.00.
Additional compensation includes annual or quarterly performance bonuses.
Additional compensation for certain positions may also include:Regional Pay Zone (RPZ) (based on location)Stock
Minimum Qualifications:Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.Option 1: Bachelor's degree in Computer Science and 4 years' experience in software engineering or related field.Option 2: 6 years' experience in software engineering or related field.Option 3: Master's degree in Computer Science and 2 years' experience in software engineering or related field.3 years' experience in data engineering, database engineering, business intelligence, or business analytics.
Preferred Qualifications:Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.Data engineering, database engineering, business intelligence, or business analytics, ETL tools and working with large data sets in the cloud, Master's degree in Computer Science or related field and 4 years' experience in software engineering.
Primary Location:840 W California Ave, Sunnyvale, CA 94086-4828, United States of America.
#J-18808-Ljbffr