Comcast
Senior Data Engineer
Comcast, Phila, Pennsylvania, United States, 19117
R375144Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can proudly bring your authentic self to the workplace. Join us. You’ll do the best work of your career right here at Comcast.(In most cases, Comcast prefers to have employees on-site collaborating unless the team has been designated as virtual due to the nature of their work. If a position is listed with both office locations and virtual offerings, Comcast may be willing to consider candidates who live greater than 100 miles from the office for the remote option.)Job Summary
We are looking for a Senior Data Engineer to join our Philadelphia-based WiFi Engineer team. Be part of the team that manages and operates the world’s largest public Wi-Fi network. The work involves analysis and performance improvement of our Xfinity Wi-Fi networks hyperscale, using state of the art optimization techniques, machine learning, specification and use of wireless measurements, and analysis of network performance, building business insights that could help create future deployment strategy. The solutions are all implemented in the cloud, using an agile development process.Job Description
Core Responsibilities:
Create, maintain, redesign data pipelinesCreate ETL from a variety of data sources using SQL and big data technologiesPerform data analysis to discover opportunities and address gapsAutomate any manual processesCreate scalable big data solutionsBuild reports to provide actionable insights from the dataPerform analysis for query optimizationWork with data Scientists/Wireless Engineers on WiFi CX optimization using AI/ML techniquesWork with stakeholders and executives to create the requirement for data related needsBuild business insights that could help create future deployment strategyQualifications:
This is a Senior Engineer (Engineer 4) role, which requires 7-10 years of relevant experienceThis team is based in our cutting-edge Comcast Technology Center in downtown Philadelphia, and collaborates in-person on a hybrid basis.7+ years of experience in Python7+ years of experience in custom ETL design, implementation and maintenance7+ years of experience in Database technologies, SQL, MySQL, Elastic search, ETLs and framework development.7+ years of experience with Data Modeling7+ years of experience working on Big Data7+ years of experience with data analysis and visualization, particularly Tableau, SplunkExperience processing large data setsStrong experience with Spark, Hive, Pig, Flume, Sqoop, Kafka, Amazon RDS, Amazon Redshift, GCPExperience with data quality and validationAdditional Responsibilities:
Develops data structures and pipelines aligned to established standards and guidelines to organize, collect, standardize and transform data that helps generate insights and address reporting needs.Focuses on ensuring data quality during ingest, processing as well as final load to the target tables.Creates standard ingestion frameworks for structured and unstructured data as well as checking and reporting on the quality of the data being processed.Creates standard methods for end users / downstream applications to consume data including but not limited to database views, extracts and Application Programming Interfaces.Develops and maintains information systems (e.g., data warehouses, data lakes) including data access Application Programming Interfaces.Participates in the implementation of solutions via data architecture, data engineering, or data manipulation on both on-prem platforms like Kubernetes and Teradata as well as Cloud platforms like Databricks.Determines the appropriate storage platform across different on-prem (minIO and Teradata) and Cloud (AWS S3, Redshift) depending on the privacy, access and sensitivity requirements.Understands the data lineage from source to the final semantic layer along with the transformation rules applied to enable faster troubleshooting and impact analysis during changes.Collaborates with technology and platform management partners to optimize data sourcing and processing rules to ensure appropriate data quality as well as process optimization.Creates and establishes design standards and assurance processes for software, systems and applications development to ensure compatibility and operability of data connections, flows and storage requirements. Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs.Develops strategies for data acquisition, archive recovery, and database implementation.Manages data migrations/conversions and troubleshooting data processing issues.Understands the data sensitivity, customer data privacy rules and regulations and applies them consistently in all Information Lifecycle Management activities.Identifies and reacts to system notification and log to ensure quality standards for databases and applications. Solves abstract problems beyond single development language or situation by reusing data file and flags already set.Solves critical issues and shares knowledge such as trends, aggregate, quantity volume regarding specific data sources.Consistent exercise of independent judgment and discretion in matters of significance.Employees at all levels are expected to:
Understand our Operating Principles; make them the guidelines for how you do your job.Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences.Win as a team - make big things happen by working together and being open to new ideas.Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.Drive results and growth.Respect and promote inclusion & diversity.Do what's right for each other, our customers, investors and our communities.Disclaimer: This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.Comcast is proud to be an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.Education
Bachelor's DegreeWhile possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.Relevant Work Experience
7-10 YearsBase pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality – to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.
#J-18808-Ljbffr
We are looking for a Senior Data Engineer to join our Philadelphia-based WiFi Engineer team. Be part of the team that manages and operates the world’s largest public Wi-Fi network. The work involves analysis and performance improvement of our Xfinity Wi-Fi networks hyperscale, using state of the art optimization techniques, machine learning, specification and use of wireless measurements, and analysis of network performance, building business insights that could help create future deployment strategy. The solutions are all implemented in the cloud, using an agile development process.Job Description
Core Responsibilities:
Create, maintain, redesign data pipelinesCreate ETL from a variety of data sources using SQL and big data technologiesPerform data analysis to discover opportunities and address gapsAutomate any manual processesCreate scalable big data solutionsBuild reports to provide actionable insights from the dataPerform analysis for query optimizationWork with data Scientists/Wireless Engineers on WiFi CX optimization using AI/ML techniquesWork with stakeholders and executives to create the requirement for data related needsBuild business insights that could help create future deployment strategyQualifications:
This is a Senior Engineer (Engineer 4) role, which requires 7-10 years of relevant experienceThis team is based in our cutting-edge Comcast Technology Center in downtown Philadelphia, and collaborates in-person on a hybrid basis.7+ years of experience in Python7+ years of experience in custom ETL design, implementation and maintenance7+ years of experience in Database technologies, SQL, MySQL, Elastic search, ETLs and framework development.7+ years of experience with Data Modeling7+ years of experience working on Big Data7+ years of experience with data analysis and visualization, particularly Tableau, SplunkExperience processing large data setsStrong experience with Spark, Hive, Pig, Flume, Sqoop, Kafka, Amazon RDS, Amazon Redshift, GCPExperience with data quality and validationAdditional Responsibilities:
Develops data structures and pipelines aligned to established standards and guidelines to organize, collect, standardize and transform data that helps generate insights and address reporting needs.Focuses on ensuring data quality during ingest, processing as well as final load to the target tables.Creates standard ingestion frameworks for structured and unstructured data as well as checking and reporting on the quality of the data being processed.Creates standard methods for end users / downstream applications to consume data including but not limited to database views, extracts and Application Programming Interfaces.Develops and maintains information systems (e.g., data warehouses, data lakes) including data access Application Programming Interfaces.Participates in the implementation of solutions via data architecture, data engineering, or data manipulation on both on-prem platforms like Kubernetes and Teradata as well as Cloud platforms like Databricks.Determines the appropriate storage platform across different on-prem (minIO and Teradata) and Cloud (AWS S3, Redshift) depending on the privacy, access and sensitivity requirements.Understands the data lineage from source to the final semantic layer along with the transformation rules applied to enable faster troubleshooting and impact analysis during changes.Collaborates with technology and platform management partners to optimize data sourcing and processing rules to ensure appropriate data quality as well as process optimization.Creates and establishes design standards and assurance processes for software, systems and applications development to ensure compatibility and operability of data connections, flows and storage requirements. Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs.Develops strategies for data acquisition, archive recovery, and database implementation.Manages data migrations/conversions and troubleshooting data processing issues.Understands the data sensitivity, customer data privacy rules and regulations and applies them consistently in all Information Lifecycle Management activities.Identifies and reacts to system notification and log to ensure quality standards for databases and applications. Solves abstract problems beyond single development language or situation by reusing data file and flags already set.Solves critical issues and shares knowledge such as trends, aggregate, quantity volume regarding specific data sources.Consistent exercise of independent judgment and discretion in matters of significance.Employees at all levels are expected to:
Understand our Operating Principles; make them the guidelines for how you do your job.Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences.Win as a team - make big things happen by working together and being open to new ideas.Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.Drive results and growth.Respect and promote inclusion & diversity.Do what's right for each other, our customers, investors and our communities.Disclaimer: This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.Comcast is proud to be an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.Education
Bachelor's DegreeWhile possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.Relevant Work Experience
7-10 YearsBase pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality – to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.
#J-18808-Ljbffr