Worldpay
Senior Data Engineer - Python Airflow
Worldpay, Cincinnati, Ohio, United States, 45208
Job DescriptionAre you ready to write your next chapter?Make your mark at one of the biggest names in payments. With proven technology, we process the largest volume of payments in the world, driving the global economy every day. When you join Worldpay, you join a global community of experts and changemakers, working to reinvent an industry by constantly evolving how we work and making the way millions of people pay easier, every day.What makes a Worldpayer? It’s simple: Think, Act, Win. We stay curious, always asking the right questions to be better every day, finding creative solutions to simplify the complex. We’re dynamic, every Worldpayer is empowered to make the right decisions for their customers. And we’re determined, always staying open – winning and failing as one.We’re looking for a
Senior Data Engineer – Python Airflow
to join our ever evolving
Cloud Data Platform team
to help us unleash the potential of every business.Are you ready to make your mark? Then you sound like a Worldpayer.About The Team
Worldpay Cloud Data Platform team provides WorldPay Big Data capabilities including large scale data processing, analytics, fraud platforms, machine learning engineering, stream processing and data insights. Worldpay Cloud Data Platform team help maintain and advance cloud data platforms and services to build data products powering our business services and customers.What You’ll Own
Develop and implement strategies for data engineering initiatives using Python, AWS, Airflow, and Snowflake technologiesMonitor trends in the data engineering industry and stay up to date on current technologiesCollaborate with product team to develop solutions that meet their goals and objectivesAct as a subject matter expert for Apache Airflow and provide technical guidance to team membersInstall, configure, and maintain Astronomer Airflow environmentsBuild complex data engineering pipelines using Python and AirflowDesign, develop, and maintain scalable workflows and orchestration systems using AstronomerCreate and manage Directed Acyclic Graphs (DAGs) to automate data pipelines and processesLeverage AWS Glue, Step Functions, and other services for orchestrating data workflowsDevelop custom operators and plugins for Astronomer to extend its capabilitiesIntegrate code with defined CI/CD framework and AWS services required for building secure data pipelineManage user access and permissions, ensuring data security and compliance with company policiesImplement and monitor security controls, including encryption, authentication, and network securityConduct regular security audits and vulnerability assessmentsManage data ingestion and ETL processesAutomate routine tasks and processes using scripting and automation toolsMaintain comprehensive documentation for configurations, procedures, and troubleshooting stepsWhat You Bring
5+ yrs in a pivotal Software/Data Engineering role with deep exposure to modern data stacks, particularly Snowflake, Airflow, DBT, and AWS data servicesProficiency in cloud platforms such as AWS, Azure, or Google CloudExperience with PySpark/Hadoop and/or AWS Glue ETL and/or Databricks w/ python is preferred. Must have experience on ETL development life cycle, best practices of ETL pipelines, thorough work experience on data warehouse using combination of Python, Snowflake & AWS ServicesData engineering experience with AWS Services (S3, Lambda, Glue, Lake Formation, EMR), Kafka, Streaming, Databricks is highly preferredExperience in Astronomer and/or AirflowUnderstanding data pipelines and modern ways of automating data pipeline using cloud-based testing and clearly document implementations, so others can easily understand the requirements, implementation, and test conditionsStrong experience with Amazon Web Services (AWS) accounts and high-level usage monitoringProficiency in scripting languages such as Python, Bash, or PowerShellExperience with CI/CD tools like Jenkins, GitLab CI, CircleCI, or similarFamiliarity with monitoring and logging tools (e.g., Prometheus, Grafana, ELK stack)Excellent problem-solving skills and attention to detailStrong communication skills and the ability to work collaboratively in a team environmentExperience with AWS CLI and NetworkingExperience with architecting and maintaining high availability production systemsExperience with developing monitoring architecture and implementing monitoring agents, dashboards, escalations, and alertsKnowledge of security controls for the public cloud (encryption of data in motion/rest and key management)Demonstrated knowledge and hands-on experience with AWS alerting/monitoring toolsExperience with infrastructure as code (IaC) tools such as TerraformAWS certificationAirflow CertificationPython CertificationWorldpay Perks - What We’ll Bring For You
We know it’s bigger than just your career. It’s your life, and your world. That’s why we offer global benefits and programs to support you at every stage. Here’s a taste of what you can expect.A competitive salary and benefitsTime to support charities and give back to your communityParental leave policyGlobal recognition platformVirgin Pulse accessGlobal employee assistance programWhat Makes A Worldpayer
At Worldpay, we take our Values seriously, and we live them every day. Think like a customer, Act like an owner, and Win as a team.Curious. Humble. Creative. We ask the right questions, listening and learning to get better every day. We simplify the complex and we’re always looking to create a bigger impact for our colleagues and customers.Empowered. Accountable. Dynamic. We stay agile, using our initiative, taking calculated risks to progress. Never standing still, never settling, we work at pace to achieve our goals. We champion our ideas and stay flexible to make them happen. We know that every action adds up.Determined. Inclusive. Open. Unlocking potential means working as one global community. Our work spans borders, and we stay united by our purpose. We collaborate, always encouraging others to perform at their best, welcoming new perspectives.Does this sound like you? Then you sound like a Worldpayer.Apply now to write the next chapter in your career. We can’t wait to hear from you.To find out more about working with us, find us on LinkedIn.Worldpay is committed to providing its employees with an exciting career opportunity and competitive compensation. The pay range for this full-time position is $105,070.00 - $176,520.00 and reflects the minimum and maximum target for new hire salaries for this position based on the posted role, level, and location. Within the range, actual individual starting pay is determined by additional factors, including job-related skills, experience, and relevant education or training. Any changes in work location will also impact actual individual starting pay. Please consult with your recruiter about the specific salary range for your preferred location during the hiring process.Privacy StatementWorldpay is committed to protecting the privacy and security of all personal information that we process in order to provide services to our clients. For specific information on how Worldpay protects personal information online, please see the Online Privacy Notice.EEOC StatementWorldpay is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, marital status, genetic information, national origin, disability, veteran status, and other protected characteristics.Sourcing ModelRecruitment at Worldpay works primarily on a direct sourcing model; a relatively small portion of our hiring is through recruitment agencies. Worldpay does not accept resumes from recruitment agencies which are not on the preferred supplier list and is not responsible for any related fees for resumes submitted to job postings, our employees, or any other part of our company.
#J-18808-Ljbffr
Senior Data Engineer – Python Airflow
to join our ever evolving
Cloud Data Platform team
to help us unleash the potential of every business.Are you ready to make your mark? Then you sound like a Worldpayer.About The Team
Worldpay Cloud Data Platform team provides WorldPay Big Data capabilities including large scale data processing, analytics, fraud platforms, machine learning engineering, stream processing and data insights. Worldpay Cloud Data Platform team help maintain and advance cloud data platforms and services to build data products powering our business services and customers.What You’ll Own
Develop and implement strategies for data engineering initiatives using Python, AWS, Airflow, and Snowflake technologiesMonitor trends in the data engineering industry and stay up to date on current technologiesCollaborate with product team to develop solutions that meet their goals and objectivesAct as a subject matter expert for Apache Airflow and provide technical guidance to team membersInstall, configure, and maintain Astronomer Airflow environmentsBuild complex data engineering pipelines using Python and AirflowDesign, develop, and maintain scalable workflows and orchestration systems using AstronomerCreate and manage Directed Acyclic Graphs (DAGs) to automate data pipelines and processesLeverage AWS Glue, Step Functions, and other services for orchestrating data workflowsDevelop custom operators and plugins for Astronomer to extend its capabilitiesIntegrate code with defined CI/CD framework and AWS services required for building secure data pipelineManage user access and permissions, ensuring data security and compliance with company policiesImplement and monitor security controls, including encryption, authentication, and network securityConduct regular security audits and vulnerability assessmentsManage data ingestion and ETL processesAutomate routine tasks and processes using scripting and automation toolsMaintain comprehensive documentation for configurations, procedures, and troubleshooting stepsWhat You Bring
5+ yrs in a pivotal Software/Data Engineering role with deep exposure to modern data stacks, particularly Snowflake, Airflow, DBT, and AWS data servicesProficiency in cloud platforms such as AWS, Azure, or Google CloudExperience with PySpark/Hadoop and/or AWS Glue ETL and/or Databricks w/ python is preferred. Must have experience on ETL development life cycle, best practices of ETL pipelines, thorough work experience on data warehouse using combination of Python, Snowflake & AWS ServicesData engineering experience with AWS Services (S3, Lambda, Glue, Lake Formation, EMR), Kafka, Streaming, Databricks is highly preferredExperience in Astronomer and/or AirflowUnderstanding data pipelines and modern ways of automating data pipeline using cloud-based testing and clearly document implementations, so others can easily understand the requirements, implementation, and test conditionsStrong experience with Amazon Web Services (AWS) accounts and high-level usage monitoringProficiency in scripting languages such as Python, Bash, or PowerShellExperience with CI/CD tools like Jenkins, GitLab CI, CircleCI, or similarFamiliarity with monitoring and logging tools (e.g., Prometheus, Grafana, ELK stack)Excellent problem-solving skills and attention to detailStrong communication skills and the ability to work collaboratively in a team environmentExperience with AWS CLI and NetworkingExperience with architecting and maintaining high availability production systemsExperience with developing monitoring architecture and implementing monitoring agents, dashboards, escalations, and alertsKnowledge of security controls for the public cloud (encryption of data in motion/rest and key management)Demonstrated knowledge and hands-on experience with AWS alerting/monitoring toolsExperience with infrastructure as code (IaC) tools such as TerraformAWS certificationAirflow CertificationPython CertificationWorldpay Perks - What We’ll Bring For You
We know it’s bigger than just your career. It’s your life, and your world. That’s why we offer global benefits and programs to support you at every stage. Here’s a taste of what you can expect.A competitive salary and benefitsTime to support charities and give back to your communityParental leave policyGlobal recognition platformVirgin Pulse accessGlobal employee assistance programWhat Makes A Worldpayer
At Worldpay, we take our Values seriously, and we live them every day. Think like a customer, Act like an owner, and Win as a team.Curious. Humble. Creative. We ask the right questions, listening and learning to get better every day. We simplify the complex and we’re always looking to create a bigger impact for our colleagues and customers.Empowered. Accountable. Dynamic. We stay agile, using our initiative, taking calculated risks to progress. Never standing still, never settling, we work at pace to achieve our goals. We champion our ideas and stay flexible to make them happen. We know that every action adds up.Determined. Inclusive. Open. Unlocking potential means working as one global community. Our work spans borders, and we stay united by our purpose. We collaborate, always encouraging others to perform at their best, welcoming new perspectives.Does this sound like you? Then you sound like a Worldpayer.Apply now to write the next chapter in your career. We can’t wait to hear from you.To find out more about working with us, find us on LinkedIn.Worldpay is committed to providing its employees with an exciting career opportunity and competitive compensation. The pay range for this full-time position is $105,070.00 - $176,520.00 and reflects the minimum and maximum target for new hire salaries for this position based on the posted role, level, and location. Within the range, actual individual starting pay is determined by additional factors, including job-related skills, experience, and relevant education or training. Any changes in work location will also impact actual individual starting pay. Please consult with your recruiter about the specific salary range for your preferred location during the hiring process.Privacy StatementWorldpay is committed to protecting the privacy and security of all personal information that we process in order to provide services to our clients. For specific information on how Worldpay protects personal information online, please see the Online Privacy Notice.EEOC StatementWorldpay is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, marital status, genetic information, national origin, disability, veteran status, and other protected characteristics.Sourcing ModelRecruitment at Worldpay works primarily on a direct sourcing model; a relatively small portion of our hiring is through recruitment agencies. Worldpay does not accept resumes from recruitment agencies which are not on the preferred supplier list and is not responsible for any related fees for resumes submitted to job postings, our employees, or any other part of our company.
#J-18808-Ljbffr