Motion Recruitment
Senior Platform Engineer - Data Infrastructure
Motion Recruitment, Boston, Massachusetts, us, 02298
Our client is a leading consumer product company focused on delivering high-quality goods and using advanced sales data analytics to predict consumer behavior. By leveraging modern cloud technologies and data-driven insights, we empower our customers and stay ahead of market trends. We are looking for a Senior Platform Engineer to join our dynamic engineering team and help drive the future of our platform infrastructure.
As a Senior Platform Engineer, you will be instrumental in designing, building, and maintaining scalable, secure, and resilient infrastructure on AWS. You will play a key role in ensuring that our systems are optimized for data flow and processing while helping the company efficiently utilize sales data for predictive analytics. You will work closely with data engineers, DevOps, and software development teams to create an efficient and reliable platform to support our evolving business needs.
Key Responsibilities :
Design, develop, and maintain scalable cloud infrastructure using AWS, Kubernetes, and Terraform.Collaborate with engineering and data teams to build and optimize the infrastructure for data pipelines, ensuring efficient and secure handling of large-scale consumer and sales data.Implement and manage container orchestration using Kubernetes for automated deployments, scaling, and operations.Design, build, and maintain Kafka clusters for real-time data streaming and Apache Airflow for workflow orchestration.Develop infrastructure-as-code (IaC) with Terraform to manage multi-environment deployments and scale the platform efficiently.Work closely with development teams to support continuous integration/continuous delivery (CI/CD) pipelines and ensure smooth deployment processes.Monitor platform performance, identify issues, and implement necessary improvements for performance, cost, and security optimization.Ensure platform infrastructure is highly secure, reliable, and compliant with best practices and industry regulations.Mentor and guide junior engineers on best practices for infrastructure and platform development.Requirements :
Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience).5+ years of experience in platform engineering, DevOps, or a similar role.Strong experience with AWS services (EC2, S3, RDS, Lambda, etc.).Expertise in containerization and orchestration technologies, especially Kubernetes.Solid experience with Terraform for infrastructure-as-code.Experience working with streaming platforms like Apache Kafka.Strong knowledge of Apache Airflow for workflow automation.Proficiency in Python for automation and scripting.Experience with monitoring and alerting tools (e.g., Prometheus, Grafana, CloudWatch).Familiarity with CI/CD tools like Jenkins, CircleCI, or AWS CodePipeline.Excellent problem-solving skills, with a focus on scalability, performance, and security.Nice to Have :
Experience with machine learning or data science workflows.Experience working in the consumer products industry or familiarity with retail/e-commerce platforms.Knowledge of data lakes, data warehouses, and data pipeline architectures.Certifications in AWS or Kubernetes.Benefits :
Competitive salary and bonus structureComprehensive health, dental, and vision coverage401(k) with company matchFlexible work hours and remote work optionsProfessional development and certification reimbursementGenerous vacation policy
Posted by:
Matthew Durkin
Specialization:
DevOps
As a Senior Platform Engineer, you will be instrumental in designing, building, and maintaining scalable, secure, and resilient infrastructure on AWS. You will play a key role in ensuring that our systems are optimized for data flow and processing while helping the company efficiently utilize sales data for predictive analytics. You will work closely with data engineers, DevOps, and software development teams to create an efficient and reliable platform to support our evolving business needs.
Key Responsibilities :
Design, develop, and maintain scalable cloud infrastructure using AWS, Kubernetes, and Terraform.Collaborate with engineering and data teams to build and optimize the infrastructure for data pipelines, ensuring efficient and secure handling of large-scale consumer and sales data.Implement and manage container orchestration using Kubernetes for automated deployments, scaling, and operations.Design, build, and maintain Kafka clusters for real-time data streaming and Apache Airflow for workflow orchestration.Develop infrastructure-as-code (IaC) with Terraform to manage multi-environment deployments and scale the platform efficiently.Work closely with development teams to support continuous integration/continuous delivery (CI/CD) pipelines and ensure smooth deployment processes.Monitor platform performance, identify issues, and implement necessary improvements for performance, cost, and security optimization.Ensure platform infrastructure is highly secure, reliable, and compliant with best practices and industry regulations.Mentor and guide junior engineers on best practices for infrastructure and platform development.Requirements :
Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience).5+ years of experience in platform engineering, DevOps, or a similar role.Strong experience with AWS services (EC2, S3, RDS, Lambda, etc.).Expertise in containerization and orchestration technologies, especially Kubernetes.Solid experience with Terraform for infrastructure-as-code.Experience working with streaming platforms like Apache Kafka.Strong knowledge of Apache Airflow for workflow automation.Proficiency in Python for automation and scripting.Experience with monitoring and alerting tools (e.g., Prometheus, Grafana, CloudWatch).Familiarity with CI/CD tools like Jenkins, CircleCI, or AWS CodePipeline.Excellent problem-solving skills, with a focus on scalability, performance, and security.Nice to Have :
Experience with machine learning or data science workflows.Experience working in the consumer products industry or familiarity with retail/e-commerce platforms.Knowledge of data lakes, data warehouses, and data pipeline architectures.Certifications in AWS or Kubernetes.Benefits :
Competitive salary and bonus structureComprehensive health, dental, and vision coverage401(k) with company matchFlexible work hours and remote work optionsProfessional development and certification reimbursementGenerous vacation policy
Posted by:
Matthew Durkin
Specialization:
DevOps