Photon
Stream Infra Engineer- (Sr Engineer, Analytics- Streaming)- United States
Photon, Young America, MN
Job Description
Greetings Everyone
Sr Engineer, Analytics (Streaming)
Job Summary:
We are seeking an experienced Senior Engineer, Analytics with a focus on Streaming to join our team. As a Senior Engineer, you will play a key role in designing, building, and maintaining our real-time analytics infrastructure. You will work closely with our data scientists, product managers, and other engineers to develop and deploy scalable, efficient, and reliable data pipelines.
Responsibilities:
Requirements:
Sr Engineer, Analytics (Batching)
Who are we?
For the past 20 years, we have powered many Digital Experiences for the Fortune 500. Since 1999, we have grown from a few people to more than 4000 team members across the globe that are engaged in various Digital Modernization. For a brief 1 minute video about us, you can check https://youtu.be/uJWBWQZEA6o.
What will you do?
What are we looking for?
Greetings Everyone
Sr Engineer, Analytics (Streaming)
Job Summary:
We are seeking an experienced Senior Engineer, Analytics with a focus on Streaming to join our team. As a Senior Engineer, you will play a key role in designing, building, and maintaining our real-time analytics infrastructure. You will work closely with our data scientists, product managers, and other engineers to develop and deploy scalable, efficient, and reliable data pipelines.
Responsibilities:
- Design, build, and maintain large-scale streaming data pipelines using technologies such as Apache Beam, Apache Kafka, Apache Kinesis, Google Cloud Pub/Sub, and Google Cloud DataFlow
- Develop and implement streaming data processing jobs using programming languages like Java or Python. (Experience with both is a plus)
- Work with data scientists and product managers to develop and deploy real-time analytics applications
- Collaborate with other engineers to integrate streaming data pipelines with our data warehouse and data lake
- Work with public cloud providers such as Google Cloud Platform (GCP), Amazon Web Services (AWS), or Microsoft Azure
- Monitor and troubleshoot streaming pipelines to ensure high availability and performance.
- Implement DevOps principles and practices to ensure efficient and reliable deployment of batch processing systems
- Knowledge of containerization technologies such as Docker and Kubernetes
Requirements:
- Bachelor's degree in Computer Science or a related field
- 5+ years of experience in software engineering, with a focus on streaming data pipelines and analytics
- Strong programming skills in Java or Python
- Experience with a public cloud provider, with a focus on GCP
- Strong experience with messaging/stream processing systems such as Apache Kafka, Apache Kinesis, Google Cloud Pub/Sub, and Google Cloud DataFlow
- Experience with data warehousing and data lake technologies
- Strong understanding of data modeling, data governance, and data security
- Excellent problem-solving skills, with the ability to work independently and collaboratively
- Excellent communication skills, with the ability to explain complex technical concepts to non-technical stakeholders
- Experience with machine learning and data science technologies is a plus
- Certification in a public cloud provider or a relevant technology is a plus
Sr Engineer, Analytics (Batching)
Who are we?
For the past 20 years, we have powered many Digital Experiences for the Fortune 500. Since 1999, we have grown from a few people to more than 4000 team members across the globe that are engaged in various Digital Modernization. For a brief 1 minute video about us, you can check https://youtu.be/uJWBWQZEA6o.
What will you do?
- List out the Instructions
What are we looking for?
- List out the Instructions