Senior Automation Engineer
Sigmaways Inc - San Francisco
Work at Sigmaways Inc
Overview
- View job
Overview
We are looking for a Sr. Automation Test Engineer Lead to design, build and test automated frameworks including the coding of reusable components and functions, integration of test frameworks.
Responsibilities:
- Determine, coordinate, and create necessary tests to ensure data and pipeline quality.
- Lead automated test strategies and guide decisions to successful implementation and completion.
- Design, develop and maintain robust, and efficient data pipelines to ingest, transform, catalog, and deliver curated, trusted and quality data from disparate data sources into Common Data Platform and making it available for comprehensive business analysis.
- Good understanding of data architecture, information security, data governance, develops processes to enforce standards.
- Proactively identifying and resolving issues with data pipelines and analytical data stores
- Deploying monitoring and alerting for data pipelines, data stores and implementing auto remediation wherever possible to ensure the availability and reliability of data systems.
- Employing security, testing and automation first strategy and adhering to data engineering best practices.
- As a member of the Agile delivery squad, actively participate in the various Agile rituals following the Scaled Agile processes and tools .
Qualifications:
- Typically requires Bachelor’s degree in computer science, Information Systems, or another related field.
- The Test Automation Engineer typically requires four or more years of test automation, data science, or software engineering experience. The Sr. Test Automation Engineer typically requires seven or more years of test automation, data science, or software engineering experience.
- 2+ years of experience with a modern data stack (Object stores like S3, Spark, Airflow, Lakehouse architectures, real-time databases)
- 2+ years of experience with automated test tools (Great Expectations, Lambda test, Selenium, Cucumber)
- Working as a Sr./Data Engineer with a good understanding of the associated technology landscape as well as the functional objectives.
- Experience building end to end data pipelines to ingest and process unstructured or semi-structured data using Spark architecture.
- Experience with data engineering including knowledge of Big Data ecosystem preferred.
- Strong desire and motivation to take up the potential challenges and opportunities as part of this exciting large and complex program with system wide visibility.
- Understanding of the automation strategies & techniques available for testing data, application, and CI/CD infrastructure.
- Demonstrates mutual respect, embraces diversity, equity and inclusion, and acts with authenticity.