JobRialto
Senior Data Engineer
JobRialto, Boston, Massachusetts, us, 02298
Job Summary
The Senior Data Engineer (Life and Annuity) will create and maintain an optimal data pipeline architecture, managing large, complex data sets to meet business requirements in the Life and Annuity domain. The role involves working with stakeholders to address data-related technical needs, optimizing infrastructure for scalability, and supporting data and analytics teams. The engineer will leverage AWS cloud services, SQL, and Python to enhance the data ecosystem and ensure secure data handling across multiple regions.
Key Responsibilities
• Develop and maintain data pipeline architecture, assembling large and complex data sets to support business requirements
• Identify and implement internal process improvements, including automating manual processes and optimizing data delivery
• Collaborate with stakeholders across Executive, Product, Data, and Design teams to address data infrastructure needs
• Ensure data security across national boundaries using multiple data centers and AWS regions
• Create tools for data analytics and data science teams to build and optimize innovative products
• Work with data and analytics experts to improve data system functionality and performance
Required Qualifications
• Strong experience with AWS cloud services (Lambda, Glue, S3, EMR, SNS, SQS, CloudWatch, Redshift)
• Proficiency in SQL and experience with relational databases (Oracle, MySQL, PostgreSQL)
• Proficient in Python programming for data engineering tasks and automation
• Experience with shell scripting in Linux/Unix environments
• Experience with Big Data technologies such as Hadoop and Spark
Preferred Qualifications
• Knowledge of machine learning models, regression, and validation techniques
Education:
Bachelors Degree
The Senior Data Engineer (Life and Annuity) will create and maintain an optimal data pipeline architecture, managing large, complex data sets to meet business requirements in the Life and Annuity domain. The role involves working with stakeholders to address data-related technical needs, optimizing infrastructure for scalability, and supporting data and analytics teams. The engineer will leverage AWS cloud services, SQL, and Python to enhance the data ecosystem and ensure secure data handling across multiple regions.
Key Responsibilities
• Develop and maintain data pipeline architecture, assembling large and complex data sets to support business requirements
• Identify and implement internal process improvements, including automating manual processes and optimizing data delivery
• Collaborate with stakeholders across Executive, Product, Data, and Design teams to address data infrastructure needs
• Ensure data security across national boundaries using multiple data centers and AWS regions
• Create tools for data analytics and data science teams to build and optimize innovative products
• Work with data and analytics experts to improve data system functionality and performance
Required Qualifications
• Strong experience with AWS cloud services (Lambda, Glue, S3, EMR, SNS, SQS, CloudWatch, Redshift)
• Proficiency in SQL and experience with relational databases (Oracle, MySQL, PostgreSQL)
• Proficient in Python programming for data engineering tasks and automation
• Experience with shell scripting in Linux/Unix environments
• Experience with Big Data technologies such as Hadoop and Spark
Preferred Qualifications
• Knowledge of machine learning models, regression, and validation techniques
Education:
Bachelors Degree