Principal Platform Engineer - GenAI (hybrid)

Principal Software Engineer - IE06GE

We’re determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals – and to help others accomplish theirs, too. Join our team as we help shape the future.

At the Hartford, we are seeking a Principal GEN AI Engineer who is responsible for building our GenAIOps (Internal Developer platform) to accelerate designing, developing, and deploying GenAI use cases, and drive innovation at scale.

This role requires versatility and expertise across a wide range of skills. Someone with a diverse background/experience and an engineer at heart will fit into this role seamlessly.

This role will have a Hybrid work arrangement, with the expectation of working in an office location (Charlotte, NC; Chicago, IL; Hartford, CT; Columbus, OH; Frisco, TX) 3 days a week (Tuesday through Thursday). Candidates must be authorized to work in the US without company sponsorship. The company will not support the STEM OPT I-983 Training Plan endorsement for this position.

Responsibilities:

• Design and build fault-tolerant solutions to support the Generative AI Ref architecture (RAG, Summarization, Agent etc).
• Ensure code is delivered without vulnerabilities by enforcing engineering practices, code scanning, etc.
• Build and maintain IAC (terraform/Cloud Formation), CICD (Jenkins) scripts, CodePipeline, uDeploy, & GitHub Actions.
• Partner with our shared service teams like Architecture, Cloud, Security, etc. to design and implement platform solutions.
• Collaborate with the DS team to develop a self-service internal developer Generative AI platform.
• Design and setup Guardrails for both responsible use of this technology and to prevent adversarial attacks and jailbreaks as well.
• Build the Observability stack for monitoring, logging, experiment tracking and replays.
• Design and build LLM agentic workflows integrating function calling, planning and self-reflection to build our next-gen Cognitive Architecture.
• Create templates (Architecture As Code) implementing Ref architecture application’s topology.
• Build a feedback system using HITL for Supervised fine-tuning.

Qualifications:

• Bachelor's degree in Computer Science, Computer Engineering, or a technical field.
• 10+ years of experience with AWS cloud.
• Extensive programming experience with Python, Typescript.
• At least 8 years of experience designing and building data-intensive solutions using distributed computing.
• 10+ years building and shipping software and/or platform infrastructure solutions for enterprises.
• Experience with CI/CD pipelines, Automated Testing, Automated Deployments, Agile methodologies, Unit Testing and Integration Testing tools.
• Experience with building scalable serverless applications (real-time / batch) on AWS stack (Lambda + step function).
• Knowledge of distributed NoSQL database systems.
• Experience with data engineering, ETL technology, and conversation UX is a plus.
• Experience with HPCs, vector embedding, and Hybrid/Semantic search technologies.
• Experience with AWS OpenSearch, Step/Lambda Functions, SageMaker, API Gateways, ECS/Docker is a plus.
• Proficiency in customization techniques across various stages of the RAG pipeline, including model fine-tuning, retrieval re-ranking, Hybrid search and multimodal RAG plus.
• Strong proficiency in embeddings, ANN/KNN, vector stores, quantization, database optimization, & performance tuning.
• Experience in building Agentic systems using frameworks like LangGraph and crewai is a plus.
• Experience with LLM orchestration frameworks like Langchain, LangSmith, LangGraph, LlamaIndex etc.
• Basic understanding of Natural Language Processing, vector space models and Deep Learning.
• Excellent problem-solving skills and the ability to work in a collaborative team environment.
• Excellent communication skills.

Compensation

The listed annualized base pay range is primarily based on analysis of similar positions in the external market. Actual base pay could vary and may be above or below the listed range based on factors including but not limited to performance, proficiency and demonstration of competencies required for the role. The base pay is just one component of The Hartford’s total compensation package for employees. Other rewards may include short-term or annual bonuses, long-term incentives, and on-the-spot recognition. The annualized base pay range for this role is:

$166,560 - $249,840

Equal Opportunity Employer

Females/Minorities/Veterans/Disability/Sexual Orientation/Gender Identity or Expression/Religion/Age