WEX, Inc.
Staff Engineer, Data Lake Engineering
WEX, Inc., San Francisco, California, United States, 94199
This is a remote position; however, the candidate must reside within 30 miles of one of the following locations: Portland, ME; Boston, MA; Chicago, IL; and San Francisco Bay Area, CA.About the Team/Role:The Data Lake Engineering team at WEX builds a unified, scalable data platform supporting AI and machine learning applications across the company. They collaborate with departments like Data & Analytics, Security, and Risk to enhance data accessibility, scalability, and innovation, aiming to drive WEX's tech transformation and support a growing customer base.
The Staff Engineer, Data Lake Engineering, will lead the technical architecture and development of WEX's Data Lake platform. Reporting to the VP of Data Lake and AI Engineering, they'll ensure quality, security, and scalability while integrating with company-wide platforms. The ideal candidate brings deep expertise in data lake environments and hands-on leadership skills.How you'll make an impactLead and drive the development of technology and platform for the company's Data Lake needs, ensuring functional richness, reliability, performance, and flexibility.Help design the architecture and lead the implementation of the Data Lake platform and services.Challenge the status quo and drive for better technical solutions to effectively serve the needs in the broad risk area of WEX.Guide your team to leverage data and/or AI technology or tools in your design and development for high productivity and better solution quality.Partner closely with other senior engineers across the organization to understand business needs and develop technical solutions.Ensure the security and privacy of data, implementing encryption and access controls as required.Collaborate with solutions architecture and product engineering teams on integrations of the Data Lake Platform.Engage with external partners and vendors to evaluate technologies and services that complement the company's Data Lake strategy.Create, prioritize, communicate, manage, and execute roadmaps and project plans.Report on the status of development, quality, operations, and system performance to management and partners.Drive the technical vision and strategy of Data Lake to serve business needs.Provide technical guidance and mentorship to engineering teams, fostering an environment of continuous learning and innovation.Set clear, measurable quality goals for your group.Partner with security and SRE teams to ensure continuous improvement and meet security requirements.Take financial responsibility for your team.Hold yourself and your team accountable for delivering quality results using defined OKRs.Advise senior leadership on complex situations impacting the organization.Provide strategic thought leadership on business initiatives using your deep technical and industry expertise.Experience you'll bringA technically deep and innovative Software Engineer with 10+ years of software design and development experience.Strong software development skills in programming languages, with readiness to learn Java and Python.Broad understanding of Data Lakehouse formats like Apache Hudi, Apache Iceberg, or Delta Lake.Demonstrable experience in Spark programming.Experience with Spark on DBT with AWS Glue or Apache Polaris.Understanding of cloud architecture tools and services, particularly AWS and Azure.Hands-on experience in architecture design, development, deployment, and production operation.Rich experience in Big Data and large scale data platforms, especially in Data Lake.Understanding of CI/CD automation.Experience in leading teams for effective development using agile practices.Excellent analytical skills for problem identification and resolution.Understanding of payment organizations is a plus.Ability to mentor individuals of varying seniority levels.Strong written and verbal communication skills.Bachelor's degree in Computer Science or a related field; higher degree is a plus.Leadership & Personal CharacteristicsDemonstrates a collaborative, engaging, mission-driven style with good listening skills.Champions a culture of high standards and embraces change.Able to operate in a fast-paced environment with a hands-on approach.Leads with empathy and promotes a culture of trust and inclusion.Communicates effectively in various formats.Talent developer and talent scout, managing diverse teams to drive engagement.Possesses a high level of intellectual curiosity and learning agility.Understands how to drive change through influence across a complex business.The base pay range represents the anticipated low and high end of the pay range for this position. Actual pay rates will vary based on qualifications, skills, and competencies. WEX's total compensation package includes various benefits designed to support personal and professional well-being.Pay Range: $134,000.00 - $178,000.00
#J-18808-Ljbffr
The Staff Engineer, Data Lake Engineering, will lead the technical architecture and development of WEX's Data Lake platform. Reporting to the VP of Data Lake and AI Engineering, they'll ensure quality, security, and scalability while integrating with company-wide platforms. The ideal candidate brings deep expertise in data lake environments and hands-on leadership skills.How you'll make an impactLead and drive the development of technology and platform for the company's Data Lake needs, ensuring functional richness, reliability, performance, and flexibility.Help design the architecture and lead the implementation of the Data Lake platform and services.Challenge the status quo and drive for better technical solutions to effectively serve the needs in the broad risk area of WEX.Guide your team to leverage data and/or AI technology or tools in your design and development for high productivity and better solution quality.Partner closely with other senior engineers across the organization to understand business needs and develop technical solutions.Ensure the security and privacy of data, implementing encryption and access controls as required.Collaborate with solutions architecture and product engineering teams on integrations of the Data Lake Platform.Engage with external partners and vendors to evaluate technologies and services that complement the company's Data Lake strategy.Create, prioritize, communicate, manage, and execute roadmaps and project plans.Report on the status of development, quality, operations, and system performance to management and partners.Drive the technical vision and strategy of Data Lake to serve business needs.Provide technical guidance and mentorship to engineering teams, fostering an environment of continuous learning and innovation.Set clear, measurable quality goals for your group.Partner with security and SRE teams to ensure continuous improvement and meet security requirements.Take financial responsibility for your team.Hold yourself and your team accountable for delivering quality results using defined OKRs.Advise senior leadership on complex situations impacting the organization.Provide strategic thought leadership on business initiatives using your deep technical and industry expertise.Experience you'll bringA technically deep and innovative Software Engineer with 10+ years of software design and development experience.Strong software development skills in programming languages, with readiness to learn Java and Python.Broad understanding of Data Lakehouse formats like Apache Hudi, Apache Iceberg, or Delta Lake.Demonstrable experience in Spark programming.Experience with Spark on DBT with AWS Glue or Apache Polaris.Understanding of cloud architecture tools and services, particularly AWS and Azure.Hands-on experience in architecture design, development, deployment, and production operation.Rich experience in Big Data and large scale data platforms, especially in Data Lake.Understanding of CI/CD automation.Experience in leading teams for effective development using agile practices.Excellent analytical skills for problem identification and resolution.Understanding of payment organizations is a plus.Ability to mentor individuals of varying seniority levels.Strong written and verbal communication skills.Bachelor's degree in Computer Science or a related field; higher degree is a plus.Leadership & Personal CharacteristicsDemonstrates a collaborative, engaging, mission-driven style with good listening skills.Champions a culture of high standards and embraces change.Able to operate in a fast-paced environment with a hands-on approach.Leads with empathy and promotes a culture of trust and inclusion.Communicates effectively in various formats.Talent developer and talent scout, managing diverse teams to drive engagement.Possesses a high level of intellectual curiosity and learning agility.Understands how to drive change through influence across a complex business.The base pay range represents the anticipated low and high end of the pay range for this position. Actual pay rates will vary based on qualifications, skills, and competencies. WEX's total compensation package includes various benefits designed to support personal and professional well-being.Pay Range: $134,000.00 - $178,000.00
#J-18808-Ljbffr