WEX
Senior Data Engineer
WEX, Chicago, Illinois, United States, 60290
(*) This is a remote position; however, the candidate must reside within 30 miles of one of the following locations:
Boston, MA; Chicago, IL; San Francisco Bay Area, CA; and Portland, ME.About the Team/RoleWe are the cloud data platform team at WEX. We empower businesses by providing cutting-edge data platforms and solutions that drive innovation and enhance decision-making. Our platform is built on a foundation of innovation, security, and scalability, and we are looking for a highly skilled and experienced Senior Data Engineer to join our dynamic team and help us continue to push the boundaries of what is possible.As a Senior Data Engineer
at WEX, you will drive the implementation and optimization of our cloud data platform. As a key member of our organization, you will play a critical role in designing and implementing industry-leading data solutions that meet the needs of our business. You will also play a pivotal role in architecting and implementing data solutions that underpin our data platform.As a Senior data engineer, you will be at the forefront of driving transformative change in our data engineering capabilities. You will leverage your product expertise, along with your extensive experience in AWS, Snowflake, Big Data technologies, and DataOps, to design and implement cutting-edge data solutions. Your role will involve making design decisions that optimize performance, scalability, and data governance while meeting the unique requirements of WEX.How you'll make an impactLead the design and implementation of scalable, robust, and high-performance data pipelines, ETL processes, and analytics solutions using AWS services, Snowflake, and other Big Data technologies.
Understanding of Data Warehousing/Data Lake/Data Lake House architecture
Collaborate closely with business stakeholders, data scientists, and other cross-functional teams to understand their requirements and translate them into innovative data solutions.
Optimizing with the capability to do performance-tune complex SQL queries on Snowflake along with a deep understanding of cost optimization strategies in Snowflake.
Working with Data Analysts to ensure that all data feeds are optimized and available at the required times. This can include Change Capture, Change Data Control, and other "delta loading" approaches.
Implement solutions for data integration, data management, metadata management, data processing, data security, and data quality, including technical delivery review, resolution of design issues, and the migration of the existing on-premises applications to the data platform.
Improve data discovery and usability with data tagging, cataloging, and ensuring accuracy, consistency, and reliability of data.
Experience you'll bringProficiency in data engineering
Strong expertise in designing and building scalable data pipelines, ETL processes, and analytics solutions using AWS services (e.g., S3, Glue, Lambda), ETL tools [ e.g., Informatica IDMC], and Snowflake.
Experience with increasing responsibilities implementing data solutions with a focus on Snowflake or similar warehouse
Good understanding of Cloud-based data solution components and architecture covering data ingestion, data processing, data cataloging, data optimization, security, DevOps, consumption, etc
Experience implementing core Snowflake concepts such as UDFs, zero-copy clones, time travel, micro partition, stored procedures, data import/export, and external tables focus on snowflake.
Experience with scripting language and governance tools (e.g., Alation, Collibra) will be an added advantage.
Exceptional communication and collaboration skills, with the ability to work effectively with senior stakeholders and cross-functional teams.
Extensive experience working with data related to the fintech industry, including knowledge of Rebates, commissions, and pricing and familiarity with how these processes integrate with other business operations such as sales and finance.
Knowledge of financial accounting principles relevant to rebates and commissions will be an added advantage.
Experience in software engineering with a strong background in software development, design patterns, and best practices.
Development experience with programming languages such as Java, Python, or Scala.
Strong understanding of code quality, version control, testing frameworks, and CI/CD pipelines
Required Qualifications:Bachelor in Computer Science or Equivalent with 10 years of experience in Data Engineering and data warehousing or Master with 7 years worth of experience in Data Engineering and data warehousing.
7+ Years of experience in PowerCenter/Informatica cloud (IICS) - Expert level knowledge & Experience in CDI and CAI.
Experience in API-based integration and real-time integration.
Knowledge of other Informatica products is always a plus.
The base pay range represents the anticipated low and high end of the pay range for this position. Actual pay rates will vary and will be based on various factors, such as your qualifications, skills, competencies, and proficiency for the role. Base pay is one component of WEX's total compensation package. Most sales positions are eligible for commission under the terms of an applicable plan. Non-sales roles are typically eligible for a quarterly or annual bonus based on their role and applicable plan. WEX's comprehensive and market competitive benefits are designed to support your personal and professional well-being. Benefits include health, dental and vision insurances, retirement savings plan, paid time off, health savings account, flexible spending accounts, life insurance, disability insurance, tuition reimbursement, and more. For more information, check out the "About Us" section. Pay Range: $117,000.00 - $156,000.00
Boston, MA; Chicago, IL; San Francisco Bay Area, CA; and Portland, ME.About the Team/RoleWe are the cloud data platform team at WEX. We empower businesses by providing cutting-edge data platforms and solutions that drive innovation and enhance decision-making. Our platform is built on a foundation of innovation, security, and scalability, and we are looking for a highly skilled and experienced Senior Data Engineer to join our dynamic team and help us continue to push the boundaries of what is possible.As a Senior Data Engineer
at WEX, you will drive the implementation and optimization of our cloud data platform. As a key member of our organization, you will play a critical role in designing and implementing industry-leading data solutions that meet the needs of our business. You will also play a pivotal role in architecting and implementing data solutions that underpin our data platform.As a Senior data engineer, you will be at the forefront of driving transformative change in our data engineering capabilities. You will leverage your product expertise, along with your extensive experience in AWS, Snowflake, Big Data technologies, and DataOps, to design and implement cutting-edge data solutions. Your role will involve making design decisions that optimize performance, scalability, and data governance while meeting the unique requirements of WEX.How you'll make an impactLead the design and implementation of scalable, robust, and high-performance data pipelines, ETL processes, and analytics solutions using AWS services, Snowflake, and other Big Data technologies.
Understanding of Data Warehousing/Data Lake/Data Lake House architecture
Collaborate closely with business stakeholders, data scientists, and other cross-functional teams to understand their requirements and translate them into innovative data solutions.
Optimizing with the capability to do performance-tune complex SQL queries on Snowflake along with a deep understanding of cost optimization strategies in Snowflake.
Working with Data Analysts to ensure that all data feeds are optimized and available at the required times. This can include Change Capture, Change Data Control, and other "delta loading" approaches.
Implement solutions for data integration, data management, metadata management, data processing, data security, and data quality, including technical delivery review, resolution of design issues, and the migration of the existing on-premises applications to the data platform.
Improve data discovery and usability with data tagging, cataloging, and ensuring accuracy, consistency, and reliability of data.
Experience you'll bringProficiency in data engineering
Strong expertise in designing and building scalable data pipelines, ETL processes, and analytics solutions using AWS services (e.g., S3, Glue, Lambda), ETL tools [ e.g., Informatica IDMC], and Snowflake.
Experience with increasing responsibilities implementing data solutions with a focus on Snowflake or similar warehouse
Good understanding of Cloud-based data solution components and architecture covering data ingestion, data processing, data cataloging, data optimization, security, DevOps, consumption, etc
Experience implementing core Snowflake concepts such as UDFs, zero-copy clones, time travel, micro partition, stored procedures, data import/export, and external tables focus on snowflake.
Experience with scripting language and governance tools (e.g., Alation, Collibra) will be an added advantage.
Exceptional communication and collaboration skills, with the ability to work effectively with senior stakeholders and cross-functional teams.
Extensive experience working with data related to the fintech industry, including knowledge of Rebates, commissions, and pricing and familiarity with how these processes integrate with other business operations such as sales and finance.
Knowledge of financial accounting principles relevant to rebates and commissions will be an added advantage.
Experience in software engineering with a strong background in software development, design patterns, and best practices.
Development experience with programming languages such as Java, Python, or Scala.
Strong understanding of code quality, version control, testing frameworks, and CI/CD pipelines
Required Qualifications:Bachelor in Computer Science or Equivalent with 10 years of experience in Data Engineering and data warehousing or Master with 7 years worth of experience in Data Engineering and data warehousing.
7+ Years of experience in PowerCenter/Informatica cloud (IICS) - Expert level knowledge & Experience in CDI and CAI.
Experience in API-based integration and real-time integration.
Knowledge of other Informatica products is always a plus.
The base pay range represents the anticipated low and high end of the pay range for this position. Actual pay rates will vary and will be based on various factors, such as your qualifications, skills, competencies, and proficiency for the role. Base pay is one component of WEX's total compensation package. Most sales positions are eligible for commission under the terms of an applicable plan. Non-sales roles are typically eligible for a quarterly or annual bonus based on their role and applicable plan. WEX's comprehensive and market competitive benefits are designed to support your personal and professional well-being. Benefits include health, dental and vision insurances, retirement savings plan, paid time off, health savings account, flexible spending accounts, life insurance, disability insurance, tuition reimbursement, and more. For more information, check out the "About Us" section. Pay Range: $117,000.00 - $156,000.00