GM Financial
Data Engineer II - ABS Data Analytics & Reporting Finance
GM Financial, Fort Worth, Texas, United States, 76102
NOTE: We are unable to offer sponsorship for this positionWhy GM Financial?GM Financial is the wholly owned captive finance subsidiary of General Motors and is headquartered in Fort Worth, U.S. We are a global provider of auto finance solutions, with operations in North America, South America and the Asia Pacific region. Through our long-standing relationships with auto dealers, we offer attractive retail financing and lease programs to meet the needs of each customer. We also offer commercial lending products to dealers to help them finance and grow their businesses.At GM Financial, our team members define and shape our culture — an environment that welcomes new ideas, fosters integrity and creates a sense of community and belonging. Here we do more than work — we thrive.Our Purpose: We pioneer the innovations that move and connect people to what matters.Responsibilities
About the role:ABS Data Engineer II, Finance is a critical technical role within the GMF North America Securitization and Conduit Reporting team. This position will be helping ABS reporting team in building and maintaining reliable and scalable data pipelines. This position will leverage your expertise in Python, SQL, and Azure cloud technologies to extract, transform, and load data efficiently, enabling seamless data access and analysis for accounting business users. This position involves a high level of coordination with other departments and third-party software vendors.JOB DUTIES
Code, test, deploy, orchestrate, monitor, document and implement data pipelines utilizing the Microsoft Azure Data Bricks platform.Utilize technologies like Spark, Delta Lake and Unity Catalog for efficient data processing and governance.Implement the Medallion architecture pattern for robust and modular data pipelines.Implement CI/CD pipelines for automated testing and deployment of data pipelines using Azure DevOps.Configure and manage Azure Data Lake Storage for secure and scalable data storage.Collaborate and work closely with ABS data analysts, accounting business partners to identify, capture, collect and format data from the external sources, internal systems and data warehouse to extract features of interest.Monitor and optimize data pipelines for performance and reliability.Stay up-to-date with the latest advancements in Databricks, Azure, and big data technologies.Educate and develop ETL developers on data engineering cloud-based initiatives to enable transition to data engineer and practice.Monitor the production reporting environment on a daily and monthly basis to analyze data and make business decisions on the data.Qualifications
What makes you a dream candidate?Experience with Databricks platform on Microsoft Azure.Experience with processing large datasets using Hadoop, Spark, Kafka or similar distributed systems.Experience with PySpark and distributed data processing frameworks.Understanding of cloud computing technologies, business drivers and emerging computing trends.Experience with ingesting various source data formats such as JSON, Parquet, Sequencefile, Cloud databases, MQ, Relational databases such as Oracle.Working knowledge of Object Storage technologies to include but not limited to Data Lake Storage Gen2, ADLS etc.Working knowledge of Unity Catalog and data governance principles.Working knowledge of Agile development/SAFe, Scrum and Application Lifecycle Management.Strong background with source control management systems (GIT or Subversion); Build Systems (Maven, Gradle, Webpack); Code Quality (Sonar); Artifact Repository Managers (Artifactory), Continuous Integration/Continuous Deployment (Azure DevOps).Experience with Python and SQL.Creating and maintaining ETL processes and data pipelines.Knowledgeable of best practices in information technology governance and privacy compliance.Knowledge on auto finance industries core business functions.Ability to establish priorities and meet tight deadlines.Ability to interact collaboratively with internal customers.Demonstrated quantitative skills and data analytical skills.Solid design, coding, testing and debugging skills.Experience and Education
4-6 years of hands-on experience with data engineering required.3-5 years of hands-on experience with processing large data sets required.3-5 years of hands-on experience with SQL, data modeling, relational databases and/or NoSQL databases required.Bachelor’s Degree in related field or equivalent work experience required.What We Offer:
Generous benefits package available on day one to include: 401K matching, bonding leave for new parents (12 weeks, 100% paid), tuition assistance, training, GM employee auto discount, community service pay and nine company holidays.Our Culture:
Our team members define and shape our culture — an environment that welcomes innovative ideas, fosters integrity, and creates a sense of community and belonging. Here we do more than work — we thrive.Compensation:
Competitive pay and bonus eligibility.Work Life Balance:
Flexible hybrid work environment, minimum of 2 days a week in office in Fort Worth, Texas.#LI-SC1
#J-18808-Ljbffr
About the role:ABS Data Engineer II, Finance is a critical technical role within the GMF North America Securitization and Conduit Reporting team. This position will be helping ABS reporting team in building and maintaining reliable and scalable data pipelines. This position will leverage your expertise in Python, SQL, and Azure cloud technologies to extract, transform, and load data efficiently, enabling seamless data access and analysis for accounting business users. This position involves a high level of coordination with other departments and third-party software vendors.JOB DUTIES
Code, test, deploy, orchestrate, monitor, document and implement data pipelines utilizing the Microsoft Azure Data Bricks platform.Utilize technologies like Spark, Delta Lake and Unity Catalog for efficient data processing and governance.Implement the Medallion architecture pattern for robust and modular data pipelines.Implement CI/CD pipelines for automated testing and deployment of data pipelines using Azure DevOps.Configure and manage Azure Data Lake Storage for secure and scalable data storage.Collaborate and work closely with ABS data analysts, accounting business partners to identify, capture, collect and format data from the external sources, internal systems and data warehouse to extract features of interest.Monitor and optimize data pipelines for performance and reliability.Stay up-to-date with the latest advancements in Databricks, Azure, and big data technologies.Educate and develop ETL developers on data engineering cloud-based initiatives to enable transition to data engineer and practice.Monitor the production reporting environment on a daily and monthly basis to analyze data and make business decisions on the data.Qualifications
What makes you a dream candidate?Experience with Databricks platform on Microsoft Azure.Experience with processing large datasets using Hadoop, Spark, Kafka or similar distributed systems.Experience with PySpark and distributed data processing frameworks.Understanding of cloud computing technologies, business drivers and emerging computing trends.Experience with ingesting various source data formats such as JSON, Parquet, Sequencefile, Cloud databases, MQ, Relational databases such as Oracle.Working knowledge of Object Storage technologies to include but not limited to Data Lake Storage Gen2, ADLS etc.Working knowledge of Unity Catalog and data governance principles.Working knowledge of Agile development/SAFe, Scrum and Application Lifecycle Management.Strong background with source control management systems (GIT or Subversion); Build Systems (Maven, Gradle, Webpack); Code Quality (Sonar); Artifact Repository Managers (Artifactory), Continuous Integration/Continuous Deployment (Azure DevOps).Experience with Python and SQL.Creating and maintaining ETL processes and data pipelines.Knowledgeable of best practices in information technology governance and privacy compliance.Knowledge on auto finance industries core business functions.Ability to establish priorities and meet tight deadlines.Ability to interact collaboratively with internal customers.Demonstrated quantitative skills and data analytical skills.Solid design, coding, testing and debugging skills.Experience and Education
4-6 years of hands-on experience with data engineering required.3-5 years of hands-on experience with processing large data sets required.3-5 years of hands-on experience with SQL, data modeling, relational databases and/or NoSQL databases required.Bachelor’s Degree in related field or equivalent work experience required.What We Offer:
Generous benefits package available on day one to include: 401K matching, bonding leave for new parents (12 weeks, 100% paid), tuition assistance, training, GM employee auto discount, community service pay and nine company holidays.Our Culture:
Our team members define and shape our culture — an environment that welcomes innovative ideas, fosters integrity, and creates a sense of community and belonging. Here we do more than work — we thrive.Compensation:
Competitive pay and bonus eligibility.Work Life Balance:
Flexible hybrid work environment, minimum of 2 days a week in office in Fort Worth, Texas.#LI-SC1
#J-18808-Ljbffr