INSPYR Solutions
Sr. Data Engineer
INSPYR Solutions, Charlotte, North Carolina, United States, 28245
Title: Sr. Data Engineer
Location: Remote (Quarterly travel to CLT)
Duration: 6 month Contract to hire
Job Summary
We are looking for a hands-on Senior Data Engineer with expertise in developing data ingestion pipelines. This role is crucial in designing, building, and maintaining our data infrastructure, focusing on creating scalable pipelines, ensuring data integrity, and optimizing performance.
Key skills include strong Snowflake expertise, advanced SQL proficiency, data extraction from APIs using Python and AWS Lambda, and experience with ETL/ELT processes. Workflow automation using AWS Airflow is essential, and experience with Fivetran and DBT is a plus.
Job Responsibilities
Design, build, test, and implement scalable data pipelines using Python and SQL. Maintain and optimize our Snowflake data warehouse's performance, including data ingestion and query optimization. Extract data from APIs using Python and AWS Lambda and automate workflows with AWS Airflow. Perform analysis and critical thinking to troubleshoot data-related issues and implement checks/scripts to enhance data quality. Collaborate with other data engineers and architect to develop new pipelines and/or optimize existing ones. Maintain code via CI/CD processes as defined in our Azure DevOps platform. Job Qualifications
7+ years of experience in Data Engineering roles, with a focus on building and implementing scalable data pipelines for data ingestion. Expertise in Snowflake, including data ingestion and performance optimization. Strong SQL skills for writing efficient queries and optimizing existing ones. Proficiency in Python for data extraction from APIs using AWS Lambda, Glue, etc. Experience with AWS services such as Lambda, Airflow, Glue, S3, SNS, etc. Highly self-motivated and detail-oriented with strong communication skills. Familiarity with ETL/ELT processes. Experience with Fivetran and DBT is a plus.
Our benefits package includes:
Comprehensive medical benefits Competitive pay 401(k) retirement plan ...and much more!
About INSPYR Solutions Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities
#LI-SD6 #LI-Remote
Job Summary
We are looking for a hands-on Senior Data Engineer with expertise in developing data ingestion pipelines. This role is crucial in designing, building, and maintaining our data infrastructure, focusing on creating scalable pipelines, ensuring data integrity, and optimizing performance.
Key skills include strong Snowflake expertise, advanced SQL proficiency, data extraction from APIs using Python and AWS Lambda, and experience with ETL/ELT processes. Workflow automation using AWS Airflow is essential, and experience with Fivetran and DBT is a plus.
Job Responsibilities
Design, build, test, and implement scalable data pipelines using Python and SQL. Maintain and optimize our Snowflake data warehouse's performance, including data ingestion and query optimization. Extract data from APIs using Python and AWS Lambda and automate workflows with AWS Airflow. Perform analysis and critical thinking to troubleshoot data-related issues and implement checks/scripts to enhance data quality. Collaborate with other data engineers and architect to develop new pipelines and/or optimize existing ones. Maintain code via CI/CD processes as defined in our Azure DevOps platform. Job Qualifications
7+ years of experience in Data Engineering roles, with a focus on building and implementing scalable data pipelines for data ingestion. Expertise in Snowflake, including data ingestion and performance optimization. Strong SQL skills for writing efficient queries and optimizing existing ones. Proficiency in Python for data extraction from APIs using AWS Lambda, Glue, etc. Experience with AWS services such as Lambda, Airflow, Glue, S3, SNS, etc. Highly self-motivated and detail-oriented with strong communication skills. Familiarity with ETL/ELT processes. Experience with Fivetran and DBT is a plus.
Our benefits package includes:
Comprehensive medical benefits Competitive pay 401(k) retirement plan ...and much more!
About INSPYR Solutions Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities
#LI-SD6 #LI-Remote