Beacon Hill
Data Engineer - Python
Beacon Hill, Phila, Pennsylvania, United States, 19117
To Apply for this Job Click HereLocation: Remote EST HoursSalary: 115-120K with 20% bonusWe are seeking a highly skilled Senior Data Engineer This role involves extensive coding, infrastructure management, and automation, with a focus on building and maintaining robust ETL pipelines and tools. The ideal candidate will be a key individual contributor, working closely with the director and mentoring junior team members.Key Responsibilities:
ETL Pipeline Development : Build and manage ETL pipelines using Python, Kafka, Snowflake, and AWS, ensuring data is efficiently processed and delivered.
Heavy Coding : Focus on Python development to implement data processing, analysis, and automation tasks.
Infrastructure as Code (IaC) : Utilize SQL-based IaC tools (CloudFormation, Serverless, Terraform) for infrastructure management.
Automation & Optimization : Automate manual processes, optimize data delivery, and redesign infrastructure to enhance scalability and performance.
End-to-End Development : Take ownership of all aspects of development, from application code to cloud deployment and ongoing observability.
Testing & CI\/CD : Develop automated unit and integration tests, and create and maintain CI\/CD pipelines using GitHub Actions.
Mentorship : Act as a go-to resource for junior team members, providing guidance and support.
Collaboration : Work closely with the director to align on project goals and contribute to the overall success of the team.Required Skills and Qualifications:
Python Development : Extensive experience in Python coding, particularly for ETL and data processing.
AWS & ETL Tools : Proficiency with AWS services, Kafka, Snowflake, and experience in building and managing ETL pipelines.
Infrastructure as Code : Experience with Terraform, CloudFormation, and Serverless frameworks for infrastructure management.
DevOps & CI\/CD : Strong understanding of DevOps practices and experience with CI\/CD pipelines, including GitHub Actions.
SQL & Databases : Experience with relational databases, SQL, and building unit tests.
Version Control : Advanced skills with Git or other version control systems.
Docker & Linux\/Unix : Experience with Docker and working in Linux\/Unix environments.
T1390632-PHI_1725543953To Apply for this Job Click Here
ETL Pipeline Development : Build and manage ETL pipelines using Python, Kafka, Snowflake, and AWS, ensuring data is efficiently processed and delivered.
Heavy Coding : Focus on Python development to implement data processing, analysis, and automation tasks.
Infrastructure as Code (IaC) : Utilize SQL-based IaC tools (CloudFormation, Serverless, Terraform) for infrastructure management.
Automation & Optimization : Automate manual processes, optimize data delivery, and redesign infrastructure to enhance scalability and performance.
End-to-End Development : Take ownership of all aspects of development, from application code to cloud deployment and ongoing observability.
Testing & CI\/CD : Develop automated unit and integration tests, and create and maintain CI\/CD pipelines using GitHub Actions.
Mentorship : Act as a go-to resource for junior team members, providing guidance and support.
Collaboration : Work closely with the director to align on project goals and contribute to the overall success of the team.Required Skills and Qualifications:
Python Development : Extensive experience in Python coding, particularly for ETL and data processing.
AWS & ETL Tools : Proficiency with AWS services, Kafka, Snowflake, and experience in building and managing ETL pipelines.
Infrastructure as Code : Experience with Terraform, CloudFormation, and Serverless frameworks for infrastructure management.
DevOps & CI\/CD : Strong understanding of DevOps practices and experience with CI\/CD pipelines, including GitHub Actions.
SQL & Databases : Experience with relational databases, SQL, and building unit tests.
Version Control : Advanced skills with Git or other version control systems.
Docker & Linux\/Unix : Experience with Docker and working in Linux\/Unix environments.
T1390632-PHI_1725543953To Apply for this Job Click Here