ETL Developer

Onsite/remote schedule - 2 days/week onsite • Migrate existing SSIS ETL scripts to Python; develop new ETL scripts • Support existing SSIS SQL Projects • Maintain ETL pipelines in and out of data warehouse using combination of Python and Snowflakes SnowSQL • Write SQL queries against Snowflake. • Understanding data pipelines and modern ways of automating data pipeline using cloud-based • Work closely with existing senior integration staff to flush out design, priority and build. • Scaffolding and framework will be needed for staging and transforming datasets. • Use existing DevOps pipeline for Python and enhance if necessary. • Automate Python scripts on our enterrprise scheduler. Strong troubleshooting skills to identify root cause and resolve production issues Job Requirements • At least 5 years of full-time development experience using Python. • Designing and implementing highly performant data ingestion pipelines from multiple sources using Azure Databricks. • Direct experience of building data piplines using Azure Data Factory and (preferably Databricks). • Extensive experience in software development and the entire SDLC. • Solid understanding of a variety of programming tools and development platforms. • Experience in creating high-level product specifications and design documents. • Experience in writing Python applications with the benefit of frameworks like Django, Flask, Pyramid, or Tornado. • Experience in Python testing and code analysis tools like Pytest and Pylint. • Integration experience (ETL, ELT) with Python. • Strong SQL skills. • Familarity with SSIS would be helpful. • General development expertise, use of version control, ticketing, and continuous integration systems. • Experience in using an Enterprise Scheduler (Tidal) • Experience in an Agile Development environment On-point communication skills to concisley report status of work/issues and next action, and articulate technical complexity to Businss analysts, Project manager and Business users