Data Engineer

Clearance: Minimum Active Secret Clearance Responsibilities: Design, build, migrate, monitor and maintain customer's data pipelines in Azure Data Factory (ADF) Cleanup and transform data as necessary Support integration with other systems Migrate existing on-premise datasets and data workflows to ADF Support customer's data needs to further their Analytics and AI efforts Day-to-day, manage ADF, SQL Servers, Notebooks etc. Improve, innovate data ingestion and data pipelines Other ETL/ELT duties as assigned Skills: ADF, SQL, Databricks/Jupyter notebooks, Python and other data engineering tools Optionally, Spark/PySpark Understanding of data security and governance Requirements gathering Understanding of Agile methods Software engineering best practices Write production quality code Good verbal and written communication Collaborate across functional teams Interact with and manage customer expectations