Centraprise
Sr. Azure Data Engineer
Centraprise, Arlington, VA
Job Description -
Sr. Azure Data Engineer
Arlington, Virginia
Fulltime
Key Areas Description
Roles & Responsibilities
• Responsible for designing, building, testing, and delivering data pipelines to enhance the Azure Data Lake using structured and unstructured data sources
• Builds and delivers Azure DevOps model using automation and Continuous Integration/Continuous Deployment (CI/CD) pipelines following Agile methodologies (i.e. Scrum, SAFe, Kanban)
• Develops forward-thinking IT blueprints
• Collaborates with Product Owners and Data Engineers to drive alignment and acceptance of the enterprise architecture
• Ensures the security of data by maintaining the integrity and performance of client databases and guaranteeing that data is stored securely and optimally
• Creates design documentation and code delivery as part of the client Standards Experience Required
• 10+ years of experience in business analytics and/or IT solution delivery
• 5+ years of experience in Azure Cloud technologies (as mentioned below)
• Experience designing, developing, and implementing analytics platforms using Azure Cloud architecture using structured and unstructured data sources Key Areas.
Job Description
Must-have experience
• Experience in generating data pipelines in Azure ADF
• Experience in ingesting data from different Sources using in Azure ADF
• Experience in transforming the data using Azure Databricks
• Experience in Azure DevOps CI/CD - Stories, Bugs, and Issue management
• Implement Integration solution in Microsoft Azure
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues
• Works closely with a team of frontend and backend engineers, product managers, and analysts
• Experience working in agile development projects and sprint delivery Good to have
• Experience working with CPG customers
• Experience in areas of master data like material master and transactional data in manufacturing like Bill of Material, Sales Data etc.
• Worked in SAP BW to Azure data Integration projects Factors for success
• Prompt communication and timely deliverables
• Detailed documentation of requirements and design approach
• Ability to look for solutions and work around when technology does not provide straight forward approach
Mandatory Technical Skills
Azure Cloud Technologies: Azure Data Factory, Azure Data Lake Analytics, PySpark, Azure Data Bricks, Azure SQL Data Warehouse / Synapse, Azure Functions, Event Hub, Azure DevOps
Sr. Azure Data Engineer
Arlington, Virginia
Fulltime
Key Areas Description
Roles & Responsibilities
• Responsible for designing, building, testing, and delivering data pipelines to enhance the Azure Data Lake using structured and unstructured data sources
• Builds and delivers Azure DevOps model using automation and Continuous Integration/Continuous Deployment (CI/CD) pipelines following Agile methodologies (i.e. Scrum, SAFe, Kanban)
• Develops forward-thinking IT blueprints
• Collaborates with Product Owners and Data Engineers to drive alignment and acceptance of the enterprise architecture
• Ensures the security of data by maintaining the integrity and performance of client databases and guaranteeing that data is stored securely and optimally
• Creates design documentation and code delivery as part of the client Standards Experience Required
• 10+ years of experience in business analytics and/or IT solution delivery
• 5+ years of experience in Azure Cloud technologies (as mentioned below)
• Experience designing, developing, and implementing analytics platforms using Azure Cloud architecture using structured and unstructured data sources Key Areas.
Job Description
Must-have experience
• Experience in generating data pipelines in Azure ADF
• Experience in ingesting data from different Sources using in Azure ADF
• Experience in transforming the data using Azure Databricks
• Experience in Azure DevOps CI/CD - Stories, Bugs, and Issue management
• Implement Integration solution in Microsoft Azure
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues
• Works closely with a team of frontend and backend engineers, product managers, and analysts
• Experience working in agile development projects and sprint delivery Good to have
• Experience working with CPG customers
• Experience in areas of master data like material master and transactional data in manufacturing like Bill of Material, Sales Data etc.
• Worked in SAP BW to Azure data Integration projects Factors for success
• Prompt communication and timely deliverables
• Detailed documentation of requirements and design approach
• Ability to look for solutions and work around when technology does not provide straight forward approach
Mandatory Technical Skills
Azure Cloud Technologies: Azure Data Factory, Azure Data Lake Analytics, PySpark, Azure Data Bricks, Azure SQL Data Warehouse / Synapse, Azure Functions, Event Hub, Azure DevOps