Resource Informatics Group
Azure Data Engineer
Resource Informatics Group, Irving, Texas, United States, 75084
Job Title: - Azure Data EngineerLocation: - RemoteDuration: - 6+ MonthsExperience: - 11+ yearsPrimary duties:Support overall Azure Cloud Ecosystem at Client through management of data stores, data pipelines and analytics outputManage Operational Azure Synapse environments and Data LakesManage and Develop Integrations (Data Factory pipelines, APIs, FTP)Manage Event and Messaging Queues (Event Hubs)Build out advanced analytics use cases from sourcing data through building analytics and piping and delivering data outputs to applications and visualization toolsetsPartner with Infrastructure, Support and Application teams to identify and implement best practices for cloud services monitoring and management, and promoting these best practices across SpireResearch and implement cloud services to support cloud apps and maintain cloud servicesSupport POC Cloud Application DevelopmentMonitor cloud app performance for potential bottlenecks and resolving performance issuesPartner with Infrastructure in the identification and implementation of cost-saving strategies to reduce ongoing cloud expenses, with specific responsibility in cloud data services costsAutomate key services and tasks across cloud systems to increase efficiency and further reduce cloud costsAssist in the formulation of recovery plans and support the execution of the planWork with Information Security to support the security model for data on cloudPerform detailed analysis, design and development of the logical and physical data modelsEngage with business teams to help architect and develop use cases and data models used in analytics and visualizations tools and other applicationsWork with Enterprise Architecture teams to develop data governance and data quality layers within the Azure platformWorks in conjunction with the Advanced Analytics, BI and Infrastructure (Networking, Azure Support, Security) teamsAll other duties as assigned
Qualifications:
Ability to demonstrate the core and job category competencies: customer-focused, results-driven, teamwork, communications, adaptability, initiative, problem solving and qualityAbility to lead by example in support of the Company's essential characteristics and values: strong ethics and integrity, dedication to a safe work environment, commitment to a diverse workforce that recognizes and respects all individual's unique skills and perspectivesAbility to work independently and manage time effectively in order to meet individual goals and deadlines.Supervisory responsibilities:
N/AEducation and experience:
Bachelor's degree and / or approximately 5+ years of related work experience; or a graduate degree and approximately 3+ years of related work experienceAt least 3 years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, data warehouse and analytics solutionsExtensive hands-on experience implementing data migration and data processing using Azure services: Azure Datalake, Azure Data Factory, Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Data Catalog, Client Studio, AI/Client, etc.Well versed in DevSecOps and CI/CD deployments within an Azure environmentExperience developing and deploying ETL pipeline solutions on AzureFamiliarity with the technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage, Data Catalog etc.Experience working with Developer tools such as Azure DevOps, GitLabs, Jenkins, etc.Experience with SQL, ADLS/Blob, Python etc.
Qualifications:
Ability to demonstrate the core and job category competencies: customer-focused, results-driven, teamwork, communications, adaptability, initiative, problem solving and qualityAbility to lead by example in support of the Company's essential characteristics and values: strong ethics and integrity, dedication to a safe work environment, commitment to a diverse workforce that recognizes and respects all individual's unique skills and perspectivesAbility to work independently and manage time effectively in order to meet individual goals and deadlines.Supervisory responsibilities:
N/AEducation and experience:
Bachelor's degree and / or approximately 5+ years of related work experience; or a graduate degree and approximately 3+ years of related work experienceAt least 3 years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, data warehouse and analytics solutionsExtensive hands-on experience implementing data migration and data processing using Azure services: Azure Datalake, Azure Data Factory, Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Data Catalog, Client Studio, AI/Client, etc.Well versed in DevSecOps and CI/CD deployments within an Azure environmentExperience developing and deploying ETL pipeline solutions on AzureFamiliarity with the technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage, Data Catalog etc.Experience working with Developer tools such as Azure DevOps, GitLabs, Jenkins, etc.Experience with SQL, ADLS/Blob, Python etc.