Dexian DISYS
Data Architect (11/14)
Dexian DISYS, Tallahassee, Florida, us, 32318
Data Architect (11/14)
Job details
Posted11 November 2024
LocationTallahassee, FL
Job typeContract
Reference944140
Job description
Job Title:
Data ArchitectJob Location:
Tallahassee, FL (on-site)Job Duration:
Contract through June + extensionJob Overview:Serve as the principal line of communication for the project team.Drive the development of data integration pipelines, enabling efficient, reliable access to critical data within the Correction Information Management System (CIMS) Data Warehouse/Data Lake on Azure.Work with Azure Data Factory (ADF), Azure Databricks, Azure Synapse, Power BI, and Azure Purview.Transform complex data into actionable insights; andEnsure data integrity, security, and performance, all while meeting mission-critical needs.
Job Duties:ETL Pipeline Design and Development:Lead the design and development of high-performing ETL processes to integrate and transform data across disparate sources.Deliver efficient, reliable pipelines that meet business needs and maintain the highest standards of security; andUtilize Azure Data Factory (ADF) to automate and streamline data workflows, ensuring smooth transitions from source to target.
Data Integration and Transformation:Build and manage complex ETL workflows that extract, transform, and load data for downstream analytics and reporting, ensuring data is accurate, timely, and secure; andTake ownership of data quality and validation, creating resilient ETL processes that ensure only trusted data reaches its destination.
Cloud Platform Expertise:Leverage the full power of the Azure ecosystem-ADF, Databricks, Synapse, and Purview-to manage and process high volumes of structured and unstructured data, delivering solutions that are scalable and performance-optimized; andIntegrate large datasets into Azure Synapse Analytics, enabling analytics teams to deliver data- driven insights that support the Department's mission.
Performance Optimization:Continuously optimize ETL jobs to minimize latency and maximize throughput.Ensure the architecture supports fast, reliable data access for end-users and systems, meeting stringent performance metrics.
Security and Compliance:Embed security and compliance best practices in every step of the ETL process.Protect sensitive data by adhering to industry standards and ensuring compliance with the Department's data governance policies; andUse Azure Purview to enforce data governance, track data lineage, and ensure that data handling meets the highest standards of integrity.
Collaboration and Stakeholder Engagement:Partner with cross-functional teams-data engineers, analysts, business stakeholders, and security experts-to design and implement ETL solutions that meet the department's evolving needs.Act as a technical leader and mentor, helping guide junior team members and providing expert guidance on data processing and transformation best practices.
Documentation and Best Practices:Develop and maintain clear, detailed documentation for ETL processes, ensuring the team can consistently deliver high-quality, reliable solutions; andEstablish and enforce best practices for data handling, ETL development, and security, driving a culture of excellence and accountability.
Required Experience:Seven (7) to 10 years of experience in ETL development and data engineering, with at least three (3) to five (5) years of hands-on experience working with already defined ADF, Azure Databricks, Azure Synapse Analytics, and Azure Purview.Proven track record of building and optimizing large-scale ETL pipelines for high-performance, high- availability environments.Expertise in Spark, Python, and/or Scala for large-scale data transformations.Strong SQL proficiency and experience working with complex data structures.In-depth knowledge of data governance, security protocols, and role-based access control (RBAC) within the Azure ecosystem; andAbility to design ETL processes that are resilient, efficient, and fully compliant with regulatory standards.
Preferred Experience:Microsoft Certified: Azure Data Engineer Associate.Microsoft Certified: Azure Solutions Architect Expert.Microsoft Certified: Azure Fundamentals.Databricks Certified: Data Engineer Associate.
Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian's platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals.Dexian's brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more.Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.
Job details
Posted11 November 2024
LocationTallahassee, FL
Job typeContract
Reference944140
Job description
Job Title:
Data ArchitectJob Location:
Tallahassee, FL (on-site)Job Duration:
Contract through June + extensionJob Overview:Serve as the principal line of communication for the project team.Drive the development of data integration pipelines, enabling efficient, reliable access to critical data within the Correction Information Management System (CIMS) Data Warehouse/Data Lake on Azure.Work with Azure Data Factory (ADF), Azure Databricks, Azure Synapse, Power BI, and Azure Purview.Transform complex data into actionable insights; andEnsure data integrity, security, and performance, all while meeting mission-critical needs.
Job Duties:ETL Pipeline Design and Development:Lead the design and development of high-performing ETL processes to integrate and transform data across disparate sources.Deliver efficient, reliable pipelines that meet business needs and maintain the highest standards of security; andUtilize Azure Data Factory (ADF) to automate and streamline data workflows, ensuring smooth transitions from source to target.
Data Integration and Transformation:Build and manage complex ETL workflows that extract, transform, and load data for downstream analytics and reporting, ensuring data is accurate, timely, and secure; andTake ownership of data quality and validation, creating resilient ETL processes that ensure only trusted data reaches its destination.
Cloud Platform Expertise:Leverage the full power of the Azure ecosystem-ADF, Databricks, Synapse, and Purview-to manage and process high volumes of structured and unstructured data, delivering solutions that are scalable and performance-optimized; andIntegrate large datasets into Azure Synapse Analytics, enabling analytics teams to deliver data- driven insights that support the Department's mission.
Performance Optimization:Continuously optimize ETL jobs to minimize latency and maximize throughput.Ensure the architecture supports fast, reliable data access for end-users and systems, meeting stringent performance metrics.
Security and Compliance:Embed security and compliance best practices in every step of the ETL process.Protect sensitive data by adhering to industry standards and ensuring compliance with the Department's data governance policies; andUse Azure Purview to enforce data governance, track data lineage, and ensure that data handling meets the highest standards of integrity.
Collaboration and Stakeholder Engagement:Partner with cross-functional teams-data engineers, analysts, business stakeholders, and security experts-to design and implement ETL solutions that meet the department's evolving needs.Act as a technical leader and mentor, helping guide junior team members and providing expert guidance on data processing and transformation best practices.
Documentation and Best Practices:Develop and maintain clear, detailed documentation for ETL processes, ensuring the team can consistently deliver high-quality, reliable solutions; andEstablish and enforce best practices for data handling, ETL development, and security, driving a culture of excellence and accountability.
Required Experience:Seven (7) to 10 years of experience in ETL development and data engineering, with at least three (3) to five (5) years of hands-on experience working with already defined ADF, Azure Databricks, Azure Synapse Analytics, and Azure Purview.Proven track record of building and optimizing large-scale ETL pipelines for high-performance, high- availability environments.Expertise in Spark, Python, and/or Scala for large-scale data transformations.Strong SQL proficiency and experience working with complex data structures.In-depth knowledge of data governance, security protocols, and role-based access control (RBAC) within the Azure ecosystem; andAbility to design ETL processes that are resilient, efficient, and fully compliant with regulatory standards.
Preferred Experience:Microsoft Certified: Azure Data Engineer Associate.Microsoft Certified: Azure Solutions Architect Expert.Microsoft Certified: Azure Fundamentals.Databricks Certified: Data Engineer Associate.
Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian's platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals.Dexian's brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more.Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.