Technogen International Company
Azure Data Architect
Technogen International Company, Annapolis, MD
Location: Annapolis, MD 21401 - Hybrid
SCOPE OF WORK
1. Participation in all aspects of DW and ETL process design, creation, and specification for components.
2. Providing the following services in coordination with technical, functional and management representatives from JIS and the AOC.
a. Source Data Model to DW Logical Design ERD
(1) Understanding the general structure of the MDEC data and star schema models currently in use by JIS, and any related data sources identified as a result of initial planning and assessments.
(2) Creating a logical warehouse data design.
(3) Collaboration with platform administration team, design an ETL process to move data from the source system to the data warehouse, including, but not limited to, the following:
i Outlining the ETL process, setting the borders of data processing. ii Providing system architecture for each element and the whole data pipeline. iii Documenting the requirements of the system, manage its development and facilitate necessary knowledge transfer. iv Assisting in the actual development/implementation of ETL tools. v Conducting testing of the tools and data pipelines.
b. DW Schema (1) Developing effective DW model(s) representing the data entities of the logical design based on functional analytic, reporting and bulk data requirements. c. DW Physical Design
(1) Collaborating with platform administration to assist their efforts in creating a DW Physical design including technical considerations for data quality and operational efficiency.
3. Collaborating with business and technology stakeholders to ensure data warehouse architecture development and utilization.
SKILLS, EXPERIENCE, & CAPABILITIES
a. Database and analytical skills. b. Ability to query source data. c. Knowledge and experience with ETL tools, Visual Studio, and transmitting and reconstructing Extensible Markup Language (XML) and Structured Query Language (SQL). d. Knowledge of scripting languages, such as Python, and the ability to automate repetitive tasks in Azure
Strong analytical, consultative, and communication skills; as well as the ability to make good judgment and work with both technical and business personnel. f. Ability to:
(1) Work productively and maintain effective working relationships with peers, end users, vendor development staff, and all levels of management and Judicial personnel.
(2) Critically think and problem solve,
(3) Provide excellent communication and mentoring needs,
(4) Quickly evaluate, learn and prototype new technologies.
(5) Write optimized SQL queries and manage databases, as Azure data analysts frequently interact with Azure SQL database and other SQL-based services.
g. Experience with:
(1) BI best practices, relational structures, dimensional data modeling, structured query language (SQL) skills, data warehouse and reporting techniques.
(2) Dimensional modeling, STAR schema design, Snow fake schema design, slowly changing dimensions, confirmed dimensions.
(3) Designing and building BI solutions by monitoring and tuning queries and data loads, addressing user questions concerning data integrity, data mapping, monitoring performance and communicating functional and technical issues.
(4) Designing and implementing database models, schemes, and databases to support efficient data storage, retrieval, and analysis.
(5) Monitoring and optimizing data systems, data lifecycle, and infrastructure to ensure performance, scalability, and integrity.
(6) Designing and implementing ETL procedures for intake of data from multiple source systems; as well as ensure data quality and cleansing is verified.
(7) Normalization process
(8) Performing the design and extension of data marts, meta data, and data models.
(9) Ensuring all data warehouse architecture codes are maintained in a version control system.
(10) Advanced experience with technologies such as SQL Server 2016 or above, as well as with Azure data factory, SSIS and stored procedures (11) Advanced experience developing codes, testing for quality assurance, administering RDBMS.
(12) High proficiency in dimensional modeling techniques and their applications
(13) Azure's architecture in order to structure optimized data workflows. (14) The following tools: i Power BI ii Tableau iii Azure Synapse iv Azure Data Factory v Azure Blob Storage vi Azure Databricks vii Microsoft Fabric viii One Lake
SCOPE OF WORK
1. Participation in all aspects of DW and ETL process design, creation, and specification for components.
2. Providing the following services in coordination with technical, functional and management representatives from JIS and the AOC.
a. Source Data Model to DW Logical Design ERD
(1) Understanding the general structure of the MDEC data and star schema models currently in use by JIS, and any related data sources identified as a result of initial planning and assessments.
(2) Creating a logical warehouse data design.
(3) Collaboration with platform administration team, design an ETL process to move data from the source system to the data warehouse, including, but not limited to, the following:
i Outlining the ETL process, setting the borders of data processing. ii Providing system architecture for each element and the whole data pipeline. iii Documenting the requirements of the system, manage its development and facilitate necessary knowledge transfer. iv Assisting in the actual development/implementation of ETL tools. v Conducting testing of the tools and data pipelines.
b. DW Schema (1) Developing effective DW model(s) representing the data entities of the logical design based on functional analytic, reporting and bulk data requirements. c. DW Physical Design
(1) Collaborating with platform administration to assist their efforts in creating a DW Physical design including technical considerations for data quality and operational efficiency.
3. Collaborating with business and technology stakeholders to ensure data warehouse architecture development and utilization.
SKILLS, EXPERIENCE, & CAPABILITIES
a. Database and analytical skills. b. Ability to query source data. c. Knowledge and experience with ETL tools, Visual Studio, and transmitting and reconstructing Extensible Markup Language (XML) and Structured Query Language (SQL). d. Knowledge of scripting languages, such as Python, and the ability to automate repetitive tasks in Azure
Strong analytical, consultative, and communication skills; as well as the ability to make good judgment and work with both technical and business personnel. f. Ability to:
(1) Work productively and maintain effective working relationships with peers, end users, vendor development staff, and all levels of management and Judicial personnel.
(2) Critically think and problem solve,
(3) Provide excellent communication and mentoring needs,
(4) Quickly evaluate, learn and prototype new technologies.
(5) Write optimized SQL queries and manage databases, as Azure data analysts frequently interact with Azure SQL database and other SQL-based services.
g. Experience with:
(1) BI best practices, relational structures, dimensional data modeling, structured query language (SQL) skills, data warehouse and reporting techniques.
(2) Dimensional modeling, STAR schema design, Snow fake schema design, slowly changing dimensions, confirmed dimensions.
(3) Designing and building BI solutions by monitoring and tuning queries and data loads, addressing user questions concerning data integrity, data mapping, monitoring performance and communicating functional and technical issues.
(4) Designing and implementing database models, schemes, and databases to support efficient data storage, retrieval, and analysis.
(5) Monitoring and optimizing data systems, data lifecycle, and infrastructure to ensure performance, scalability, and integrity.
(6) Designing and implementing ETL procedures for intake of data from multiple source systems; as well as ensure data quality and cleansing is verified.
(7) Normalization process
(8) Performing the design and extension of data marts, meta data, and data models.
(9) Ensuring all data warehouse architecture codes are maintained in a version control system.
(10) Advanced experience with technologies such as SQL Server 2016 or above, as well as with Azure data factory, SSIS and stored procedures (11) Advanced experience developing codes, testing for quality assurance, administering RDBMS.
(12) High proficiency in dimensional modeling techniques and their applications
(13) Azure's architecture in order to structure optimized data workflows. (14) The following tools: i Power BI ii Tableau iii Azure Synapse iv Azure Data Factory v Azure Blob Storage vi Azure Databricks vii Microsoft Fabric viii One Lake