ABBTECH Professional Resources
Senior Big Data Architect
ABBTECH Professional Resources, Washington, District of Columbia, us, 20022
This program requires US Citizenship or Green Card (Lawful Permanent Residents)
Onsite
Databricks Certified Data Engineer Professional is highly desired.
Position Description: This role will provide expertise to support the development of a Big Data / Data Lake system architecture that supports enterprise data operations for the District of Columbia government, including the Internet of Things (IoT) / Smart City projects, enterprise data warehouse, the open data portal, and data science applications. This is an exciting opportunity to work as a part of a collaborative senior data team supporting DC's Chief Data Officer. This architecture includes Databricks, Microsoft Azure platform tools (including Data Lake and Synapse), Apache platform tools (including Hadoop, Hive, Impala, Spark, Sedona, and Airflow), and data pipeline/ETL development tools (including Streamsets, Apache NiFi, Azure Data Factory). The platform will be designed for District-wide use and integration with other OCTO Enterprise Data tools such as Esri, Tableau, MicroStrategy, API Gateways, and Oracle databases and integration tools.
Position Responsibilities:
Coordinates IT project management, engineering, maintenance, QA, and risk management.
Plans, coordinates, and monitors project activities.
Develops technical applications to support users.
Develops, implements, maintains, and enforces documented standards and procedures for assigned systems' design, development, installation, modification, and documentation.
Provides training for system products and procedures.
Performs application upgrades.
Performs monitoring, maintenance, or reporting on real-time databases, real-time network and serial data communications, and real-time graphics and logic applications.
Troubleshoots problems.
Ensures project life-cycle follows District standards and procedures. Minimum Education/Certification Requirements: Bachelor’s degree in Information Technology or related field or equivalent experience Skills Matrix: Skill | Required/ Desired | Years Experience implementing modern Big Data storage and analytics platforms such as Databricks and Data Lakes | Required | 5Knowledge of modern Big Data and Data Architecture and Implementation best practices | Required | 5Knowledge of architecture and implementation of networking, security and storage on cloud platforms such as Microsoft Azure | Required | 5Experience with deployment of data tools and storage on cloud platforms such as Microsoft Azure | Required | 5Knowledge of Data-centric systems for the analysis and visualization of data, such as Tableau, MicroStrategy, ArcGIS, Kibana, Oracle | Required | 5Experience querying structured and unstructured data sources including SQL and NoSQL databases | Required | 5Experience modeling and ingesting data into and between various data systems through the use of Data Pipelines | Required | 5Experience with API / Web Services (REST/SOAP) | Required | 3Experience with complex event processing and real-time streaming data | Required | 3Experience with deployment and management of data science tools and modules such as JupyterHub | Required | 3Experience with ETL, data processing, analytics using languages such as Python, Java or R | Required | 3Databricks Certified Data Engineer Professional | Highly desiredExperience with Cloudera Data Platform | Highly desired | 316+ yrs planning, coordinating, and monitoring project activities | Required | 1616+ yrs leading projects, ensuring they are in compliance with established standards/procedures | Required | 16Bachelor’s degree in IT or related field or equivalent experience | Required
Position Details:
Pay Rate / Range:$40-$62.50
The above salary range represents the range expected for the position; however, final salary offers are based on a number of factors such as the position’s responsibilities; the candidate’s experience, education, and skills; location; travel required; and current market conditions.
Benefits (Regular, Full Time Employees):
Medical, Dental, and Vision offerings
Weekly Direct Deposit
Paid Holidays and Personal Time Off
401(k) with match
Voluntary Life and AD&D, Short / Long Term Disability, plus other voluntary coverages
Pre-Paid Legal and Employee Assistance Programs
Northwest Federal Credit Union Membership
BB&T @ Work Program
ABBTECH is an EOE/Minorities/Women/Disabled Individuals/Veterans
Onsite
Databricks Certified Data Engineer Professional is highly desired.
Position Description: This role will provide expertise to support the development of a Big Data / Data Lake system architecture that supports enterprise data operations for the District of Columbia government, including the Internet of Things (IoT) / Smart City projects, enterprise data warehouse, the open data portal, and data science applications. This is an exciting opportunity to work as a part of a collaborative senior data team supporting DC's Chief Data Officer. This architecture includes Databricks, Microsoft Azure platform tools (including Data Lake and Synapse), Apache platform tools (including Hadoop, Hive, Impala, Spark, Sedona, and Airflow), and data pipeline/ETL development tools (including Streamsets, Apache NiFi, Azure Data Factory). The platform will be designed for District-wide use and integration with other OCTO Enterprise Data tools such as Esri, Tableau, MicroStrategy, API Gateways, and Oracle databases and integration tools.
Position Responsibilities:
Coordinates IT project management, engineering, maintenance, QA, and risk management.
Plans, coordinates, and monitors project activities.
Develops technical applications to support users.
Develops, implements, maintains, and enforces documented standards and procedures for assigned systems' design, development, installation, modification, and documentation.
Provides training for system products and procedures.
Performs application upgrades.
Performs monitoring, maintenance, or reporting on real-time databases, real-time network and serial data communications, and real-time graphics and logic applications.
Troubleshoots problems.
Ensures project life-cycle follows District standards and procedures. Minimum Education/Certification Requirements: Bachelor’s degree in Information Technology or related field or equivalent experience Skills Matrix: Skill | Required/ Desired | Years Experience implementing modern Big Data storage and analytics platforms such as Databricks and Data Lakes | Required | 5Knowledge of modern Big Data and Data Architecture and Implementation best practices | Required | 5Knowledge of architecture and implementation of networking, security and storage on cloud platforms such as Microsoft Azure | Required | 5Experience with deployment of data tools and storage on cloud platforms such as Microsoft Azure | Required | 5Knowledge of Data-centric systems for the analysis and visualization of data, such as Tableau, MicroStrategy, ArcGIS, Kibana, Oracle | Required | 5Experience querying structured and unstructured data sources including SQL and NoSQL databases | Required | 5Experience modeling and ingesting data into and between various data systems through the use of Data Pipelines | Required | 5Experience with API / Web Services (REST/SOAP) | Required | 3Experience with complex event processing and real-time streaming data | Required | 3Experience with deployment and management of data science tools and modules such as JupyterHub | Required | 3Experience with ETL, data processing, analytics using languages such as Python, Java or R | Required | 3Databricks Certified Data Engineer Professional | Highly desiredExperience with Cloudera Data Platform | Highly desired | 316+ yrs planning, coordinating, and monitoring project activities | Required | 1616+ yrs leading projects, ensuring they are in compliance with established standards/procedures | Required | 16Bachelor’s degree in IT or related field or equivalent experience | Required
Position Details:
Pay Rate / Range:$40-$62.50
The above salary range represents the range expected for the position; however, final salary offers are based on a number of factors such as the position’s responsibilities; the candidate’s experience, education, and skills; location; travel required; and current market conditions.
Benefits (Regular, Full Time Employees):
Medical, Dental, and Vision offerings
Weekly Direct Deposit
Paid Holidays and Personal Time Off
401(k) with match
Voluntary Life and AD&D, Short / Long Term Disability, plus other voluntary coverages
Pre-Paid Legal and Employee Assistance Programs
Northwest Federal Credit Union Membership
BB&T @ Work Program
ABBTECH is an EOE/Minorities/Women/Disabled Individuals/Veterans