ConsultNet Technology Services and Solutions
Data Warehouse Engineer
ConsultNet Technology Services and Solutions, Jacksonville, Florida, United States, 32290
Data Engineer
Overview We are seeking a skilled professional to design, build, and maintain the infrastructure required for large-scale data collection, storage, and analysis. The role involves collaborating with cross-functional teams to develop data systems that support key data pipelines and business objectives. Key Responsibilities Data Infrastructure & Pipeline Development Design, implement, and maintain scalable systems for data management. Build and optimize ETL pipelines for seamless data processing. Ensure high performance and reliability in data storage and retrieval. Data Warehousing Develop and enhance data warehouse structures to support various data formats. Apply techniques like partitioning and indexing to improve query performance. Database Management Create and manage database schemas for efficient data handling. Leverage SQL and NoSQL technologies to implement robust database solutions. Uphold data quality, security, and integrity standards. Data Integration Consolidate data from multiple sources into unified storage systems. Work with APIs and collaborate with engineering teams to integrate data workflows. Data Modeling & Transformation Utilize best practices in data modeling to ensure consistency and accuracy. Perform data cleansing, enrichment, and transformation as needed. Governance & Compliance Adhere to data governance policies and implement quality assurance measures. Document processes and maintain up-to-date architectural records. Collaboration & Support Partner with analysts and stakeholders to address data requirements. Provide troubleshooting and mentorship to team members. Application Integration Facilitate data exchange between business applications and storage systems. Develop APIs and middleware solutions for seamless integration. Performance Optimization Monitor system performance to identify and resolve bottlenecks. Continuously improve scalability and cost-efficiency of data systems. Qualifications Education & Experience Bachelor's degree in a technical field or equivalent professional experience. Hands-on experience in data engineering, warehousing, and ETL processes. Familiarity with cloud platforms (AWS, Azure, Google Cloud) and related tools. Experience with Snowflake, Synapse, Azure Data Factory, or similar platforms preferred. Technical Skills Proficient in SQL and NoSQL database management. Expertise in programming languages such as Python, Java, or Scala. Knowledge of big data frameworks (e.g., Spark, Hadoop) and data automation tools. Certifications Certifications like Azure Data Engineer Associate or similar are a plus.
Overview We are seeking a skilled professional to design, build, and maintain the infrastructure required for large-scale data collection, storage, and analysis. The role involves collaborating with cross-functional teams to develop data systems that support key data pipelines and business objectives. Key Responsibilities Data Infrastructure & Pipeline Development Design, implement, and maintain scalable systems for data management. Build and optimize ETL pipelines for seamless data processing. Ensure high performance and reliability in data storage and retrieval. Data Warehousing Develop and enhance data warehouse structures to support various data formats. Apply techniques like partitioning and indexing to improve query performance. Database Management Create and manage database schemas for efficient data handling. Leverage SQL and NoSQL technologies to implement robust database solutions. Uphold data quality, security, and integrity standards. Data Integration Consolidate data from multiple sources into unified storage systems. Work with APIs and collaborate with engineering teams to integrate data workflows. Data Modeling & Transformation Utilize best practices in data modeling to ensure consistency and accuracy. Perform data cleansing, enrichment, and transformation as needed. Governance & Compliance Adhere to data governance policies and implement quality assurance measures. Document processes and maintain up-to-date architectural records. Collaboration & Support Partner with analysts and stakeholders to address data requirements. Provide troubleshooting and mentorship to team members. Application Integration Facilitate data exchange between business applications and storage systems. Develop APIs and middleware solutions for seamless integration. Performance Optimization Monitor system performance to identify and resolve bottlenecks. Continuously improve scalability and cost-efficiency of data systems. Qualifications Education & Experience Bachelor's degree in a technical field or equivalent professional experience. Hands-on experience in data engineering, warehousing, and ETL processes. Familiarity with cloud platforms (AWS, Azure, Google Cloud) and related tools. Experience with Snowflake, Synapse, Azure Data Factory, or similar platforms preferred. Technical Skills Proficient in SQL and NoSQL database management. Expertise in programming languages such as Python, Java, or Scala. Knowledge of big data frameworks (e.g., Spark, Hadoop) and data automation tools. Certifications Certifications like Azure Data Engineer Associate or similar are a plus.