JobRialto
ETL Developer
JobRialto, New York, New York, 10261
Job Summary: We are seeking a skilled ETL Developer / Data Engineer with expertise in geographic data and database management to extract, transform, and load (ETL) data from various sources, ensuring its integrity and quality. The ideal candidate will have extensive experience in SQL, data modeling, and API development, with a strong focus on handling large datasets and integrating them for reporting, system integration, and business analysis. The candidate will work closely with cross-functional teams and stakeholders to design, implement, and optimize data pipelines and reporting solutions. Key Responsibilities: Data Extraction & Transformation: Extract geographic and non-geographic data from Oracle and SQL Server databases, ensuring data integrity and quality. ETL Process Design: Design and implement efficient data pipelines for handling large datasets. Automate ETL integrations using SQL Server Integration Services (SSIS). Data Analysis & Reporting: Perform data analysis to drive business decisions and create reporting solutions using SQL Server Reporting Services (SSRS). ETL Automation: Develop, test, and maintain ETL workflows and scripts to automate data processing. Monitor ETL processes for reliability, scalability, and performance. Data Modeling: Perform data modeling and database design in collaboration with the Database Administrator and Architect for application development and product implementation. API Development: Create APIs to enable data access and integration with applications and systems. Ensure APIs are secure, performant, and adhere to industry standards. Cross-Department Collaboration: Work with GIS analysts, developers, business analysts, and stakeholders to understand data requirements and deliver solutions that meet business needs. Troubleshooting: Troubleshoot and resolve data-related issues, ensuring high availability and performance of systems. Data Testing: Define and implement data testing strategies in collaboration with stakeholders, development teams, and QA groups. Participate in the software testing process, including defect identification and resolution. Documentation & Knowledge Sharing: Document ETL processes, data models, and API specifications for transparency. Mentor and guide development team members on database-related tasks. Performance Optimization: Monitor and optimize database performance and capacity utilization, ensuring scalability and redundancy. Collaboration in Technical Reviews: Participate in technical reviews, presentations, and provide input on design, implementation, and support strategies. Required Qualifications: Education: Bachelor's degree in computer science, Information Systems, Geographic Information Systems (GIS), or a related field. Experience: Minimum of 5 years of experience as an ETL Developer, Data Engineer, or in a similar role, with a focus on geographic data. Technical Skills: Proficiency in T-SQL and PL/SQL, with experience working with Microsoft SQL Server, Oracle, and PostgreSQL databases. Experience with SSRS, SSAS, SSIS, and data warehousing concepts like ETL, Dimensions, Facts, and Cubes. Knowledge of data integration patterns, database design, and data modeling principles. Strong programming skills in Python, C#, or other relevant languages for ETL and API development. Familiarity with geographic data formats (e.g., shapefiles, GeoJSON) and geospatial tools (e.g., ArcGIS, QGIS). Ability to write and optimize complex SQL queries, stored procedures, triggers, and functions. Experience in code migration, database change management, and data management through various stages of the development life cycle. Experience with cloud platforms (e.g., AWS, Azure, GCP) and related data services. Familiarity with ETL tools like Talend, Apache Nifi, or Informatica. Experience with version control and release management practices using tools such as GitHub and Azure DevOps. Problem-Solving: Excellent problem-solving skills with the ability to troubleshoot and resolve data-related issues promptly. Preferred Qualifications: Certifications: ETL certifications in Microsoft SQL Server or Oracle are a plus. Additional Skills: Experience with API frameworks like Flask, FastAPI, or Django REST Framework. Familiarity with application lifecycle management (ALM) tools such as Azure DevOps. Experience working with multidimensional databases and data warehousing. Certifications (if any): ETL certifications for Microsoft SQL Server or Oracle are a plus. Education: Bachelors Degree