Data Engineer

POSITION DESCRIPTION The Data Engineer works independently and alongside cross-functional team members to model, develop and support data solutions which allow stakeholders to make data-driven decisions through flexible and structured access to data. This role works under limited supervision and provides guidance to junior Engineers. The Data Engineer maintains and works to expand knowledge of data engineering tools and techniques by learning about, implementing and supporting data solutions which includes the implementation of databases, data warehouses, BI visualization and reporting platforms, automation, data pipelines, ETL and the data governance processes which enables the preparation and use of small and large scale data sets. A strong Data Engineer will work collaboratively in conjunction with the data solutions team to advance knowledge in all areas of data engineering. The Data Engineer is passionate about working with and exploring data, and using and optimizing specialized tools that enable business insights and data driven decisions. POSITION REQUIREMENTS Bachelor's degree in Computer Science, Management Information Systems, Mathematics, Statistics, Informatics, Actuarial Sciences or related major, or an Associate's degree with comparable work experience. Two to six years' experience developing and supporting DBA, ETL, data engineering, data quality management, information architecture or data strategy projects and initiatives. Intermediate understanding, experience and knowledge of the languages, software, tools and methods used in data engineering, including: SQL and relational databases, query authoring and familiarity with a variety of database solutions. SQL query performance tuning, troubleshooting, index optimization. Demonstrated analytical skills related to designing and working with structured and unstructured datasets. Building and optimizing data transformation (ETL/ELT) and movement pipelines, architectures and data sets. Manipulating, processing and extracting value from disconnected datasets. Message queuing, stream processing, file transfer, batch processing and data storage systems. Constructing datasets for use by downstream applications, reporting, visualization, machine learning and analytical consumption. Building visual analytics, business reporting or data manipulation solutions. Data tools which can process data from APIs, files and other data sources. Debugging and data validation skills crossing multiple tools and components. Version control and release management of work items. Management and use of cloud and on-premise data management and visualization solutions. Patterns, common libraries, packages and tools used in data engineering. Building resilient, flexible and robust solutions which require minimal maintenance. Common architectural patterns and documentation standards in data engineering and data management. Agile development practices, processes and collaboration techniques. Enterprise data assets in a large, complex organization or of large international clients. Working within the constraints of data guidelines, policies, procedures, standards, legal, security and contractual constraints. Specific experience with the following tools or similar: Big Data: Azure Synapse, HDFS, Spark, Kafka, SQL Polybase, etc. Relational SQL and NoSQL databases: SQL Server, Mongo, Postgres, etc. Data pipeline and management: SSIS, Azure Data Factory, Alteryx, etc. Data programming and scripting languages: Python, C#, Scala, R, etc. Reporting and Dashboarding: SSRS, PowerBI, Tableau, TIBCO, etc. Data catalog and metadata management: Informatica, Azure Data Catalog, etc. To perform this job successfully, an individual must be able to complete each essential duty satisfactorily. The requirements listed above are representative of the knowledge, skill and/or ability required. ITA Group, Inc. is an Equal Opportunity Employer. In compliance with the Americans with Disabilities Act, the Company will consider reasonable accommodations for qualified individuals with disabilities and encourage prospective employees and incumbents to discuss potential accommodations with the Company.