Strategic Data Systems
10136 - Lead Developer/Python/Data Engineer
Strategic Data Systems, Cincinnati, Ohio, United States, 45208
Senior Data Engineer / Developer
Strategic Data Systems (SDS) is a software development firm focused on strategy, technology, and business transformation for fortune 100 companies, mid-sized companies, and startups. We redefine what’s possible and create what’s next so our clients can ‘Accomplish More’ by trusting the excellent work and the technical professionals we provide to assist. As a consultant for Strategic Data Systems, you will have the opportunity to work with multiple clients, projects, and technologies.
About The Role
As a Developer / Data Engineer , you will collect, aggregate, store, and reconcile data in support of Customer's business decisions. You will design and build data pipelines, data streams, data service APIs, data generators and other end-user information portals and insight tools. Python Development Skills are an important requirement for this role.
Day-to-day You Will
Plan, build and implement data solutions based on DataBricksDesign and build Modern Data Pipelines and Data StreamsDevelop and Maintain Data WarehouseDesign and create ETL processes supplying Data WarehouseImplement effective metrics and monitoring processPreprocess of structured and unstructured data, create queries in databases
Qualifications
Experience working with Azure DatabricksFamiliarity with PySparkKnowledge of at least one component: Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQLStrong software development skill using: PythonExperience with Apache Nifi, Delta tables and Kafka a plus.Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows5+ years of Python with experience in newer language features such as type hintingExperience with modern development tools such as PyCharm or VS Code"Unity Catalog" experience is a plus
#J-18808-Ljbffr
Strategic Data Systems (SDS) is a software development firm focused on strategy, technology, and business transformation for fortune 100 companies, mid-sized companies, and startups. We redefine what’s possible and create what’s next so our clients can ‘Accomplish More’ by trusting the excellent work and the technical professionals we provide to assist. As a consultant for Strategic Data Systems, you will have the opportunity to work with multiple clients, projects, and technologies.
About The Role
As a Developer / Data Engineer , you will collect, aggregate, store, and reconcile data in support of Customer's business decisions. You will design and build data pipelines, data streams, data service APIs, data generators and other end-user information portals and insight tools. Python Development Skills are an important requirement for this role.
Day-to-day You Will
Plan, build and implement data solutions based on DataBricksDesign and build Modern Data Pipelines and Data StreamsDevelop and Maintain Data WarehouseDesign and create ETL processes supplying Data WarehouseImplement effective metrics and monitoring processPreprocess of structured and unstructured data, create queries in databases
Qualifications
Experience working with Azure DatabricksFamiliarity with PySparkKnowledge of at least one component: Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQLStrong software development skill using: PythonExperience with Apache Nifi, Delta tables and Kafka a plus.Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows5+ years of Python with experience in newer language features such as type hintingExperience with modern development tools such as PyCharm or VS Code"Unity Catalog" experience is a plus
#J-18808-Ljbffr