ShiftCode Analytics
Cloud Data Engineer
ShiftCode Analytics, Jersey City, New Jersey, United States, 07390
Title: Cloud Data EngineerLocation: Charlotte, NCThis role is 100% remote But Local Candidate is highly PreferredSector: BankingDuration: 8 month (C2H)(USC or GC candidates Only***)
Job Summary:Project Details:Job Description:Be the subject matter expert for data, pipeline design, architecture, and other data engineering technologies for the team.Owns the technical vision and development of a domain or capability.cts as strong advocate for a culture of quality and pushing the boundaries of platform.Leads team to utilize new frameworks/technologies to improve an existing process or service. Brings fresh perspective based on research and latest industry standards.Help to define the technical direction of the team and drive the actual architecture/design/implementations to enhance an ever-expanding data platform, that supports business process needs for internal and external integration via APIs, data models, self-serve reporting solutions, and interactive querying.High-level and low-level design of real time and batch system interfaces and data enrichment pipelines in a cloud-native data ecosystemPromoting and enforcing design and development standards and best practicesLead development initiatives and team from technical perspective by mentoring team members and contributing towards code base.Work with the latest and greatest technologies in the Microsoft cloud stack including Azure SQL, Synapse, Data Lake, Data Factory, Databricks, Azure function, Service Bus, etc.
Must Haves:
Top required skills:
Python - PySparkSQLTerraform - Azure data infrastructure.Experience with Azure cloud stack and especially with data services like Azure SQL, Synapse, Data Lake, Data Factory, Databricks, Azure function, Service Bus, etc. Experience with Python & SQL.
Job Summary:Project Details:Job Description:Be the subject matter expert for data, pipeline design, architecture, and other data engineering technologies for the team.Owns the technical vision and development of a domain or capability.cts as strong advocate for a culture of quality and pushing the boundaries of platform.Leads team to utilize new frameworks/technologies to improve an existing process or service. Brings fresh perspective based on research and latest industry standards.Help to define the technical direction of the team and drive the actual architecture/design/implementations to enhance an ever-expanding data platform, that supports business process needs for internal and external integration via APIs, data models, self-serve reporting solutions, and interactive querying.High-level and low-level design of real time and batch system interfaces and data enrichment pipelines in a cloud-native data ecosystemPromoting and enforcing design and development standards and best practicesLead development initiatives and team from technical perspective by mentoring team members and contributing towards code base.Work with the latest and greatest technologies in the Microsoft cloud stack including Azure SQL, Synapse, Data Lake, Data Factory, Databricks, Azure function, Service Bus, etc.
Must Haves:
Top required skills:
Python - PySparkSQLTerraform - Azure data infrastructure.Experience with Azure cloud stack and especially with data services like Azure SQL, Synapse, Data Lake, Data Factory, Databricks, Azure function, Service Bus, etc. Experience with Python & SQL.