Agility Partners LLC
Advanced Data Engineer (Azure) Company Hidden Retail Cincinnati, OH Developer 1
Agility Partners LLC, Cincinnati, Ohio, United States, 45208
Agility Partners is seeking a qualified Advanced Data Engineer to fill an open position with a leading grocer in the Cincinnati area.Key Responsibilities:
SQL, Python, Spark, DatabricksWorking with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformationDevOps process and Terraform scriptingLeadership skills: must be able to put together and deliver presentations.Solid communication while working with PMO. Must be able to translate what the product is asking for and communicate effectively with the team.Benefits and Perks
Work within a collaborative team environment where ideas and creativity are welcomed! Family and work-life balance are important to this organization and valued for the employees.Working for an organization that focuses on company culture, inclusion, and diversity50% medical coverage for you and your entire family, short/long term disability, and life insurance options401(k)Life InsuranceDisability coverageThe Ideal Candidate
Qualifications:Experience in Data modeling and advanced SQL techniquesExperience working on cloud migration methodologies and processes including tools like Databricks, Azure Data Factory, Azure Functions, and other Azure data servicesExpert in SQL, Python, Spark, DatabricksExperience working with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformationExperience with DevOps process and understanding of Terraform scriptingUnderstanding the benefits of data warehousing, data architecture, data quality processes, data warehousing design and implementation, table structure, fact and dimension tables, logical and physical database designExperience designing and implementing ingestion processes for unstructured and structured data setsExperience designing and developing data cleansing routines utilizing standard data operationsKnowledge of data, master data, and metadata related standards and processesExperience working with multi-Terabyte data sets, troubleshooting issues, performance tuning of Spark and SQL queriesExperience using Azure DevOps/Github actions CI/CD pipelines to deploy codeMicrosoft Azure certifications are a plusMinimum of 7 years of hands-on experience working on design, configuration, implementation, and data migration for medium to large sized enterprise data platforms.
#J-18808-Ljbffr
SQL, Python, Spark, DatabricksWorking with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformationDevOps process and Terraform scriptingLeadership skills: must be able to put together and deliver presentations.Solid communication while working with PMO. Must be able to translate what the product is asking for and communicate effectively with the team.Benefits and Perks
Work within a collaborative team environment where ideas and creativity are welcomed! Family and work-life balance are important to this organization and valued for the employees.Working for an organization that focuses on company culture, inclusion, and diversity50% medical coverage for you and your entire family, short/long term disability, and life insurance options401(k)Life InsuranceDisability coverageThe Ideal Candidate
Qualifications:Experience in Data modeling and advanced SQL techniquesExperience working on cloud migration methodologies and processes including tools like Databricks, Azure Data Factory, Azure Functions, and other Azure data servicesExpert in SQL, Python, Spark, DatabricksExperience working with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformationExperience with DevOps process and understanding of Terraform scriptingUnderstanding the benefits of data warehousing, data architecture, data quality processes, data warehousing design and implementation, table structure, fact and dimension tables, logical and physical database designExperience designing and implementing ingestion processes for unstructured and structured data setsExperience designing and developing data cleansing routines utilizing standard data operationsKnowledge of data, master data, and metadata related standards and processesExperience working with multi-Terabyte data sets, troubleshooting issues, performance tuning of Spark and SQL queriesExperience using Azure DevOps/Github actions CI/CD pipelines to deploy codeMicrosoft Azure certifications are a plusMinimum of 7 years of hands-on experience working on design, configuration, implementation, and data migration for medium to large sized enterprise data platforms.
#J-18808-Ljbffr