Dennis Earl Hardy Inc
Databricks Architect
Dennis Earl Hardy Inc, Minneapolis, Minnesota, United States, 55400
Responsibilities:
Lead the design, implementation, and optimization of the Databricks platform.
Develop and maintain a platform optimized for performance, scalability, and reliability.
Collaborate with cross-functional teams to understand business requirements and provide technical solutions.
Design and implement data pipelines, ETL processes, and data models.
Implement security measures to ensure data privacy and compliance.
Troubleshoot and resolve performance issues, system errors, and data inconsistencies.
Manage the team, providing guidance and mentorship to junior members.
Key Skill Sets:
Strong experience with Databricks platform and related technologies.
Proficient in programming languages such as Python, Scala, or SQL.
In-depth knowledge of Apache Spark and its ecosystem.
Familiarity with cloud platforms like AWS or Azure.
Strong understanding of data engineering principles and best practices.
Experience in data modeling, data warehousing, and data integration techniques.
Excellent problem-solving and analytical skills.
Good communication and collaboration abilities.
Experience with Snowflake data platform (nice to have).
Minimum Qualifications:
Bachelor's degree in Computer Science, Engineering, or a related field.
At least 5 years of experience in data engineering or architecture roles.
Hands-on experience with the Databricks platform and Apache Spark.
Preferred Qualifications:
Master's degree in Computer Science, Engineering, or a related field.
Experience in the healthcare or medical device industry.
Certifications in Databricks or related technologies.
Knowledge of data governance and data quality frameworks.
Focus Areas:
Design and optimization of the Databricks platform.
Ensuring performance, scalability, and reliability of the platform.
Team management and leadership.
Developing data pipelines, ETL processes, and data models.
Implementing security and compliance measures.
Troubleshooting and resolving system issues.
Mentoring and fostering team collaboration.
Lead the design, implementation, and optimization of the Databricks platform.
Develop and maintain a platform optimized for performance, scalability, and reliability.
Collaborate with cross-functional teams to understand business requirements and provide technical solutions.
Design and implement data pipelines, ETL processes, and data models.
Implement security measures to ensure data privacy and compliance.
Troubleshoot and resolve performance issues, system errors, and data inconsistencies.
Manage the team, providing guidance and mentorship to junior members.
Key Skill Sets:
Strong experience with Databricks platform and related technologies.
Proficient in programming languages such as Python, Scala, or SQL.
In-depth knowledge of Apache Spark and its ecosystem.
Familiarity with cloud platforms like AWS or Azure.
Strong understanding of data engineering principles and best practices.
Experience in data modeling, data warehousing, and data integration techniques.
Excellent problem-solving and analytical skills.
Good communication and collaboration abilities.
Experience with Snowflake data platform (nice to have).
Minimum Qualifications:
Bachelor's degree in Computer Science, Engineering, or a related field.
At least 5 years of experience in data engineering or architecture roles.
Hands-on experience with the Databricks platform and Apache Spark.
Preferred Qualifications:
Master's degree in Computer Science, Engineering, or a related field.
Experience in the healthcare or medical device industry.
Certifications in Databricks or related technologies.
Knowledge of data governance and data quality frameworks.
Focus Areas:
Design and optimization of the Databricks platform.
Ensuring performance, scalability, and reliability of the platform.
Team management and leadership.
Developing data pipelines, ETL processes, and data models.
Implementing security and compliance measures.
Troubleshooting and resolving system issues.
Mentoring and fostering team collaboration.