Xcel Energy
Senior Databricks Platform Engineer
Xcel Energy, Golden, Colorado, United States, 80401
Are you looking for an exciting job where you can put your skills and talents to work at a company you can feel proud to be a part of? Do you want a workplace that will challenge you and offer you opportunities to learn and grow? A position at Xcel Energy could be just what you’re looking for.
Position Summary
The Senior Databricks Platform Engineer is responsible for leading technical aspects of IT solution delivery, strategic planning, and operational excellence. They are responsible for managing the overall health of the technology ecosystem and will manage and oversee design of solutions to meet business needs and support the overall IT Strategy. They provide technical guidance in partnership with Architecture and with cross-organizational input and in accordance with business unit objectives. They are a consultant to business managers, architecture, security and operations teams to drive cross-awareness of business needs and opportunities. They bring innovative solutions to the business line by leveraging their technical expertise. They identify and implement continuous improvement over cost, security, operation, and functionality of the solutions in their domain.
As a Sr Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You’ll handle administration, configuration, and optimization to support data analytics, machine learning, and data engineering activities. You will lead and mentor a team of Databricks Platform Engineers to ensure the effective use and administration of the Databricks platform. Collaborating with data engineers, data scientists, and stakeholders, you’ll ensure the platform aligns with requirements while maintaining security and performance standards.
Essential Responsibilities
Solution Delivery: Lead and support solution lifecycle technical activities. Ensure solutions are designed for great user experience and operational performance. Lead design, ensuring Enterprise Architecture, Security, Operations and Compliance aspects are continuously integrated into solutions. Provide input to cost and schedule estimation. Responsible for overall integrity of system design and operation. Oversee vendor activities.
Relationship Management: Conduct peer reviews and approve system changes and technical solution design. Coach and mentor less experienced team members. Partner cross-organizationally to drive minimal costs on optimal solutions. Provide in-depth technical information to stakeholders as needed.
Strategy & Planning: Innovate through usage of industry emerging capabilities and evolving customer needs. Provide input to strategic roadmap and technical dependencies.
Subject Matter Expertise: Continuously stay current on, and apply, technical industry knowledge pertaining to the respective domain.
Operations: Review solution performance, and continually assess health of systems. Track and drive awareness to operational and technical debt risks. Provide escalated support to incident and problem management. Utilize analytics to improve availability, reliability, efficiency and capacity. Oversee vendor activities.
Configure, deploy and maintain Databricks clusters and workspaces.
Utilize IAC via Terraform to provision and deploy Databricks clusters, workspaces, and associated AWS resources.
Optimize cluster configurations, monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance.
Implement and manage access controls and security policies to protect sensitive data.
Manage platform feature and software releases and updates.
Provide technical support to Databricks users, including troubleshooting and issue resolution.
Conduct training sessions to educate users on platform best practices and capabilities.
Monitor and manage auto-scaling to ensure resources are allocated efficiently.
Stay up-to-date with security best practices and compliance requirements.
Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability.
Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes.
Monitor and manage platform costs, including optimizing resource utilization to control expenses.
Maintain detailed documentation of configurations, procedures, and best practices.
Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts to understand their requirements and provide technical solutions.
Minimum Requirements
Ten years of related functional experience.
Bachelor's degree in technology, Science, Business or related field, or 4 years of experience equivalent to the position.
Excellent communication skills, effective with varying organizational levels and skill set, and able to translate between technical and non-technical concepts.
Excellent Relationship Management and collaboration skills, with a track record of working as one team cross-organizationally to drive innovation and business results.
Expertise managing the lifecycle of technical solutions.
Deep Subject Matter Expertise within the respective system domain products, platforms, processes and architecture.
Broad and deep knowledge of technology architecture, infrastructure, network, security and software principles and models.
Experience working in partnership with internal and external vendors.
Excellent analytical, problem-solving and troubleshooting skills.
Extensive knowledge of future technology trends within area of expertise.
Demonstrated leadership on technical aspects of large-scale projects.
Experience coaching other developers in system deployment or operational troubleshooting.
Experience with delivery methodologies (Waterfall, Agile, Scrum) and operational models (ITIL).
Experience and understanding of core IT Service Management functions, such as Change Management and Incident Management.
Professional Competencies:
Integrity and Trust
Customer Focus
Functional/Technical skills
Written/Oral Communication
Excellent analytical and problem-solving skills.
Ability to adapt to different projects and assignments quickly.
Team player with strong communication skills.
Preferred Requirements
Bachelor's degree in a relevant field (computer science, data engineering, etc.)
7+ years of related professional experience.
3 years’ experience with Databricks Lakehouse Platform Architecture on AWS.
Strong knowledge of IaC via Terraform HCL, SQL, Python, Apache Spark, Gitlab CI/CD pipelines, MLOps, Databricks Bundles.
Proficiency in AWS cloud platforms.
Experience in Utility and Energy related business is a plus.
As a leading combination electricity and natural gas energy company, Xcel Energy offers a comprehensive portfolio of energy-related products and services to 3.4 million electricity and 1.9 million natural gas customers across eight Western and Midwestern states. At Xcel Energy, we strive to be the preferred and trusted provider of the energy our customers need. If you’re ready to be a part of something big, we invite you to join our team.
All qualified applicants will receive consideration for employment without regard to age, race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Individuals with a disability who need an accommodation to apply please contact us at recruiting@xcelenergy.com.
Non-Bargaining
The anticipated starting base pay for this position is: $105,600.00 to $172,200.00 per year.
This position is eligible for the following benefits: Annual Incentive Program, Medical/Pharmacy Plan, Dental, Vision, Life Insurance, Dependent Care Reimbursement Account, Health Care Reimbursement Account, Health Savings Account (HSA) (if enrolled in eligible health plan), Limited-Purpose FSA (if enrolled in eligible health plan and HSA), Transportation Reimbursement Account, Short-term disability (STD), Long-term disability (LTD), Employee Assistance Program (EAP), Fitness Center Reimbursement (if enrolled in eligible health plan), Tuition reimbursement, Transit programs, Employee recognition program, Pension, 401(k) plan, Paid time off (PTO), Holidays, Volunteer Paid Time Off (VPTO), Parental Leave.
Benefit plans are subject to change and Xcel Energy has the right to end, suspend, or amend any of its plans, at any time, in whole or in part.
Deadline to Apply: 10/31/24.
EEO is the Law | EEO is the Law Supplement | Pay Transparency Nondiscrimination | Equal Opportunity Policy (PDF) | Employee Rights (PDF)
ACCESSIBILITY STATEMENTXcel Energy endeavors to make https://www.xcelenergy.com/ accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact Xcel Energy Talent Acquisition at recruiting@xcelenergy.com. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications.
#J-18808-Ljbffr
Position Summary
The Senior Databricks Platform Engineer is responsible for leading technical aspects of IT solution delivery, strategic planning, and operational excellence. They are responsible for managing the overall health of the technology ecosystem and will manage and oversee design of solutions to meet business needs and support the overall IT Strategy. They provide technical guidance in partnership with Architecture and with cross-organizational input and in accordance with business unit objectives. They are a consultant to business managers, architecture, security and operations teams to drive cross-awareness of business needs and opportunities. They bring innovative solutions to the business line by leveraging their technical expertise. They identify and implement continuous improvement over cost, security, operation, and functionality of the solutions in their domain.
As a Sr Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You’ll handle administration, configuration, and optimization to support data analytics, machine learning, and data engineering activities. You will lead and mentor a team of Databricks Platform Engineers to ensure the effective use and administration of the Databricks platform. Collaborating with data engineers, data scientists, and stakeholders, you’ll ensure the platform aligns with requirements while maintaining security and performance standards.
Essential Responsibilities
Solution Delivery: Lead and support solution lifecycle technical activities. Ensure solutions are designed for great user experience and operational performance. Lead design, ensuring Enterprise Architecture, Security, Operations and Compliance aspects are continuously integrated into solutions. Provide input to cost and schedule estimation. Responsible for overall integrity of system design and operation. Oversee vendor activities.
Relationship Management: Conduct peer reviews and approve system changes and technical solution design. Coach and mentor less experienced team members. Partner cross-organizationally to drive minimal costs on optimal solutions. Provide in-depth technical information to stakeholders as needed.
Strategy & Planning: Innovate through usage of industry emerging capabilities and evolving customer needs. Provide input to strategic roadmap and technical dependencies.
Subject Matter Expertise: Continuously stay current on, and apply, technical industry knowledge pertaining to the respective domain.
Operations: Review solution performance, and continually assess health of systems. Track and drive awareness to operational and technical debt risks. Provide escalated support to incident and problem management. Utilize analytics to improve availability, reliability, efficiency and capacity. Oversee vendor activities.
Configure, deploy and maintain Databricks clusters and workspaces.
Utilize IAC via Terraform to provision and deploy Databricks clusters, workspaces, and associated AWS resources.
Optimize cluster configurations, monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance.
Implement and manage access controls and security policies to protect sensitive data.
Manage platform feature and software releases and updates.
Provide technical support to Databricks users, including troubleshooting and issue resolution.
Conduct training sessions to educate users on platform best practices and capabilities.
Monitor and manage auto-scaling to ensure resources are allocated efficiently.
Stay up-to-date with security best practices and compliance requirements.
Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability.
Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes.
Monitor and manage platform costs, including optimizing resource utilization to control expenses.
Maintain detailed documentation of configurations, procedures, and best practices.
Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts to understand their requirements and provide technical solutions.
Minimum Requirements
Ten years of related functional experience.
Bachelor's degree in technology, Science, Business or related field, or 4 years of experience equivalent to the position.
Excellent communication skills, effective with varying organizational levels and skill set, and able to translate between technical and non-technical concepts.
Excellent Relationship Management and collaboration skills, with a track record of working as one team cross-organizationally to drive innovation and business results.
Expertise managing the lifecycle of technical solutions.
Deep Subject Matter Expertise within the respective system domain products, platforms, processes and architecture.
Broad and deep knowledge of technology architecture, infrastructure, network, security and software principles and models.
Experience working in partnership with internal and external vendors.
Excellent analytical, problem-solving and troubleshooting skills.
Extensive knowledge of future technology trends within area of expertise.
Demonstrated leadership on technical aspects of large-scale projects.
Experience coaching other developers in system deployment or operational troubleshooting.
Experience with delivery methodologies (Waterfall, Agile, Scrum) and operational models (ITIL).
Experience and understanding of core IT Service Management functions, such as Change Management and Incident Management.
Professional Competencies:
Integrity and Trust
Customer Focus
Functional/Technical skills
Written/Oral Communication
Excellent analytical and problem-solving skills.
Ability to adapt to different projects and assignments quickly.
Team player with strong communication skills.
Preferred Requirements
Bachelor's degree in a relevant field (computer science, data engineering, etc.)
7+ years of related professional experience.
3 years’ experience with Databricks Lakehouse Platform Architecture on AWS.
Strong knowledge of IaC via Terraform HCL, SQL, Python, Apache Spark, Gitlab CI/CD pipelines, MLOps, Databricks Bundles.
Proficiency in AWS cloud platforms.
Experience in Utility and Energy related business is a plus.
As a leading combination electricity and natural gas energy company, Xcel Energy offers a comprehensive portfolio of energy-related products and services to 3.4 million electricity and 1.9 million natural gas customers across eight Western and Midwestern states. At Xcel Energy, we strive to be the preferred and trusted provider of the energy our customers need. If you’re ready to be a part of something big, we invite you to join our team.
All qualified applicants will receive consideration for employment without regard to age, race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Individuals with a disability who need an accommodation to apply please contact us at recruiting@xcelenergy.com.
Non-Bargaining
The anticipated starting base pay for this position is: $105,600.00 to $172,200.00 per year.
This position is eligible for the following benefits: Annual Incentive Program, Medical/Pharmacy Plan, Dental, Vision, Life Insurance, Dependent Care Reimbursement Account, Health Care Reimbursement Account, Health Savings Account (HSA) (if enrolled in eligible health plan), Limited-Purpose FSA (if enrolled in eligible health plan and HSA), Transportation Reimbursement Account, Short-term disability (STD), Long-term disability (LTD), Employee Assistance Program (EAP), Fitness Center Reimbursement (if enrolled in eligible health plan), Tuition reimbursement, Transit programs, Employee recognition program, Pension, 401(k) plan, Paid time off (PTO), Holidays, Volunteer Paid Time Off (VPTO), Parental Leave.
Benefit plans are subject to change and Xcel Energy has the right to end, suspend, or amend any of its plans, at any time, in whole or in part.
Deadline to Apply: 10/31/24.
EEO is the Law | EEO is the Law Supplement | Pay Transparency Nondiscrimination | Equal Opportunity Policy (PDF) | Employee Rights (PDF)
ACCESSIBILITY STATEMENTXcel Energy endeavors to make https://www.xcelenergy.com/ accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact Xcel Energy Talent Acquisition at recruiting@xcelenergy.com. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications.
#J-18808-Ljbffr