Baldwin Risk Partners
AWS Databricks Platform Administrator
Baldwin Risk Partners, Tampa, Florida, us, 33646
This position will require location in Tampa, FL with a hybrid work environment.
The Baldwin Group is an award-winning entrepreneur-led and inspired insurance brokerage firm delivering expertly crafted Commercial Insurance and Risk Management, Private Insurance and Risk Management, Employee Benefits and Benefit Administration, Asset and Income Protection, and Risk Mitigation strategies to clients wherever their passions and businesses take them throughout the U.S. and abroad. The Baldwin Group has award-winning industry expertise, colleagues, competencies, insurers, and most importantly, a highly differentiated culture that our clients consider an invaluable expansion of their business. The Baldwin Group (NASDAQ: BWIN), takes a holistic and tailored approach to insurance and risk management.
The AWS Databricks Platform administrator is a technical role to design, implement and maintain process used to manage the organization's Databricks platform. The administrator will be responsible for facilitating the work of data analysts, data engineers and data scientists while maintaining best practices for security and compliance. Unity catalog will be used to implement access and identity policies. Infrastructure will be maintained using Terraform. The administrator will be responsible for assisting with compute issues, monitoring and alerting, and assuring the platform functions smoothly. This role requires great organization and communication skills.
Job responsibilities:
Manage and maintain role-based access to data and features in the Databricks Platform using Unity CatalogImplement external access controls for outside teams using service principles, SQL warehouses and Delta SharingWork with platform users to solve problems and facilitate workCreate infrastructure for AWS and Databricks using Terraform: S3, IAM roles, Instance Profiles, KMS KeysImprove processes and systems used to manage infrastructure, users and external accessKeep track of unused assets for pruningUnderstand and implement best practices for security and complianceImplement service principles and access tokens for external usersUnderstand how to utilize Databricks APIs to automate administrative tasksCreate queries and dashboards to monitor critical systems and processesCreate documentation for users and adminsAutomate common admin tasks using Databricks notebooksManage workflow tags, cluster tags, workflow naming convention enforcementClusters health check and best practices implementationRegular back up & recoveryPrivilege reviews on users and resourcesRequired qualifications:
4 or more years of experience administering the Databricks platformStrong understanding of data engineering needsExperience creating AWS infrastructure with TerraformStrong understanding of AWS infrastructure required by DatabricksExperience with compliance audits/audit documentationExperience using Databricks APIs with tools like PostmanUnderstanding of the Databricks workspace and development environmentExperience using GitHub to manage source codeStrong SQL skills for creating admin related queries and dashboardsStrong debugging skillsAbility to do risk analysis for 3rd party integrations with AWS resources.Knowledge of Python a plusFamiliarity with Datadog
#LI-TD1
Click here for some insight into our culture!
The Baldwin Group is an award-winning entrepreneur-led and inspired insurance brokerage firm delivering expertly crafted Commercial Insurance and Risk Management, Private Insurance and Risk Management, Employee Benefits and Benefit Administration, Asset and Income Protection, and Risk Mitigation strategies to clients wherever their passions and businesses take them throughout the U.S. and abroad. The Baldwin Group has award-winning industry expertise, colleagues, competencies, insurers, and most importantly, a highly differentiated culture that our clients consider an invaluable expansion of their business. The Baldwin Group (NASDAQ: BWIN), takes a holistic and tailored approach to insurance and risk management.
The AWS Databricks Platform administrator is a technical role to design, implement and maintain process used to manage the organization's Databricks platform. The administrator will be responsible for facilitating the work of data analysts, data engineers and data scientists while maintaining best practices for security and compliance. Unity catalog will be used to implement access and identity policies. Infrastructure will be maintained using Terraform. The administrator will be responsible for assisting with compute issues, monitoring and alerting, and assuring the platform functions smoothly. This role requires great organization and communication skills.
Job responsibilities:
Manage and maintain role-based access to data and features in the Databricks Platform using Unity CatalogImplement external access controls for outside teams using service principles, SQL warehouses and Delta SharingWork with platform users to solve problems and facilitate workCreate infrastructure for AWS and Databricks using Terraform: S3, IAM roles, Instance Profiles, KMS KeysImprove processes and systems used to manage infrastructure, users and external accessKeep track of unused assets for pruningUnderstand and implement best practices for security and complianceImplement service principles and access tokens for external usersUnderstand how to utilize Databricks APIs to automate administrative tasksCreate queries and dashboards to monitor critical systems and processesCreate documentation for users and adminsAutomate common admin tasks using Databricks notebooksManage workflow tags, cluster tags, workflow naming convention enforcementClusters health check and best practices implementationRegular back up & recoveryPrivilege reviews on users and resourcesRequired qualifications:
4 or more years of experience administering the Databricks platformStrong understanding of data engineering needsExperience creating AWS infrastructure with TerraformStrong understanding of AWS infrastructure required by DatabricksExperience with compliance audits/audit documentationExperience using Databricks APIs with tools like PostmanUnderstanding of the Databricks workspace and development environmentExperience using GitHub to manage source codeStrong SQL skills for creating admin related queries and dashboardsStrong debugging skillsAbility to do risk analysis for 3rd party integrations with AWS resources.Knowledge of Python a plusFamiliarity with Datadog
#LI-TD1
Click here for some insight into our culture!