Skip to content

Databricks Admin

Foster City, CA Full Time Posted by: Elgebra Posted: Friday, 24 May 2024
 
Ownership of Databricks as a strategic and operational resource - Complete ownership of the product for the data solutions Expertise in migrating to and enabling Unity Catalog (UC) within Databricks environments. Management of Databricks at the Workspace and Account levels with a centralized approach.

Experience with setting up UC across multiple workspaces, including separate environments for Production and Non-Production. Capability to handle deduplication of workspaces efficiently. Proficient in implementing access control mechanisms to secure data and workflows.

Ability to assist during the migration to Unity Catalog, ensuring a smooth transition. Knowledge and experience in managing licensing, resource utilization, scaling, and storage specifically for Databricks on AWS. Experience in spinning up new Databricks workspaces and migrating data from AWS S3 buckets.

Ability to create and manage new server clusters on AWS efficiently. Good Experience in Apache Spark and Delta Lake Technology (DLT), as well as Hive Metastore management. Skills in query optimization, managing notebooks, and effectively utilizing Databricks for data operations.

Understanding of role-based access control (RBAC) and attribute-based access control (ABAC), along with overall data governance. Expertise in metadata modeling to support effective data management and analysis. Knowledge in handling sensitive information, including skills in data segregation, encryption, and anonymization to ensure privacy and compliance.

Basic knowledge of AWS services, including VPC, Private Subnet, NACL, and VPC Endpoints.

Foster City, CA, USA
Elgebra
AJF/711418462
24/05/2024 05:46

We strongly recommend that you should never provide your bank account details to an advertiser during the job application process. Should you receive a request of this nature please contact support giving the advertiser's name and job reference.