Databricks Admin from Elgebra

Ownership of Databricks as a strategic  and operational resource - Complete ownership of the product for the data solutions

• Expertise in migrating to and enabling Unity Catalog (UC) within Databricks environments.

• Management of Databricks at the Workspace and Account levels with a centralized approach.

• Experience with setting up UC across multiple workspaces, including separate environments for Production and Non-Production.

• Capability to handle deduplication of workspaces efficiently.

• Proficient in implementing access control mechanisms to secure data and workflows.

• Ability to assist during the migration to Unity Catalog, ensuring a smooth transition.

• Knowledge and experience in managing licensing, resource utilization, scaling, and storage specifically for Databricks on AWS.

• Experience in spinning up new Databricks workspaces and migrating data from AWS S3 buckets.

• Ability to create and manage new server clusters on AWS efficiently.
Good Experience in Apache Spark and Delta Lake Technology (DLT), as well as Hive Metastore management.

• Skills in query optimization, managing notebooks, and effectively utilizing Databricks for data operations.

• Understanding of role-based access control (RBAC) and attribute-based access control (ABAC), along with overall data governance.

• Expertise in metadata modeling to support effective data management and analysis.

• Knowledge in handling sensitive information, including skills in data segregation, encryption, and anonymization to ensure privacy and compliance.

• Basic knowledge of AWS services, including VPC, Private Subnet, NACL, and VPC Endpoints