Required skills
Languages: English
Job description
Project overview
Introduction & Summary
We are seeking an experienced Databricks Architect to shape and oversee the platform's target architecture, ensuring it is secure, cost-effective, and maintained by our dedicated team post-launch. The ideal candidate will possess exceptional skills in data architecture and governance, along with a strong commitment to engineering standards.
Main Responsibilities
Key Requirements
- Develop a reference architecture for the platform, including workspaces, environments, networking, and medallion layers.
- Design the governance of Unity Catalog, focusing on domain-based catalog structure, access model, and managing grants as code in Terraform.
- Establish engineering standards for Databricks asset bundles, CI/CD processes, code review, testing, and environment promotion.
- Define data product patterns, encompassing data contracts, output ports, and delineation between core and composite products.
- Implement cost control methods including cluster policies, serverless usage, tagging, and budget alerts.
- Collaborate with the lead architect on critical architecture decisions and document them as formal decision records.
- Provide coaching to data platform engineers and transfer all designs prior to go-live.
- Extensive experience with Databricks architecture and governance
- Proficient with Terraform for managing infrastructure as code
- Strong understanding of data product definitions and contracts
- Experience setting engineering standards and CI/CD processes
- Proven ability to implement cost control measures in cloud environments
Nice to have
- Familiarity with data modeling techniques
- Experience in mentoring or coaching engineering teams
Project details
ASAP
7-8 months
Copenhagen
- Start: flexible
- Duration: 7-9 months
- Remote: hybrid
- Location: Copenhagen, Denmark, DK
- Languages: English
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on portal.emagine.org