Текст заказа
Introduction & Summary
We are seeking an experienced Databricks Architect to shape and oversee the platform's target architecture, ensuring it is secure, cost-effective, and maintained by our dedicated team post-launch. The ideal candidate will possess exceptional skills in data architecture and governance, along with a strong commitment to engineering standards.
Main Responsibilities
• Develop a reference architecture for the platform, including workspaces, environments, networking, and medallion layers.
• Design the governance of Unity Catalog, focusing on domain-based catalog structure, access model, and managing grants as code in Terraform.
• Establish engineering standards for Databricks asset bundles, CI/CD processes, code review, testing, and environment promotion.
• Define data product patterns, encompassing data contracts, output ports, and delineation between core and composite products.
• Implement cost control methods including cluster policies, serverless usage, tagging, and budget alerts.
• Collaborate with the lead architect on critical architecture decisions and document them as formal decision records.
• Provide coaching to data platform engineers and transfer all designs prior to go-live.
Key Requirements
Extensive experience with Databricks architecture and governance
Proficient with Terraform for managing infrastructure as code
Strong understanding of data product definitions and contracts
Experience setting engineering standards and CI/CD processes
Proven ability to implement cost control measures in cloud environments
Nice to Have
Familiarity with data modeling techniques
Experience in mentoring or coaching engineering teams
Start: ASAP
Duration: 7-8 months
Location: Copenhagen