Job Details

Databricks Data Architect

Job Description

We empower enterprises globally through intelligent, creative, and insightful services for:

  • Data Integration
  • Data Analytics
  • Data Visualization

Hoonartek is a leader in enterprise transformation, data engineering, and a world-class Ab Initio delivery partner. With extensive experience, research, and leadership, we help clients:

  • Modernize legacy systems
  • Deliver big data hubs
  • Build operational data integration
  • Enable business intelligence
  • Provide risk & compliance solutions
  • Develop traditional data warehouses & marts

We are committed to delivery, quality, and value—making us a trusted partner known for vision and integrity.


HOW WE WORK

Our in-house philosophy D3 (Define, Design, Deliver) is derived from agile and rapid methodologies, focusing on:

  • “Just enough design”
  • Flexibility (Agile & Waterfall when needed)
  • Strong customer and employee relationships

Our focus is always on delivery and value.


JOB DESCRIPTION

We are seeking an experienced Senior Data Architect to design and lead scalable, secure, and high-performance data platforms.

Key Responsibilities

1. Data Architecture & Strategy

  • Define enterprise data architecture roadmap
  • Design modern Lakehouse architecture using Databricks
  • Establish data modeling standards (Dimensional, Medallion)
  • Lead architecture across ingestion, transformation, storage, and consumption
  • Design Databricks workspace architecture (clusters, governance, Unity Catalog)
  • Architect orchestration frameworks (Workflows / schedulers)
  • Integrate APIs, Key Vault, enterprise systems, AI/LLM services
  • Perform capacity planning and cost estimation

2. Databricks Platform Leadership

  • Architect solutions using Delta Lake, Unity Catalog, Workflows
  • Build ETL/ELT pipelines using PySpark, SQL
  • Implement Delta Lake features (ACID, time travel, schema evolution)
  • Optimize performance and cost
  • Design cloud landing zones

3. Cloud Data Engineering

  • Design scalable solutions on Azure (preferred), AWS, GCP
  • Integrate with:
    • Azure Data Factory / AWS Glue
    • ADLS / S3 / BigQuery
  • Build real-time and batch pipelines

4. Data Governance & Security

  • Implement governance frameworks (Unity Catalog)
  • Ensure data quality, lineage, and compliance
  • Define access controls and security policies

5. Stakeholder Management

  • Collaborate with business and technical teams
  • Translate business needs into technical solutions
  • Provide architectural leadership

6. Performance & Optimization

  • Optimize pipelines, storage, and compute
  • Implement monitoring and logging
  • Ensure scalability and high availability

7. Team Leadership

  • Mentor engineers and architects
  • Establish best practices and standards
  • Lead design reviews and governance forums

EXPERTISE AND QUALIFICATIONS

Required Qualifications

  • Bachelor’s/Master’s in Computer Science or related field
  • 10+ years in data engineering/architecture
  • 4+ years hands-on Databricks experience

TECHNICAL SKILLS

Must-Have

  • Databricks: Delta Lake, Unity Catalog, Workflows, Lakeflow, Lakebase
  • Strong knowledge of Databricks architecture
  • Cluster sizing, autoscaling, cost optimization (FinOps)
  • CI/CD pipelines and Declarative Automation Bundle (DAB)
  • PySpark, SQL, Python
  • Data modeling: Dimensional, Data Vault
  • Cloud platforms: Azure / AWS / GCP
  • Data warehousing and integration patterns
  • API integrations
  • Exposure to AI/ML/LLM (MLflow, APIs)
  • Enterprise security architecture

Good-to-Have

  • Network security: VNet, private endpoints, subnet isolation
  • Hybrid connectivity (VPN, ExpressRoute)
  • Cross-cloud architecture
  • IAM & Secret Management
  • Data governance tools (Collibra, Alation)
  • Real-time streaming

Thank you for your interest in this role. Please also share your CV at Vedika@lsarecruit.co.uk and if suitable, we will get in touch with you to discuss further.

    ×

    Apply for this Position

    All fields marked with * are required

    Accepted: PDF, DOC, DOCX (Max 5MB)