Databricks Solution Architect

Job Description

ABOUT CLIENT:

We are partnering with a leading Data & AI Consulting organisation to hire an experienced Databricks Solution Architect for a permanent opportunity based in Sydney, Australia.

If you've successfully delivered enterprise Databricks solutions and enjoy solving complex data and AI challenges, I'd love to hear from you.

Location: Sydney, Australia (Hybrid)

Key Responsibilities

SOLUTION ARCHITECTURE & DESIGN

Design and lead enterprise-scale Data & AI solutions on the Databricks Lakehouse Platform.Architect scalable, secure, and high-performance data platforms across AWS, Azure, and/or GCP.Define end-to-end solution architecture, ensuring alignment with business and technical objectives.Recommend best practices for data engineering, governance, security, and platform modernization.

ENTERPRISE DELIVERY & IMPLEMENTATION

Lead end-to-end delivery of enterprise Databricks implementations from discovery through production deployment.Successfully deliver large-scale production workloads with a focus on scalability, reliability, and performance.Solve complex production challenges involving distributed data processing, platform optimization, and cloud-native architectures.Ensure successful delivery within agreed timelines, quality standards, and customer expectations

DATA ENGINEERING & PLATFORM EXCELLENCE

Develop and optimize enterprise data pipelines using Apache Spark and Databricks.Build scalable ETL/ELT frameworks using Delta Lake and modern data engineering practices.Apply deep understanding of Spark architecture, execution plans, and runtime optimization.Drive platform performance tuning, cost optimization, and workload scalability.

CLOUD & MODERN DATA PLATFORM

Design and implement cloud-native data solutions across AWS, Azure, and GCP.Collaborate with platform engineering teams to implement CI/CD pipelines and deployment automation.Apply Infrastructure-as-Code and DevOps best practices where applicable.Support enterprise MLOps implementation and integration with modern AI workflows.

CUSTOMER ENGAGEMENT & CONSULTING

Lead architecture workshops, technical discovery sessions, and executive presentations.Partner with customers to understand business challenges and translate them into scalable technical solutions.Provide technical leadership throughout implementation and post-production support.Build trusted advisor relationships with business and technology stakeholders.

CUSTOMER ENGAGEMENT & CONSULTING

Define enterprise architecture standards and implementation best practices.Promote reusable solution accelerators, coding standards, and governance frameworks.Ensure security, compliance, data quality, and operational excellence across all implementations.Mentor engineering teams and contribute to capability building across the organization.

Qualifications

KNOWLEDGE & EXPERIENCE

10+ years of consulting and technology experience.Minimum 7+ years in Data Engineering, Data Platforms, or Analytics.Minimum 68 enterprise Databricks implementations delivered in production environments.Hands-on enterprise delivery experience is mandatory.Experience designing and deploying large-scale distributed data platforms.Strong customer-facing consulting and solution architecture experience.Experience working with global enterprise customers across multiple industries.

Education & Professional Qualifications

Bachelor's degree in Computer Science, Engineering, Information Technology, or a related discipline.Master's degree preferred.Databricks Data Engineer Professional Certification (Mandatory).Databricks Solution Architect Champion recognized by Databricks (Mandatory)Additional cloud certifications (AWS, Azure, or GCP) are highly desirable.

Soft Skills

Excellent technical competency.Strong communication and presentation skills.Consulting mindset with strong problem-solving ability.Executive presence and stakeholder management capability.Customer engagement and workshop facilitation skills.Ability to influence technical and business decision-makers.

Why Is This a Great Opportunity

Great company

Growing rapidly in Globally, Europe and APAC

Opportunity to work on the most cutting edge technology and be a part of a small Australian team that will shape and grow the ANZ operation of the company.