Chief Architect - Data Engineering (Databricks Practice)

Chief Architect – Data Engineering (Databricks Practice) | Sydney
We’re partnering with a specialist technology consultancy that is building a high-growth Databricks practice across Australia and the wider APAC region.This is an opportunity to become the technical anchor of the practice—owning enterprise architecture, leading major transformation programs and helping build the capability from the ground up.
This is not a diagram-only architecture role. We’re looking for someone who can confidently present to CTOs and architecture boards while remaining hands-on enough to diagnose Spark performance issues and guide engineering teams through complex delivery challenges.
What you’ll be doing• Owning end-to-end architecture across enterprise Databricks engagements• Designing secure, scalable and high-performing Lakehouse platforms• Leading large-scale cloud, data warehouse, ETL and Hadoop migrations• Driving discovery, solution design, estimation, PoCs, RFPs and proposals• Presenting and defending architecture decisions to senior stakeholders• Establishing engineering standards and leading design and code reviews• Mentoring engineers and developing the wider Databricks capability• Creating reusable accelerators and go-to-market offerings• Remaining hands-on with Spark performance, debugging and optimisation
What we’re looking for• 12+ years of experience in data engineering or data architecture• 3+ years delivering Databricks solutions at enterprise scale• Deep expertise in Apache Spark, Delta Lake and Lakehouse architecture• Strong Python and SQL skills, with Scala highly regarded• Experience with Unity Catalog, Databricks Workflows, Lakeflow/DLT, Airflow or ADF• Azure, AWS or GCP data-platform experience• Demonstrated leadership of major migration or modernisation programs• Strong presales, estimation and executive stakeholder capability• Experience mentoring engineers and establishing architecture standards• Databricks professional certification or Solution Architect accreditation preferred
Why consider it?• Permanent position based in Sydney• Australian-standard employee benefits• Opportunity to shape and grow a Databricks practice• Influence across architecture, delivery and go-to-market strategy• Exposure to major enterprise transformation programs• Hands-on technical leadership with genuine decision-making authorityCandidates must be available immediately or have a maximum notice period of 30 days.
The selection process includes two technical interviews followed by one client interview with Databricks.
If you’re a senior Databricks architect who wants to build, lead and remain close to the technology, apply now or contact me for a confidential discussion.