Job description:
ABOUT CLIENT:
We are partnering with a leading Data & AI Consulting organisation to hire an experienced Databricks Solution Architect for a permanent opportunity based in Sydney, Australia.
If you've successfully delivered enterprise Databricks solutions and enjoy solving complex data and AI challenges, I'd love to hear from you.
Location: Sydney, Australia (Hybrid)
KEY RESPONSIBILITIES :
SOLUTION ARCHITECTURE & DESIGN
- Design and lead enterprise-scale Data & AI solutions on the Databricks Lakehouse Platform.
- Architect scalable, secure, and high-performance data platforms across AWS, Azure, and/or GCP.
- Define end-to-end solution architecture, ensuring alignment with business and technical objectives.
- Recommend best practices for data engineering, governance, security, and platform modernization.
ENTERPRISE DELIVERY & IMPLEMENTATION
- Lead end-to-end delivery of enterprise Databricks implementations from discovery through production deployment.
- Successfully deliver large-scale production workloads with a focus on scalability, reliability, and performance.
- Solve complex production challenges involving distributed data processing, platform optimization, and cloud-native architectures.
- Ensure successful delivery within agreed timelines, quality standards, and customer expectations
DATA ENGINEERING & PLATFORM EXCELLENCE
- Develop and optimize enterprise data pipelines using Apache Spark and Databricks.
- Build scalable ETL/ELT frameworks using Delta Lake and modern data engineering practices.
- Apply deep understanding of Spark architecture, execution plans, and runtime optimization.
- Drive platform performance tuning, cost optimization, and workload scalability.
CLOUD & MODERN DATA PLATFORM
- Design and implement cloud-native data solutions across AWS, Azure, and GCP.
- Collaborate with platform engineering teams to implement CI/CD pipelines and deployment automation.
- Apply Infrastructure-as-Code and DevOps best practices where applicable.
- Support enterprise MLOps implementation and integration with modern AI workflows.
CUSTOMER ENGAGEMENT & CONSULTING
- Lead architecture workshops, technical discovery sessions, and executive presentations.
- Partner with customers to understand business challenges and translate them into scalable technical solutions.
- Provide technical leadership throughout implementation and post-production support.
- Build trusted advisor relationships with business and technology stakeholders.
CUSTOMER ENGAGEMENT & CONSULTING
- Define enterprise architecture standards and implementation best practices.
- Promote reusable solution accelerators, coding standards, and governance frameworks.
- Ensure security, compliance, data quality, and operational excellence across all implementations.
- Mentor engineering teams and contribute to capability building across the organization.
Qualifications:
KNOWLEDGE & EXPERIENCE
- 10+ years of consulting and technology experience.
- Minimum 7+ years in Data Engineering, Data Platforms, or Analytics.
- Minimum 68 enterprise Databricks implementations delivered in production environments.
- Hands-on enterprise delivery experience is mandatory.
- Experience designing and deploying large-scale distributed data platforms.
- Strong customer-facing consulting and solution architecture experience.
- Experience working with global enterprise customers across multiple industries.
EDUCATION & PROFESSIONAL QUALIFICATIONS
- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related discipline.
- Master's degree preferred.
- Databricks Data Engineer Professional Certification (Mandatory).
- Databricks Solution Architect Champion recognized by Databricks (Mandatory)
- Additional cloud certifications (AWS, Azure, or GCP) are highly desirable.
SOFT SKILLS
- Excellent technical competency.
- Strong communication and presentation skills.
- Consulting mindset with strong problem-solving ability.
- Executive presence and stakeholder management capability.
- Customer engagement and workshop facilitation skills.
- Ability to influence technical and business decision-makers.
Why is This a Great Opportunity:
Great company
Growing rapidly in Globally, Europe and APAC
Opportunity to work on the most cutting edge technology and be a part of a small Australian team that will shape and grow the ANZ operation of the company.
Nigel