Avanade
Avanade
Avanade provides cloud-based link management and digital connection tools for businesses. Its platform supports URL shortening, branded links, QR codes—including dynamic and GS1 Digital Link formats—mobile landing pages, digital business cards, UTM campaign tracking, link analytics, APIs, and integrations. These capabilities help marketing, developer, and customer service teams create, manage, and measure customer interactions across digital channels, with enterprise-focused security and compliance features.

Data Engineer Consultant – Databricks and Azure (Melbourne Onsite)

Build scalable Azure data pipelines and PySpark transformations with Databricks. Support analytics and data science programs in financial services.

Description

  • Create and improve scalable ingestion pipelines with Azure Data Factory, Databricks, and Apache Spark
  • Develop and maintain PySpark notebooks for data preparation, transformation, and enrichment supporting data science initiatives
  • Partner with data scientists to clarify requirements and deliver reliable, structured datasets on schedule
  • Establish data quality controls, validation rules, and monitoring processes
  • Connect and process structured, semi-structured, and unstructured data sources
  • Apply security, governance, and banking compliance standards to data solutions
  • Tune Azure Spark workloads to improve performance and control costs
  • Contribute to code reviews, solution design sessions, and agile ceremonies
  • Maintain documentation covering pipelines, workflows, and technical decisions

Requirements

  • Bring at least three years of hands-on experience with Azure Databricks
  • Demonstrate strong Apache Spark expertise, particularly PySpark for distributed processing
  • Have experience with Azure Data Factory, Azure Synapse, Azure Blob Storage, and Delta Lake
  • Understand ETL/ELT workflows, data modeling, and data warehousing principles
  • Use Python and/or Scala for data processing
  • Experience with CI/CD workflows using Azure DevOps, Git, and Terraform is preferred
  • Be familiar with SQL, NoSQL, and data lake architectures
  • Understand data governance, security, and compliance practices in financial services
  • Apply strong analytical and problem-solving abilities
  • Communicate effectively with stakeholders
  • Work productively across cross-functional teams
  • Bring an Agile mindset and experience in Scrum or similar environments
  • Hold Australian citizenship
  • Be eligible to obtain security clearance
  • A Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field is preferred
  • Databricks Certified Data Engineer Associate or Professional certification is advantageous
  • Experience in banking or financial services is highly desirable

Related Jobs

Kreato Global | BPO and Language Solutions

Remote English-Spanish OPI/VRI Interpreter

Kreato Global | BPO and Language Solutions
201 – 500 Employees
HealthcareHospitalityLogistics

Interpret remotely between English- and Spanish-speaking people in medical, financial, social service, and customer care settings. Provide language support for Kreato Global across Latin America.

Open
SPERTON - Where Great People Meet

Sales Executive, Elevators and Car Parking Systems

SPERTON - Where Great People Meet
51 – 200 Employees

Drive elevator and car parking system sales across Mumbai’s Western Region. Build client and dealer relationships, and manage deals from initial enquiry through project execution.

Open