3 Easy Steps

  • 1Search for courses by Study Area, Level and Location
  • 2We deliver you all the matched results
  • 3Choose one or more course providers to contact you

Distance from location (kms)

Exact 5 10 25 50 100

Posted since

All 2 Days 1 Week 2 Weeks 1 Month

Sort results by

Relevance Date



Bigdata Engineer

Westpac Group - Sydney, NSW

Source: uWorkin


Bigdata Engineer

  • ETL Developer
  • Westpac Institutional Banking
  • Permanent Full-time, Sydney

How will I help?

This role is part of the Data and Advanced Analytics Platforms team, which supports multiple data analytics platforms that ingest data from a wide range of operational data sources and make it available to consuming systems for reporting and analytics use cases.


  • Data Wrangling - Design and build complex large scale big data pipelines/workloads to gathering, selecting, and transforming data to make them appropriate for analytics and machine learning.
  • Data cleaning, imputation, summarization, aggregation, normalization. This competency area includes Outlier/Anomaly Detection, cleaning data, transforming categorical data to numerical data, grouping data based on values, and joining data, among others.
  • Work with Solution Architects and Solution Engineers to create detailed designs for data pipelines including batch, real time, and streaming.
  • Design and build complex optimal queries both functional and non-functional.
  • Build controls assurance for data completeness & accuracy.
  • Build automated tests for data pipelines.
  • Performance tune data loads.
  • Contribute to optimise existing Platform frameworks, components, and data templates.
  • Build DevOps (build & deployment) pipelines
  • Define and populate data models with associated technical and business metadata.

What’s in it for me?

You will play an important and significant part in the future of a business that has been around for 200 years. Our vision is to become one of the world’s great service companies. So, we will back you in the development of your career, with internal career prospects and flexible working. You will also be backed by a fantastic team of people in a can-do, supportive structure.

What do I need?

  • Experience in Bigdata , Informatica, Teradata , CTRL-M, Postgre SQL / MS SQL
  • Experience in Python, spark, shell/ bash scripting
  • Experience in Pytest, Junit, Informatica DVO
  • Experience in CI/CD , Devops and cloud
  • Good to have skills - Data modelling, Tableau , Power BI, Java , scala
  • Proficiency in API engineering including OpenAPI and Swagger
  • Significant experience in building data pipelines and datasets in large scale data platforms
  • Experience in Software delivery life cycle in both waterfall and agile delivery methodologies.

What is it like to work in Westpac?

As well as good pay and a great culture, joining the Westpac family means you will get some of the best banking, wealth, and insurance benefits in the market. We back our employees by helping them work towards industry-recognised qualifications, using online learning, training modules and career planning tools for you to grow with us. We will even pay you to do volunteer or community work. As an equal opportunity employer, we are proud to have created a culture and work environment that values diversity and flexibility – and champions inclusion.

How do I Apply?

Start here. Just click on the APPLY button.

As part of our commitment to creating a diverse and inclusive workplace, this role is open to experienced candidates seeking a discussion around workplace flexibility. We invite candidates of all ages, people with a disability and Indigenous Australians to apply.

The health and wellbeing of our employees is our top priority. We’ve developed clear standards to ensure our people are confident, safe and healthy whether they’re working from a Westpac Group site or working from home. These are based on expert medical advice and Safe Work Australia guidelines.

Westpac Group