INGRITY
Lead Data Engineer
Canberra, Australian Capital Territory•Contract
About the Job
Lead Data Engineer
Location: Canberra CBD, ACT | Hybrid
Engagement: 12-month contract, with two possible 12-month extensions
Engagement: 12-month contract, with two possible 12-month extensions
About INGRITY:
INGRITY is a specialist Data, Digital, Cloud & AI consultancy, helping organisations turn complex data into practical business outcomes.
We’re looking for an experienced Lead Data Engineer to support a federal government department’s enterprise analytics and technology services team.
About the Role:
You’ll lead the design, build and testing of data ingestion, transformation and visualisation solutions across Azure and Databricks, preparing data to support decision-making across the department.
What You’ll Do:
- Design, build, test and maintain data ingestion and transformation solutions that meet current and emerging needs.
- Develop reusable, automated ingestion and transformation patterns and frameworks.
- Prepare data for analytics, visualisation and AI use cases, with a focus on quality and query performance.
- Support data engineers across delivery teams through quality reviews and constructive feedback.
- Collaborate with project teams to deliver outcomes aligned with departmental and program priorities.
- Participate in agile delivery, including in-person attendance at quarterly agile ceremonies and key team events.
What We’re Looking For:
- Data engineering experience: At least five years’ experience as a data engineer, supported by relevant qualifications or training.
- ETL and ELT delivery: Strong experience developing solutions for large or complex data movement, transformation and visualisation, particularly in cloud environments.
- Azure technology expertise: Experience across Azure Data Factory, SQL Server Integration Services, Databricks, SQL Server, Azure Data Lake Storage, Azure Machine Learning, Azure DevOps and Visual Studio.
- Performance optimisation: Experience preparing data for efficient querying in cloud compute engines, including Spark, graph databases and Azure SQL.
- Automated ingestion: Experience sourcing and ingesting data from Oracle, Ingres, Azure and SQL Server environments.
- Analytics-ready data: Experience transforming data into Parquet and Delta formats for advanced analytics and AI use cases.
- Power BI: Ability to analyse complex datasets and design visualisations suited to the intended audience.
- Communication and collaboration: Strong written and verbal communication, relationship-building and negotiation skills.
Nice to Have:
- Experience using Azure Data Factory and Databricks together.
- Knowledge of data lake and lakehouse architectures.
- Experience with ArcGIS Enterprise.
Why Join?:
- Deliver data engineering solutions that support decision-making across a federal government department.
- Work across Azure and Databricks within an established agile team.
- Combine hands-on engineering with technical leadership and quality oversight.
- Secure a 12-month engagement with the possibility of two further 12-month extensions.
Citizenship and Security Clearance: Applicants must be Australian citizens and hold, or be eligible and willing to obtain, Negative Vetting Level 1 (NV1) clearance.