The Department is seeking an experienced Data Engineer to work as part of a project team for the delivery of the Data Management and Analytics Platform project. The successful candidate will work closely with various stakeholders, business subject matter experts, technical architects, cloud engineers and developers as part of the project, to deliver the agreed project outcomes. The project will comprise of implementing an enhanced data management and analytics platform to facilitate data warehousing capabilities, reporting, data analysis, storing transactional data and archiving of required data. The data engineer will:
•Define data solutions using Azure Synapse and Azure Data Factory and work with DISER’s data platform team to deliver these solutions
•Assist in the migration of existing data processes (Microsoft SQL Server Integration Services) to the new data platform (Azure Data Factory)
•Have the ability to understand DevOps process and can use DevOps tools in accordance with the agreed processes
•Develop and maintain relevant project and design documentation such as detailed designs, technical configuration documents and build guides
•Work with DISER’s data platform team to consume and implement recommended practices to ensure compliance of data and information management standards
•Be able to apply judgement and critical thinking skills to problem solve
•Have demonstrated government sector experience, including working in small project teams Previous experience with Microsoft technologies, specifically Azure Synapse, Azure Data Factory and Microsoft SQL Server Integration Services (SSIS) is required. Experience in working within an Agile team is highly desirable, and experience working in an enterprise data warehouse is desirable. Relevant qualifications and demonstrated experience in information technology, data management, or related fields would be highly regarded, including the ability to communicate data concepts to generalist audiences.