Office for National Statistics Careers Near Me – Data Engineer

About the job

Your Work Will Involve

The Senior Data Engineers design and implement the extract, transform and load (ETL) pipelines for data to be structured in preparation for analysis, research, and statistics carried out by ONS. Engineers undertake a range of cleaning, validation, and enhancement of data.

• Building robust and scalable automated data pipelines
• Developing tools and services that enable people to use our data effectively
• Perform data management
• Working with data users to understand and meet their needs

We currently have 3 roles that we are advertising across 2 areas, these are:

One role involves delivery of standardised and engineered external and internal key strategic data sources needed for ONS-specific cross business use. The role will work to support key deliverables including the transformation of population, migration and social statistics.

Remaining roles will deliver proactive, innovative and insightful data products for a key ONS project responsible for delivering large scale changes to economic statistic. The work can range from primary and secondary engineering, data validation, automating data insight gathering and working closely with stakeholders to deliver data that adds the most value to downstream processes and research. For this role experience with cloud technologies, deployment tools, orchestration systems (Airflow) and continuous integration tools would be a bonus, however these are not needed as we offer training and development where needed.

Responsibilities

As a Senior Data Engineer your responsibilities include but are not limited to;

• Designing, building and implementation of robust automated data pipelines and ETL processes. Knowledge of automated testing, for example with pytest.
• Logging, analysing and manage data quality issues and implement appropriate solutions.
• Development of documentation and cataloguing of data to make data more accessible to others.
• Translating data sources into useful and usable data sets.
• Identify areas of innovation in data tools and techniques and recognise appropriate timing for adoption.
• Leading data projects and engaging with stakeholders. This will typically involve liaising with data suppliers and end users. You will explain technical processes to non-technical people across grades, coordinating work across multiple areas, sharing best practice and expertise whilst doing so.
• Understand and agree user needs and outputs, what the data are (and are not). Suggest ways to improve data, its accessibility and or the way in which it is presented.