Main characteristics
- Location
- Lincoln, Lincolnshire
- Company
- Adecco
- Salary
- £19.18/hour
- Employment type
- Contract, Temporary
- Category
- IT
Job summary
We are currently recruiting for an experienced Data Engineer to work for Lincolnshire Police at their headquarters in Nettleham.This is a hybrid role working Monday to Friday 37 hours a week.
PLEASE NOTE DUE TO POLICE VETTING CRITERIA YOU MUST HAVE RESIDED WITHIN THE UK CONTINUOUSLY FOR AT LEAST 5 YEARS AT THE TIME OF APPLICATION. UNFORTUNATELY ANYTHING LESS THAN THIS WILL NOT BE CONSIDERED.
JOB PURPOSE AND SCOPE The Data Engineer is responsible for designing, building, and maintaining our data infrastructure, ensuring the efficient and reliable definition, processing, storage, and analysis of large datasets. They will contribute to ensuring our data, and data shared by others is of the highest quality, available, usable and shareable by rigorous standard setting and quality control The role requires a good level of knowledge, functional understanding of modern data technologies and platforms and as sole accountable data engineer for the Force will need to excel in the application data engineering tools and methodologies. They will cultivate strong and effective working relationships with individuals, teams and colleagues, both internal and external to the Force.
CORE WORK AREAS
Design and implement scalable, efficient, and robust data pipelines to extract, transform, and load (ETL) data from various sources into data storage and platform solutions.
Engage and collaborate with cross-functional teams, to understand their data requirements and translate them into technical solutions.
Build and link data sets so that data scientists and analysts can easily derive insights, including accessing sensitive data held in back-end systems, extracting and loading into the data storage environment (warehouse or lake) or platform (fabric or mesh, whichever strategically appropriate) from which they be provisioned.
Write ETL scripts and code to make sure the ETL process performs optimally, leading on extracting data, joining and helping analysts to derive insights
Build and optimise the performance of pipelines and APIs that connect operational systems, data for analytics and business intelligence (BI) systems, troubleshooting and resolving issues as they arise, to ensure the timely delivery of high-quality data.
Identify and automate manual data flows and reports to enable scaling and repeatable use, working with colleagues across the organisation
Develop and maintain data models, schemas, and structures that optimize data storage and retrieval for analytics and reporting purposes.
Optimise code within systems to ensure processes perform optimally.
Identify ways to improve data reliability, efficiency and quality.
Work closely with data stakeholders to understand their data needs and provide support and guidance on how to use the data engineering infrastructure effectively.
Work with information analysts and BI developers to build optimal and reusable visualisations and reports
Extract, clean, combine and store data in a way that allows it to be exploited and as an asset to help service delivery and decision making.
Undertake data engineering activities within business-critical live systems, working with services to understand and improve data quality. This may include purging data in accordance with regulation and internal policy.
Support the Information Management Unit (IMU) colleagues implementing data quality checks, data validation, and data cleansing processes to help ensure the accuracy, consistency, and integrity of the data.
Adhere to data governance policies and standards, ensuring compliance with data privacy and security regulations.
Anonymise data wherever necessary, working within the principles of GDPR and with suitable data protection and sharing agreements in place.
Document data engineering processes, workflows, and technical specifications to facilitate knowledge sharing and ensure reproducibility of analyses.
Stay up-to-date with emerging trends and advancements in data engineering, evaluating and recommending new tools, techniques, and best practices that will enhance the data engineering infrastructure.
Contribute to data strategy, writing good standards and practice for data engineering.
Engage with and help manage commercial relationships with data engineering partners; overseeing any project work undertaken by partners and suppliers, including virtual and remote management; set direction for suppliers, manage supplier risk and communicate our needs clearly.ESSENTIAL CRITERIA
Degree in Computer Science, Information Systems, or a related field. or a combination of education and relevant experience
Programming land querying languages e.g. SQL, R, Hive, Python, Java, Scala
Demonstrable experience showing competency working with multiple, complex data sets
Demonstrable experience showing competency working with data classification and standards
Competent ability to clean, integrate and scale data sets and pipeline, fixing problems in data sets, from low performance to bugs and outages
Proficiency in programming languages such as Python, Java, or Scala, used for scripting and automation
Proficiency in using query languages such as SQL, Hive, R, with any ability to work with SQL and NoSQL databases
Solid understanding of relational and NoSQL databases, including database design, query optimization, and performance tuning
Applied knowledge of modern data engineering tools, technologies and practices Understanding of machine learning techniques and algorithms
Familiarity with data governance principles, data privacy regulations (e.g., GDPR, CCPA), and data security best practices.
Adecco acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers. The Adecco Group UK & Ireland is an Equal Opportunities Employer.
By applying for this role your details will be submitted to Adecco. Our Candidate Privacy Information Statement explains how we will use your information - please copy and paste the following link in to your browser
Inform me about similar jobs:
