Back to Job Search

Data Engineer

Job Description

Data Engineer - Inside IR35

Contract Term: 6 Months

Contracting Authority: Companies House

Location: Remote

We are looking for a data engineer specialising in developing pipelines to help support our transformative work in this space. This will include a considerable focus on supporting development of our cloud data platform. Specifically, within the AWS stack, building pipelines to populate AWS S3 onwards e.g., Redshift data warehouse.

As a Data Engineer your main responsibilities would be:

  • Write ETL scripts and code to make sure the ETL process performs optimally within the AWS stack.
  • Implement data flows to connect operational systems, data for analytics and business intelligence (BI) systems.
  • Document source-to-target mappings.
  • Re-engineer manual data flows to enable scaling and repeatable use.
  • Support the build of data streaming systems.
  • Develop business intelligence reports that can be re-used.
  • Build accessible data for analysis.
  • Undertake data profiling and source system analysis and present clear insights to support the end use of the data.
  • Design build and test data products based on feeds from multiple systems using a range of different storage technologies and/or access methods.
  • Produce, maintain and update relevant data models for specific business needs.
  • Reverse-engineer data models from a live system.
  • Work with metadata repositories to complete complex tasks such as data and systems integration impact analysis maintain a repository to ensure information remains accurate and up to date.
  • Design, code, test, correct and document simple programs or scripts under direction.
  • Developing and constructing data products and services and integrating them into systems and business processes.

You'll have relevant experience in:

  • Design and build ETL utilising the AWS Stack.
  • Python programming (Pyspark would be beneficial).
  • Experience building data ingestion pipelines from on-premise to cloud.
  • Experience using other cloud technologies such as Snowflake or Databricks would be useful.
  • Understands the principles of data warehousing methodologies such as Kimball, Inmon and Data Vault.
  • Comfortable proactively gathering technical information from other departments.
  • Willing to upskill / mentor data engineers in the use of cloud technologies.

If this Data Engineer role sounds like something that you would be interested in, please click the link to apply and get in touch with rebecca.nolan@publicsectorresourcing.co.uk

"In applying for this role, you acknowledge the following: this role falls in scope of the Off Payroll Working in the Public Sector legislation. Any rates of payment quoted will reflect the gross rate per day for the assignment and will be subject to appropriate taxes and statutory costs. As such the payment to the intermediary and your income resulting from this contract will be different."

Please be aware that this role can only be worked within the UK and not Overseas.