Public Sector | 15-11-2024

Data Engineer

Location: Hybrid (3 days per week onsite) – London, Newcastle, Coventry. 

The Data Engineer will have direct oversight and responsibility for the development, implementation, review, and establishment of data and techniques used in the Advanced Data Analytics Portfolio (DAP). 

Your primary responsibilities will include developing data pipelines, processing data, and preparing data suitable for analysis. Additionally, you will evaluate, maintain, and manage data pipelines, develop and maintain data models, and support the design of analytical services, products, and models. 

Key Skills:

• Practical implementation of data solutions using Azure tech stack (Data factory, DataLakes, Notebooks, Synapse warehouse)
• Worked with varied data sources (On-Prem databases, Data Lakes , ERP systems)
• API Integration
• Complex data transformation using PYSPARK, SQL and optimization techniques
• Good understanding of Data modelling and Warehousing concepts
• Data Documentation
• Basic Machine learning experience
• Experience in Fabric