Microsoft Fabric Data Engineer

Willis Towers Watson is a leading global advisory, broking and solutions company that helps clients around the world turn risk into a path for growth. With roots dating to 1828, Willis Towers Watson has 40,000 employees serving more than 140 countries. We design and deliver solutions that manage risk, optimize benefits, cultivate talent, and expand the power of capital to protect and strengthen institutions and individuals. Our unique perspective allows us to see the critical intersections between talent, assets and ideas – the dynamic formula that drives business performance. Together, we unlock potential. Learn more at willistowerswatson.com.

About the Enterprise Data Products Team:
We are a global data product team based in Mumbai and Ipswich, comprised of approximately 30 colleagues. We design, build, and operate foundational enterprise data platforms that manage, master, and deliver authoritative, standardised data products across WTW. Our core platforms, Enterprise Reference Data (ERD) and Enterprise Client Solution (ECS), underpin critical domains such as Client/Party, Industry, Product, Currency, and Geography. Through strong governance, stewardship, and tooling, we ensure data is accurate, consistent, and trusted. ERD serves as a central hub for distributing mastered and externally sourced reference data, while ECS provides a user-friendly interface for managing Client/Party data. Together, these products enable seamless data integration, support operational efficiency, and empower innovation and client service by allowing global data to be connected and understood with confidence.

Job Description

We are seeking an experienced Microsoft Fabric Data Engineer to design, build, and optimize scalable data solutions. In this role, you will leverage Microsoft Fabric to integrate diverse data sources, implement modern data architectures, and enable advanced analytics and AI (Artificial intelligence) capabilities across the team and our internal clients.

 Key Responsibilities

Data Integration & Transformation

• Design and implement scalable data ingestion pipelines to integrate data from on-premises systems, cloud services, and APIs (Application Programming Interface) into Microsoft Fabric environments.
• Build and optimize ETL/ELT (Extract, Transform, Load/ Extract, Load, Transform) processes using Fabric Pipelines, Spark notebooks, and related tools for efficient data transformation and loading.
• Apply advanced validation, cleansing, and enrichment techniques to ensure data consistency and reliability.
• Automate workflows for incremental loads, schema evolution, and error handling to ensure high availability and resilience.
• Implement CI/CD (Continuous Integration and Continuous Delivery/Deployment)practices for Fabric artifacts using Azure DevOps, including automated deployment, version control, and environment promotion for Lakehouse tables, pipelines, and notebooks.

Data Architecture & Modelling

• Design scalable, high-performance data models within Lakehouses aligned with business requirements and analytics use cases.
• Apply best practices for modelling in a medallion architecture.
• Optimize storage and compute resources for cost efficiency and query performance across large datasets.
• Establish effective data partitioning and ordering strategies for handling large-scale datasets.

Governance & Quality

• Implement robust data quality checks, lineage tracking, and compliance standards.
• Ensure security and access control using Microsoft Fabric’s governance features.

Performance Optimization

• Monitor and optimize query performance across Lakehouses, Warehouses, and Direct Lake connections.

Legacy\Other Development

• While Microsoft Fabric is becoming a cornerstone of our data strategy, there will be ongoing requirements to work with legacy systems that may eventually be migrated into Fabric-based solutions. Additionally, certain components of our architecture may remain outside the Fabric ecosystem, requiring long-term development and maintenance.

Business Responsibilities 

• Partner closely with other Data Engineers, BAs (Business Analyst), QAs (Quality Assurance), and Product Owner to understand data needs and deliver high quality solutions aligning with business objectives.
• Translate complex technical concepts into clear, understandable language for stakeholders with varying levels of technical expertise.

Required Skills & Experience

• Proven hands-on experience with Microsoft Fabric components (Lakehouse, Pipelines, Notebooks, PySpark)

or

• Microsoft Fabric Certification combined with experience in Python/PySpark and Azure ETL (Extract, Transform, Load) technologies (e.g., Databricks, ADF (Azure Data Factory).

• Excellent communication skills, with the ability to bridge the gap between technical detail and business context.
• Comfortable collaborating with individuals across a wide range of technical skillsets and seniority levels.
• A proactive mindset, with the curiosity to ask questions and the confidence to challenge assumptions when needed.
• T-SQL (Structured query language) \ Spark SQL (Structured query language)

Preferred Skills & Experience

• Familiarity with data governance, security, and compliance frameworks in Microsoft Fabric.
• Experience implementing CI/CD (Continuous Integration and Continuous Delivery/Deployment) pipelines within Fabric and integration with Azure DevOps.
• Understanding of Power BI integration with Fabric for advanced analytics.

Any Graduate

We’re committed to equal employment opportunity and provide application, interview and workplace adjustments and accommodations to all applicants. If you foresee any barriers, from the application process through to joining WTW, please email candidatehelpdesk@wtwco.com.