01
TRCI-26-04855
Data Engineer (AWS Event-Driven Integrations)
Contract Data Engineer needed in London (5–6 years) to build reliable, event-driven integrations from CDS source systems into an AI platform. You will develop webhook/REST/event-stream connectors and ingestion pipelines using AWS API Gateway + Lambda, EventBridge and SQS (per-consumer buffering), implement state/watermark tracking in DynamoDB with reconciliation to detect delivery gaps, and support onboarding of new sources (e.g., Confluence, Jira). Python is required, and you’ll also handle backfill/data migration activities such as AWS DMS.
Position summary
- Location
- United Kingdom
- Workplace
- Remote
- Employment
- Contract
- Experience
- Minimum 5 years and Maximum 6 years
Role overview
Why This Role Matters.
Contract Data Engineer needed in London (5–6 years) to build reliable, event-driven integrations from CDS source systems into an AI platform. You will develop webhook/REST/event-stream connectors and ingestion pipelines using AWS API Gateway + Lambda, EventBridge and SQS (per-consumer buffering), implement state/watermark tracking in DynamoDB with reconciliation to detect delivery gaps, and support onboarding of new sources (e.g., Confluence, Jira). Python is required, and you’ll also handle backfill/data migration activities such as AWS DMS.
Your Impact
Deliver Enterprise Value
Help organisations solve complex business problems through modern technology, consulting expertise and measurable outcomes.
Collaboration
Work Across Teams
Collaborate with consultants, architects, engineers and client stakeholders throughout the project lifecycle.
Growth
Learn Continuously
Gain exposure to enterprise technologies, certifications, mentoring and real-world project experience.
Career Path
Grow With Ubique
Build a long-term consulting career with opportunities to take on greater responsibility and leadership over time.
Responsibilities
What You'll Be Doing.
Every role at Ubique contributes directly to solving meaningful business challenges for our clients.
02
State/watermark tracking (DynamoDB) and reconciliation to catch delivery gaps
03
Python for pipeline/integration development
04
Data migration experience (e.g. AWS DMS) for onboarding new sources"
05
"The Data Engineer is responsible for integrating CDS source systems into the AI platform — building the connectors and ingestion pipelines that get source-system data flowing into the platform reliably.
06
Implement watermark/state tracking (DynamoDB) and periodic reconciliation to catch webhook delivery gaps without placing polling load on source systems
07
Onboard new CDS source systems onto the platform's ingestion pattern as scope expands (e.g. Confluence, JIRA, and others across the CDS estate)
08
Handle data migration activities where a source system needs backfilling into the platform (e.g. AWS DMS)
09
Work with Knowledge Engineers to ensure ingested data meets the quality/structure ne"
Technology stack
Tools & Technologies.
The platforms and technologies you'll use to build modern, enterprise-grade solutions.
01
Python
Required
02
AWS
Required
03
API Gateway
Required
04
Lambda
Required
05
EventBridge
Required
06
SQS
Required
07
DynamoDB
Required
08
AWS DMS
Required
09
webhooks
Required
10
REST
Required
11
event streams
Required
12
event-driven architecture
Required
13
watermarking
Required
14
state tracking
Required
15
reconciliation
Required
16
connectors
Required
17
ingestion pipelines
Required
18
Confluence
Required
19
Jira
Required
20
CDS
Required
Requirements
Skills & Experience.
We value curiosity, collaboration and continuous learning. If you don't meet every requirement but believe you can make an impact, we'd still love to hear from you.
Essential
Required Qualifications
Building integrations against source-system APIs (webhooks, REST APIs, event streams)
Event-driven ingestion patterns on AWS
AWS API Gateway
AWS Lambda
Amazon EventBridge
Amazon SQS (including per-consumer buffering patterns)
State/watermark tracking using DynamoDB
Reconciliation processes to detect webhook delivery gaps
Python for pipeline/integration development
Data migration/backfill experience (e.g., AWS DMS)
Preferred
Nice to Have
Integrating enterprise SaaS/knowledge tools (e.g., Confluence, Jira)
Data quality/structure alignment with downstream consumers (working with Knowledge Engineers)
What you'll gain
More Than Just A Job.
We're committed to helping every team member grow professionally, personally and technically while working on meaningful projects.
Global Exposure
Collaborate with international clients and multicultural teams on enterprise programmes.
Continuous Learning
Expand your expertise through mentoring, certifications and hands-on project experience.
Career Growth
Take ownership, develop leadership skills and grow your consulting career over time.
Flexible Working
Hybrid and remote collaboration designed around trust and delivering exceptional outcomes.
People First
Join a supportive culture where collaboration, respect and long-term relationships come first.
Enterprise Projects
Work on meaningful technology initiatives for leading organisations across industries.
Apply
Apply for Data Engineer (AWS Event-Driven Integrations)
One page, about two minutes. We only ask for what we actually need to have a first conversation.