Ubique Systems

TRCD-26-06180

Databricks Data Engineer (AWS, Delta Lake, Streaming)

Contract Databricks Data Engineer (2–5 yrs) needed in Gurugram/Noida to build Databricks pipelines using Python notebooks and Workflows, implement near real-time S3 monitor-based streaming ingestion on AWS, and model data using Delta Lake medallion (Bronze/Silver/Gold) with governance via Unity Catalog. The role will serve curated datasets through Databricks SQL Warehouse to downstream services (BFFs) while enforcing data quality, study-level isolation, and GxP-compliant audit trails. Must be strong in Databricks, Python, SQL, AWS (S3/Secrets Manager/CloudWatch), streaming ingestion, and Git/Jenkins CI/CD.

Position summary

Location
India
Workplace
Hybrid
Employment
Contract
Experience
Minimum 2 years and Maximum 5 years
Apply now

Role overview

Why This Role Matters.

Contract Databricks Data Engineer (2–5 yrs) needed in Gurugram/Noida to build Databricks pipelines using Python notebooks and Workflows, implement near real-time S3 monitor-based streaming ingestion on AWS, and model data using Delta Lake medallion (Bronze/Silver/Gold) with governance via Unity Catalog. The role will serve curated datasets through Databricks SQL Warehouse to downstream services (BFFs) while enforcing data quality, study-level isolation, and GxP-compliant audit trails. Must be strong in Databricks, Python, SQL, AWS (S3/Secrets Manager/CloudWatch), streaming ingestion, and Git/Jenkins CI/CD.

Your Impact

Deliver Enterprise Value

Help organisations solve complex business problems through modern technology, consulting expertise and measurable outcomes.

Collaboration

Work Across Teams

Collaborate with consultants, architects, engineers and client stakeholders throughout the project lifecycle.

Growth

Learn Continuously

Gain exposure to enterprise technologies, certifications, mentoring and real-world project experience.

Career Path

Grow With Ubique

Build a long-term consulting career with opportunities to take on greater responsibility and leadership over time.

Responsibilities

What You'll Be Doing.

Every role at Ubique contributes directly to solving meaningful business challenges for our clients.

01

Build Databricks pipelines (Python notebooks + Workflows) ingesting from Rave, IWRS, CSS, SAE, protocol deviations, etc.

02

Implement real-time S3 monitor-based streaming ingestion.

03

Model data across Bronze ? Silver ? Gold in Delta Lake, governed by Unity Catalog.

04

Serve curated data via Databricks SQL Warehouse to BFFs.

05

Enforce data quality, study-level isolation, audit trails (GxP).

06

2+ yrs data engineering; strong Databricks, Python, SQL.

07

AWS (S3, Secrets Manager, CloudWatch).

08

Streaming ingestion; Git + Jenkins CI/CD.

09

Unity Catalog, Databricks Asset Bundles, Vector Search / Model Serving.

Technology stack

Tools & Technologies.

The platforms and technologies you'll use to build modern, enterprise-grade solutions.

01

Databricks

02

Databricks Workflows

03

Python notebooks

04

Python

05

SQL

06

Delta Lake

07

Medallion architecture

08

Bronze Silver Gold

09

Unity Catalog

10

Databricks SQL Warehouse

11

AWS

12

S3

13

Secrets Manager

14

CloudWatch

15

Streaming ingestion

16

S3 monitor

17

Git

18

Jenkins

19

CI/CD

20

Databricks Asset Bundles

Requirements

Skills & Experience.

We value curiosity, collaboration and continuous learning. If you don't meet every requirement but believe you can make an impact, we'd still love to hear from you.

Essential

Required Qualifications

Databricks (notebooks, Workflows)

Python

SQL

Data engineering (2+ years)

Delta Lake

Medallion architecture (Bronze/Silver/Gold)

AWS S3

AWS Secrets Manager

AWS CloudWatch

Streaming ingestion (Databricks/Spark streaming patterns)

Git

Jenkins CI/CD

Data quality enforcement

Study-level data isolation

Audit trails / GxP compliance

AI-driven development

Preferred

Nice to Have

Unity Catalog

Databricks Asset Bundles

Databricks Vector Search

Databricks Model Serving

What you'll gain

More Than Just A Job.

We're committed to helping every team member grow professionally, personally and technically while working on meaningful projects.

Global Exposure

Collaborate with international clients and multicultural teams on enterprise programmes.

Continuous Learning

Expand your expertise through mentoring, certifications and hands-on project experience.

Career Growth

Take ownership, develop leadership skills and grow your consulting career over time.

Flexible Working

Hybrid and remote collaboration designed around trust and delivering exceptional outcomes.

People First

Join a supportive culture where collaboration, respect and long-term relationships come first.

Enterprise Projects

Work on meaningful technology initiatives for leading organisations across industries.

Apply

Apply for Databricks Data Engineer (AWS, Delta Lake, Streaming)

One page, about two minutes. We only ask for what we actually need to have a first conversation.

Your CV

Optional. A line or two is plenty.