TRCD-26-06114
Data Engineer (Databricks / Spark / Python / SQL)
Looking for a 2–4 years Data Engineer on contract to design, build, and optimize enterprise-scale ETL/ELT pipelines on Databricks. The role requires strong hands-on Databricks (Workflows/Jobs, Delta Lake/Delta tables, Unity Catalog, Databricks SQL, DLT), deep Spark (PySpark and/or Spark SQL), and strong Python plus advanced SQL. You will implement medallion lakehouse patterns, data quality checks/monitoring, and work in an agile setup with CI/CD while tuning jobs for performance and cost (cluster right-sizing, scheduling, governance).
Position summary
- Location
- India
- Workplace
- Hybrid
- Employment
- Contract
- Experience
- Minimum 2 years and Maximum 4 years
Role overview
Why This Role Matters.
Looking for a 2–4 years Data Engineer on contract to design, build, and optimize enterprise-scale ETL/ELT pipelines on Databricks. The role requires strong hands-on Databricks (Workflows/Jobs, Delta Lake/Delta tables, Unity Catalog, Databricks SQL, DLT), deep Spark (PySpark and/or Spark SQL), and strong Python plus advanced SQL. You will implement medallion lakehouse patterns, data quality checks/monitoring, and work in an agile setup with CI/CD while tuning jobs for performance and cost (cluster right-sizing, scheduling, governance).
Your Impact
Deliver Enterprise Value
Help organisations solve complex business problems through modern technology, consulting expertise and measurable outcomes.
Collaboration
Work Across Teams
Collaborate with consultants, architects, engineers and client stakeholders throughout the project lifecycle.
Growth
Learn Continuously
Gain exposure to enterprise technologies, certifications, mentoring and real-world project experience.
Career Path
Grow With Ubique
Build a long-term consulting career with opportunities to take on greater responsibility and leadership over time.
Responsibilities
What You'll Be Doing.
Every role at Ubique contributes directly to solving meaningful business challenges for our clients.
Develop and optimize data processing workflows on Databricks
Partnering with data architects, analysts, and business stakeholders to translate data requirements into reliable, production-grade pipelines
Drive end-to-end data engineering across project phases - ingestion, transformation, quality, and delivery, ensuring alignment with business objectives and data governance
Implement and enforce data quality checks, validation frameworks, and monitoring/alerting for pipeline health
Adhere to defined data engineering standards, guidelines, and best practices across projects
Technology stack
Tools & Technologies.
The platforms and technologies you'll use to build modern, enterprise-grade solutions.
Databricks
Delta Lake
Delta tables
Delta Live Tables
DLT
Unity Catalog
Databricks SQL
Databricks Workflows
Databricks Jobs
Apache Spark
PySpark
Spark SQL
Python
SQL
ETL
ELT
Lakehouse
Medallion architecture
Bronze Silver Gold
Dimensional modeling
Requirements
Skills & Experience.
We value curiosity, collaboration and continuous learning. If you don't meet every requirement but believe you can make an impact, we'd still love to hear from you.
Essential
Required Qualifications
2-4 years hands-on experience building enterprise-scale data pipelines and ETL/ELT solutions
Databricks hands-on: notebooks, jobs/workflows, Delta tables/Delta Lake, Unity Catalog
Apache Spark proficiency (PySpark and/or Spark SQL)
Python programming for data engineering
Advanced SQL for transformations and analysis
Data warehousing concepts and dimensional modeling
Medallion lakehouse architecture (bronze/silver/gold)
Troubleshooting, performance tuning, and cost optimization of jobs
Agile ways of working and CI/CD for data pipelines
Data quality checks/validation frameworks and monitoring/alerting
Strong communication and documentation skills
English communication
Preferred
Nice to Have
Delta Live Tables (DLT)
Databricks SQL (as a dedicated component)
Experience with data formats: Parquet, JSON, Delta
Compute governance practices on Databricks (policies/controls)
What you'll gain
More Than Just A Job.
We're committed to helping every team member grow professionally, personally and technically while working on meaningful projects.
Global Exposure
Collaborate with international clients and multicultural teams on enterprise programmes.
Continuous Learning
Expand your expertise through mentoring, certifications and hands-on project experience.
Career Growth
Take ownership, develop leadership skills and grow your consulting career over time.
Flexible Working
Hybrid and remote collaboration designed around trust and delivering exceptional outcomes.
People First
Join a supportive culture where collaboration, respect and long-term relationships come first.
Enterprise Projects
Work on meaningful technology initiatives for leading organisations across industries.
Apply
Apply for Data Engineer (Databricks / Spark / Python / SQL)
One page, about two minutes. We only ask for what we actually need to have a first conversation.