Lead Engineer - Data

Lahore , Pakistan

Senior Data Engineer

Hours: Full Time 

Department: Tech Department 
Location:  Lahore 

Pakistan Full time – onsite

 

About the Company:

elGrocer.com is the UAE’s leading online grocery marketplace, now part of the e& (Etisalat) Group. We’re reimagining grocery retail through data-driven intelligence, automation, and modern cloud architecture. Our engineering culture blends the speed of a startup with the stability of a scaling enterprise — where ideas move fast, ownership is real, and impact is measurable.

Role Overview:

As a Senior Data Engineer (Databricks), you will play a pivotal role in shaping elGrocer’s data foundation across analytics, AI, and operational pipelines. You’ll architect, build, and optimize large-scale data workflows on the Databricks Lakehouse, ensuring reliability, performance, and scalability. This role directly impacts how data powers business decisions, personalization, and customer experiences across millions of grocery transactions.

 

Key Responsibilities:

  • Design, build, and optimize data pipelines and workflows using Databricks (PySpark, Delta Lake).
  • Implement robust ETL/ELT frameworks for ingestion, transformation, and enrichment across structured and unstructured sources.
  • Architect data solutions following Lakehouse principles, ensuring scalability, performance, and security.
  • Manage Delta Lake tables, versioning, schema evolution, and time travel for analytical consistency.
  • Perform Spark performance tuning, caching strategies, and cluster optimization for cost and speed.
  • Develop and maintain CI/CD pipelines for data workflows (GitHub Actions, Azure DevOps).
  • Build streaming data pipelines using Structured Streaming or Kafka for real-time insights.
  • Establish data quality, validation, and observability using modern frameworks.
  • Integrate Databricks with data warehouses like Snowflake, BigQuery, or Redshift (optional).
  • Collaborate with data scientists, analysts, and application teams to ensure unified and high-quality data delivery.

 

Required Qualifications:

  • 5+ years of professional experience working with data systems.
  • 3+ years of hands-on Data Engineering experience, including production-grade workloads.
  • Strong experience with Databricks and Apache Spark (cluster configuration, performance, optimization).
  • Proficiency in Python and SQL for data transformations and orchestration.
  • Deep knowledge of Delta Lake, Unity Catalog, and DBFS.
  • Experience with Azure, AWS, or GCP cloud ecosystems.

 

Preferred Skills:

  • Experience in data governance, lineage, and data quality frameworks.
  • Exposure to data observability tools (Monte Carlo, Great Expectations, etc.).

 

Education:

  • Bachelor’s or master’s degree in computer science, Data Engineering, Information Systems, or a related field.

Tools & Tech Stack:

  • Core: Databricks, Spark, Delta Lake, Unity Catalog
  • Languages: Python, SQL
  • Workflow: Airflow / Kafka
  • Cloud: Azure (preferred), AWS, or GCP
  • CI/CD: GitHub Actions / Azure DevOps
  • Data Quality: Great Expectations / Deequ
  • Version Control: Git / GitHub

Why Join Us:

At elGrocer, you’ll work with a team that believes data is not a back-office function — it’s a product. You’ll have autonomy to experiment, modernize, and scale systems that touch millions of customers. Our culture rewards initiative, values clarity over noise, and supports continuous learning.

  • Real impact on business-critical data systems.
  • Modern stack — Databricks Lakehouse, Delta, CI/CD, observability.
  • Collaborative team of engineers, analysts, and ML experts.
  • Growth paths into architecture, platform engineering, or data leadership roles.
Reference Code
JP25-105
Post Date
19 hours ago
Work Class
Non- Classified Employee
Work Type
Full Time - On Site
Share This Job Post
Apply Now