Numerator
Posted 7mo ago

Sr. Data Engineer

Numerator
India
RemoteFull Time
Responsibilities
  • building pipelines
  • maintaining tests
  • conducting testing
Requirements
  • 7+ years data engineering experience with Python
  • Azure/Databricks
  • Apache Spark/PySpark
  • Azure DevOps and CI/CD
  • Agile experience
  • AI/ML knowledge preferred
Technical tools mentioned
PythonDatabricksAzureApache SparkPySparkAzure DevOpsCI/CDScrumKanbanAI/ML

Job description

 We’re reinventing the market research industry. Let’s reinvent it together.


At Numerator, we believe tomorrow’s success starts with today’s market intelligence. We empower the world’s leading brands and retailers with unmatched insights into consumer behavior and the influencers that drive it.

We are seeking a highly skilled Senior Data Engineer with extensive experience in designing, building, and optimizing high-volume data pipelines. The ideal candidate will have strong expertise in Python, Databricks on Azure Cloud services, DevOps, and CI/CD tools, along with a solid understanding of AI/ML techniques and big data processing frameworks like Apache Spark and PySpark.


Responsibilities




  • Adhere to coding and Numerator technology standards 




  • Build suitable automation test suites within Azure DevOps 




  • Maintain and update automation test suites as required 




  • Carry out manual testing, load testing, exploratory testing as required 




  • Work closely with Business Analysts and Senior Data Developers to consistently achieve sprint goals 




  • Assist in estimation of sprint-by-sprint stories and tasks 




  • Pro-actively take a responsible approach to product delivery



Requirements




  • 7-10 years of experience in data engineering roles




  • Good Python skills 




  • Experience working with Microsoft Azure Cloud 




  • Experience in Agile methodologies (Scrum/Kanban)




  • Experience with Apache Spark, PySpark, Databricks 




  • Experience working with Devops pipeline, preferably Azure DevOps




Preferred Qualifications




  • Bachelor's or master's degree in computer science, Information Technology, Data Science, or a related field.




  • Experience working in a support focused role 




  • Knowledge/experience in AI ML techniques




  • Certification in relevant Data Engineering discipline or related fields.




There is strength in numbers - We are the Numerati


Numerator is 5,800 employees strong. We have the confidence to be real and embrace what makes each Numerati unique. Our diverse experiences, ideas and backgrounds fuel our innovation.


Being part of the Numerati means that we’ll take care of you! From our Recharge Days, maximum flexibility policy, wellness resources for employees and their families, development opportunities and much more — we’re always finding ways to better support, celebrate and accelerate our team.


About Numerator

Provides market intelligence and consumer insights through data analytics.

Year founded
1990
Employees
5800
Organization type
Private
Latest investment
Raised $1.50B Corporate Round (2021) — led by Kantar
Subsidiaries
Headquarters
US

Similar jobs

Data Engineer roles
4h
Save
Mark Applied
Hide
Data Engineer-I, SmartCommerce
Bengaluru, Karnataka, India
OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
1+ YOEBachelor's degree, 1+ year of data engineering experience, data modeling, warehousing, ETL pipeline development, query and scripting language experience; AWS and ETL tools preferred.
SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala, Python, KornShell, AWS, Redshift, Amazon S3, AWS Glue, EMR, Kinesis, Firehose, AWS Lambda, IAM, Informatica, ODI, SSIS, BODI, Datastage
4h
Save
Mark Applied
Hide
Lead - Data Engineer
Hyderabad or Navi Mumbai or Gurgaon or Hyderabad
HybridFull Time
Jacobs
JacobsNYSE: J: Global provider of professional engineering and technical services.
10+ YOERequires 10–12 years in data engineering, warehousing, or big data; expertise in cloud platforms, Microsoft Fabric, Databricks, ETL/ELT, data architecture, databases, governance, security, and enterprise-scale solutions.
Microsoft Azure, AWS, Google Cloud Platform (GCP), Microsoft Fabric, Lakehouses, Data Pipelines, Notebooks, Dataflows, Semantic Models, OneLake, Databricks, PySpark, Delta Lake, Unity Catalog, Databricks Workflows, Structured Streaming, SQL, NoSQL, Apache Spark, REST APIs, Web Services, Event Streaming, Power BI, Tableau, CI/CD, DevOps, Infrastructure as Code (IaC)
4h
Save
Mark Applied
Hide
Software Engineer II
Hyderabad, Telangana, India
HybridFull Time
MetLife
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
Requires strong Azure data engineering experience, including Synapse Analytics, Databricks, PySpark, Spark SQL, ADF, advanced SQL, enterprise data platforms, CI/CD, governance, and security.
Azure Synapse Analytics, Azure Databricks, Databricks, Azure Data Factory (ADF), ADLS Gen2, PySpark, Spark SQL, Oracle, SQL Server, PostgreSQL, Git, GitHub, CI/CD, Azure DevOps, RBAC, Key Vault, GitHub Copilot, Informatica PowerCenter (IPC), Kafka, Azure Event Hubs, Terraform, Infrastructure as Code (IaC), Power BI, AI/ML
4h
Save
Mark Applied
Hide
Data Engineer-Data Platforms-SnowFlake
Hyderabad, Telangana, India
HybridFull Time
IBM
IBMNew York Stock Exchange: IBM: Global technology providing enterprise software, cloud, and consulting.
Bachelor's degree required; Snowflake platform, data engineering, cloud computing, and technical solution delivery experience required. Master's degree preferred.
Snowflake, cloud computing
5h
Save
Mark Applied
Hide
Senior Data Engineer (Python, SQL, Snowflake, Devops, Azure/ AWS, Co-pilot, Kubernetes, Docker)
Chennai, Tamil Nadu, India
OnsiteFull Time
NielsenIQ
NielsenIQNYSE: NIQ: Provides consumer intelligence and retail measurement data services.
7+ YOERequires 7+ years in data engineering, advanced Python and SQL, enterprise Snowflake, cloud experience with AWS, Azure, or GCP, data warehousing, CI/CD, IaC, DevSecOps, orchestration, and stakeholder management.
Python, Snowflake, SQL, Azure Blob Storage, Azure Data Lake Storage (ADLS), Azure Functions, Azure Data Factory (ADF), Microsoft Purview, GitHub Actions, Azure DevOps, GitLab CI, Terraform, Azure Bicep, CloudFormation, pytest, Great Expectations, dbt, Open Policy Agent (OPA), Conftest, AWS, Azure, GCP, Apache Airflow, Prefect, AWS Step Functions, Kafka, Amazon Kinesis, Google Pub/Sub, OpenLineage, Marquez, Delta Lake, Iceberg, Hudi, pandas, asyncio
5h
Save
Mark Applied
Hide
DE&A - Core - Advanced Data Engineering - Advanced Data Engineering (Other)
Bangalore or India
OnsiteFull Time
Zensar
ZensarNational Stock Exchange of India: ZENSARTECH: Global technology firm providing digital transformation and infrastructure services.
4+ YOERequires 4–7 years of experience designing, modeling, developing, building, and deploying data engineering solutions and pipelines on GCP, including BigQuery; strong communication skills preferred AI/ML knowledge.
Google Cloud Platform (GCP), BigQuery, AI/ML, Agentic AI
6h
Save
Mark Applied
Hide
Engineer, Data Engineering
Bangalore, Karnataka, India
OnsiteFull Time
News Corp
News CorpNasdaq: NWSA: Global media, publishing, and digital information services.
2+ YOERequires 2–4 years of data engineering experience, GCP expertise, BigQuery, Dataform, Cloud Composer, Dataproc, Python, SQL, data modeling, CI/CD, and infrastructure-as-code experience.
Google Cloud Platform (GCP), BigQuery, BigLake, PySpark, Dataproc, Python, SQL, Cloud Composer, Airflow, Terraform, CircleCI, GitHub, Dataform, Cloud Storage, Cloud Functions
6h
Save
Mark Applied
Hide
Azure Data Engineer
Chennai, Tamil Nadu, India
OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
5+ YOEBachelor of Technology and 5–12 years of experience; skills include Azure, SQL, Azure Databricks, Logic Apps, CI/CD pipeline creation, ADLS Gen 2.0, and Azure Key Vault.
Azure, SQL, Azure Databricks, Logic Apps, CI/CD, ADLS Gen 2.0, Azure Key Vault