Iris Software
Posted 6d ago

Data - Senior Engineer

Iris Software
Noida, Uttar Pradesh, India
OnsiteFull Time
Responsibilities
  • designing pipelines
  • optimizing platforms
  • mentoring engineers
Requirements
  • Requires Python
  • PySpark
  • Apache Spark, SQL
  • Databricks, Kafka
  • AWS data services
  • Data quality
  • Pipeline architecture
  • Streaming
  • Orchestration
  • Troubleshooting
  • Collaboration, and mentoring skills
Technical tools mentioned
Databricks WorkflowsPySparkDelta LakeDatabricksApache KafkaSnowflakeAmazon KinesisApache AirflowPythonApache SparkSQLAmazon S3Amazon S3 GlacierAmazon EBSAmazon DynamoDBAmazon AuroraAmazon RDS

Job description

Why Join Iris?
Are you ready to do the best work of your career at one of India’s Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture that truly values your talent and ambitions?
Join Iris Software — one of the fastest-growing IT services companies — where you own and shape your success story.

 


About Us  
At Iris Software, our vision is to be our client’s most trusted technology partner, and the first choice for the industry’s top professionals to realize their full potential.

With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation & logistics, and professional services.

Our work covers complex, mission-critical applications with the latest technologies, such as high-value complex Application & Product Engineering, Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation.


Working with Us
At Iris, every role is more than a job — it’s a launchpad for growth.

Our Employee Value Proposition, “Build Your Future. Own Your Journey.” reflects our belief that people thrive when they have ownership of their career and the right opportunities to shape it.

We foster a culture where your potential is valued, your voice matters, and your work creates real impact. With cutting-edge projects, personalized career development, continuous learning and mentorship, we support you to grow and become your best — both personally and professionally.

Curious what it’s like to work at Iris? Head to this video for an inside look at the people, the passion, and the possibilities. Watch it here.

Job Description

Mandatory Skills:

Databricks Workflows, PySpark, Delta Lake on Databricks, Apache Kafka

Key Responsibilities:

  • Design scalable data engineering solutions using PySpark and modern distributed data processing frameworks.
  • Define data ingestion, transformation, and processing architectures aligned with business and analytical objectives.
  • Design and optimize Snowflake or Delta Lake on Databricks solutions to support enterprise-scale data platforms.
  • Lead implementation of high-performance batch and streaming data pipelines.
  • Design and optimize event-driven data architectures using Apache Kafka or Amazon Kinesis.
  • Define data streaming standards, integration frameworks, and scalable processing patterns.
  • Architect workflow orchestration solutions using Apache Airflow or Databricks Workflows.
  • Establish monitoring, scheduling, and operational controls for reliable pipeline execution.
  • Drive data quality, validation, reconciliation, and governance practices across data engineering solutions.
  • Design data engineering solutions following modern Lakehouse architecture principles, data observability practices, and platform engineering standards to improve scalability, reliability, and operational visibility.
  • Drive development of business-focused data products by improving data quality, discoverability, usability, documentation, and trusted data consumption across analytical platforms.
  • Promote responsible use of AI-assisted engineering capabilities to improve development productivity, testing, documentation, and engineering quality.
  • Review data pipeline designs and implementations to ensure adherence to engineering, scalability, and performance standards.
  • Troubleshoot complex data processing, workflow, and streaming platform issues through detailed root cause analysis.
  • Mentor team members on PySpark, Snowflake, Delta Lake, Kafka, Kinesis, Airflow, and data engineering best practices.
  • Collaborate with various teams and stakeholders to support end-to-end data platform delivery.

Behavioral Competencies:

  • Demonstrates strong ownership while driving data engineering excellence.
  • Collaborate effectively with various teams and business stakeholders to ensure smooth delivery.
  • Promotes quality-focused engineering through proactive validation, optimization, and continuous improvement.
  • Apply strong analytical thinking to evaluate complex data engineering and platform challenges.
  • Demonstrate adaptability while managing evolving technologies, data ecosystems, and business requirements.
  • Communicates effectively regarding delivery status, risks, dependencies, and improvement opportunities.
  • Maintains high attention to detail across data architecture, pipeline design, testing, and implementation activities.
  • Encourages continuous improvement in data engineering practices and platform operations.
  • Supports knowledge sharing and mentoring to strengthen team capabilities.
  • Balances scalability, performance, reliability, and business priorities while driving delivery excellence.
  • Promotes innovation by adopting modern data engineering practices, platform engineering principles, and AI-assisted development approaches to improve engineering productivity and solution quality.

 

Mandatory Competencies

Data Science and Machine Learning - Data Science and Machine Learning - Python
Data Science and Machine Learning - Data Science and Machine Learning - Apache Spark
Data & AI - Data Engineering - Data Quality & Validation
Big Data - Big Data - Pyspark
Database - Database Programming - SQL
Data & AI - Data Engineering - Apache Kafka
Data Science and Machine Learning - Data Science and Machine Learning - Databricks
Cloud - AWS - AWS S3, S3 glacier, AWS EBS
Cloud - AWS - Dynamo DB, Amazon Aurora, Amazon RDS
Beh - Communication and collaboration

Perks and Benefits for Irisians
Iris provides world-class benefits for a personalized employee experience. These benefits are designed to support financial, health and well-being needs of Irisians for a holistic professional and personal growth. Click here to view the benefits.

About Iris Software

Provides software engineering and IT consulting services to enterprises.

Year founded
1991
Employees
4300
Organization type
Private
Latest investment
Raised $948.00k Grant (2008)
Headquarters
US

Similar jobs

Data Engineer roles near Noida, Uttar Pradesh
10h
Save
Mark Applied
Hide
Lead - Data Engineer
Hyderabad or Navi Mumbai or Gurgaon or Hyderabad
HybridFull Time
Jacobs
JacobsNYSE: J: Global provider of professional engineering and technical services.
10+ YOERequires 10–12 years in data engineering, warehousing, or big data; expertise in cloud platforms, Microsoft Fabric, Databricks, ETL/ELT, data architecture, databases, governance, security, and enterprise-scale solutions.
Microsoft Azure, AWS, Google Cloud Platform (GCP), Microsoft Fabric, Lakehouses, Data Pipelines, Notebooks, Dataflows, Semantic Models, OneLake, Databricks, PySpark, Delta Lake, Unity Catalog, Databricks Workflows, Structured Streaming, SQL, NoSQL, Apache Spark, REST APIs, Web Services, Event Streaming, Power BI, Tableau, CI/CD, DevOps, Infrastructure as Code (IaC)
12h
Save
Mark Applied
Hide
Sr. Data Engineer
Gurugram, Haryana, India
OnsiteFull Time
Ascendion
Ascendion: AI-native digital engineering and software development services provider.
4+ YOERequires 4+ years of data engineering experience, strong SQL and Python, ETL/ELT and pipeline development, cloud platforms, data warehouses, Spark, Airflow, Git, CI/CD, and Agile experience.
SQL, Python, AWS, Microsoft Azure, GCP, Snowflake, BigQuery, Amazon Redshift, Azure Synapse, Apache Spark, PySpark, Apache Airflow, Git, CI/CD
15h
Save
Mark Applied
Hide
Lead Data Engineer (50356)
Gurugram, Haryana, India
OnsiteFull Time
Incedo
Incedo: Providing digital transformation and AI technology services.
7+ YOERequires 7–9 years of relevant experience, a B.Tech, B.E., M.Tech, or MCA, and expertise in AWS data platforms, pipelines, ETL, security controls, Apache Spark, Python, Java, and SQL.
Amazon Web Services (AWS), AWS Glue, AWS Redshift, AWS Lambda, Apache Spark, Python, Java, SQL
22h
Save
Mark Applied
Hide
Senior Data Engineer
Greater Noida, Uttar Pradesh, India
RemoteFull Time
TaskUs
TaskUs: Provides outsourced customer experience and digital services for technology companies.
5+ YOE5+ years in data engineering with expert Python, SQL, and PySpark skills; experience with lakehouse platforms, dbt, orchestration, infrastructure as code, DuckDB, Kubernetes, and streaming technologies.
Python, SQL, PySpark, dbt, Databricks, Delta Lake, Snowflake, Medallion Architecture, Apache Airflow, Prefect, Kafka, Kinesis, Spark Streaming, Terraform, CloudFormation, DuckDB, S3, Azure Blob, Parquet, Iceberg, Kubernetes (K8s), CI/CD
22h
Save
Mark Applied
Hide
Lead Data Engineer - Data Engineering 4C
Noida, Uttar Pradesh, India
HybridFull Time
Genpact
GenpactNYSE: G: Provides business process management and digital transformation services.
Bachelor's degree in a related field, strong Azure data engineering experience, Python and SQL proficiency, ETL/data pipeline expertise, Snowflake experience, and knowledge of cloud architecture, CI/CD, and DevOps.
Microsoft Azure, Azure Data Factory, Databricks, Azure Data Lake, Azure SQL Database, Snowflake, SQL, Python, Power BI, CI/CD, DevOps
1d
Save
Mark Applied
Hide
Senior Snowflake Data Engineer
Noida, Uttar Pradesh, India
HybridFull Time
Ibex
IbexNASDAQ: IBEX: Provides technology-enabled customer experience and business process outsourcing services.
7+ YOERequires 7+ years in data engineering, Snowflake, advanced SQL, Python, Snowpark, ELT/ETL, dbt, cloud platforms, Git, CI/CD, testing, and data modeling.
Snowflake, SQL, Python, Snowpark, Dynamic Tables, Streams, Tasks, dbt, AWS, Azure, GCP, Git, CI/CD, Fivetran, Kafka, Airflow, Terraform, Snowflake Iceberg Tables, Snowflake Cortex, Cortex Analyst, Cortex Search, Cortex LLM
1d
Save
Mark Applied
Hide
Associate Platform Services - Data Engineer
Pune or Gurgaon
HybridFull Time
ZS
ZS: Global management consulting and technology firm for healthcare and life sciences.
1+ YOEBachelor's degree required; 1–2 years of development experience, ETL, SQL, Python, data modeling, data warehousing, data products, cloud platforms, and strong analytical and communication skills.
ZAIDYN, SQL, Python, AWS, Azure, Hadoop, Spark, PySpark, Informatica, Talend, SSIS
1d
Save
Mark Applied
Hide
Data Engineer-Senior II
Bengaluru or Gurugram or Mumbai
OnsiteFull Time
FedEx
FedExNYSE: FDX: Global provider of courier, logistics, and transportation services.
4+ YOEBachelor's degree in a relevant quantitative or technical field required; master's preferred. Requires 4–7 years' experience, Python/PySpark/SAS, cloud, data engineering, SQL, ETL, data modeling, and English fluency.
Python, PySpark, SAS, Hadoop, Hive, Spark, Azure, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure DevOps, Databricks, Delta Lake, Docker, CI/CD, Kubernetes, Terraform, Octopus, SQL, Ab Initio, Informatica, DataStage, Power BI