P
Posted 1w ago

Apache Airflow , Informatica , Snowflake, Azure services, Java design patterns, Data modelling, Spring boot,Strong Python Programming -6-9-CHN

Photon
India
OnsiteFull Time
Responsibilities
  • designing pipelines
  • developing APIs
  • optimizing systems
Requirements
  • Requires 6–9 years of experience with data engineering
  • Advanced Java
  • Spring Boot
  • Python, SQL
  • Data modeling
  • Cloud platforms, APIs
  • Microservices, CI/CD, and distributed systems
Technical tools mentioned
Apache AirflowInformaticaSnowflakeAzureJavaSpring BootSpring BatchHibernate ORMSpring SecurityPythonPandasNumPyPower BIKubernetesAKSGitHub CopilotSQLApache SparkApache KafkaApache HadoopDockerAWSRabbitMQREST APIsOpenAPIJenkins

Job description

Location: CHN
Experience: 6-9 Years

 

Key Skills: Apache Airflow , Informatica , Snowflake, Azure services, Java design patterns, Data modelling, Spring boot (Spring batch framework, Hibernate ORM ,Spring security)  ,

Strong Python Programming around data libraries(Pandas,Numpy), Advanced Java , powerbi,Kubernetes(AKS), Github copilot agent development experience .

 

Skills around Data engineering and Spring boot :

Strong proficiency in SQL and data modeling.

Experience with Spark, Kafka, Hadoop, or similar technologies.

Expertise in cloud data platforms and services.

Experience in snowflake

Knowledge of CI/CD, DevOps, and automation practices.

Understanding of data governance, security, and privacy requirements.

Strong problem-solving and analytical capabilities.

Strong proficiency in Advance Java, Spring Boot, Spring MVC, and Spring Data.

Experience with microservices architecture and event-driven systems.

Working experience around Spring batch REST APIs, OpenAPI, and API security standards.

Familiarity with Kafka, RabbitMQ, or messaging frameworks.

Experience with containerization and cloud platforms (Docker, Kubernetes, Azure/AWS).

Understanding of DevSecOps, CI/CD, and agile development methodologies.

Strong debugging, troubleshooting, and performance optimization skills.

 

Key Responsibilities:

Design and implement batch and real-time data ingestion pipelines.

Build scalable ETL/ELT solutions using modern data engineering frameworks.

Develop and optimize data models, data lakes, and data warehouse architectures.

Ensure data quality, lineage, governance, and compliance standards.

Optimize performance, reliability, and scalability of data processing workflows.

Collaborate with cross-functional teams to define data requirements and solutions.

Implement monitoring, alerting, and operational controls for data platforms.

Support cloud-native data solutions across Azure.

Design and develop RESTful APIs and microservices using spring and Spring Boot.

Implement business logic and integration services for enterprise applications.

Build scalable and resilient distributed systems using cloud-native patterns.

Collaborate with architects, product owners, and QA teams throughout the SDLC.

Ensure code quality through unit testing, code reviews, and automated testing.

Optimize application performance, security, and reliability.

Implement observability through logging, monitoring, and tracing solutions in datadoog

Participate in CI/CD pipeline development(declarative pipeline using Jenkins core) and deployment automation.

 

About Photon

An information technology organization providing software development and data engineering services.

Year founded
1999
Employees
5400

Similar jobs

Data Engineer roles
3h
Save
Mark Applied
Hide
Lead Associate - Data / AI
Pune, Maharashtra, India
HybridFull Time
Davies
Davies: Insurance claims management and legal professional services provider.
3+ YOE3+ MgmtBachelor's degree in computer science or related field; 3–5 years managing BI or data teams; experience building data pipelines and architectures with ADF; strong communication and process improvement skills.
Azure Data Factory, Microsoft Fabric, Microsoft SQL Server, Microsoft Power BI
9h
Save
Mark Applied
Hide
Data Engineering Snowflake Lead Engineer _ Vice President _Data Engineering
Bengaluru, Karnataka, India
OnsiteFull Time
Morgan Stanley
Morgan StanleyNYSE: MS: Global financial services firm providing investment and wealth management.
8+ YOERequires 8+ years in data engineering or a related field, with Python, Snowflake Cortex, Databricks, SQL/NoSQL, data modeling, cloud platforms, and data pipeline experience.
Snowflake, Python, SQL/PLSQL, Snowflake Cortex, Apache Spark, Hadoop, SQL, NoSQL, Databricks, AWS, Azure, Kafka, Git, Jupyter, Tableau, Power BI, Collibra
14h
Save
Mark Applied
Hide
Apprentice - Data Engineer
Pune or United States or India or Poland
HybridFull Time, Internship
StoneX Group
StoneX GroupNASDAQ: SNEX: Provides global financial services and market access.
Completing a bachelor's degree in computer science, engineering, mathematics, or related field by July/August 2027; available for a full-time six-month apprenticeship; familiarity with Python, SQL, PySpark, Azure, and Databricks.
Python, SQL, PySpark, Microsoft Azure, Databricks, Power BI, React.js, .NET, SQL Server, Profisee, RedPanda, Kafka, OpenAPI, Airflow, Dynamics, Jenkins, GitHub, Docker, Kubernetes
19h
Save
Mark Applied
Hide
Data Engineer
Bengaluru or India
OnsiteFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
3+ YOEMinimum 3 years of experience, 15 years of full-time education, and Databricks expertise. Requires Python, SQL, Spark/PySpark, cloud data engineering, ETL/ELT, orchestration, streaming, and performance tuning skills.
Databricks Unified Data Analytics Platform, PySpark, Apache Spark, AWS, Microsoft Azure, Google Cloud Platform (GCP), Python, SQL, Amazon S3, Azure Blob Storage, Google BigQuery, Amazon Redshift, Apache Airflow, Parquet, Avro, JSON, Apache Kafka, dbt (Data Build Tool), Informatica, Talend, Matillion
19h
Save
Mark Applied
Hide
Data Engineer, YouTube Business Organization
Bengaluru, Karnataka, India
OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
3+ YOEBachelor's degree or equivalent practical experience, 3+ years coding and building data pipelines, dimensional models, data infrastructure, and exploratory queries; SQL and data platform experience required.
Flume, Dataflow, Apache Spark, SQL, Extract, Transform, Load (ETL)
20h
Save
Mark Applied
Hide
Data Engineer
Hyderabad, Telangana, India
OnsiteFull Time
Milestone Technologies
Milestone Technologies: Global provider of IT managed services and digital solutions.
5+ YOEBachelor's degree in a technical field, 5+ years building and supporting data pipes, 2+ years automating ETL data quality measurement, and experience with Azure Data Services, SQL Server, Azure DevOps, PowerShell, and Python.
SQL Server 2016, Microsoft Azure, Azure Data Catalog, Azure Blob Storage, Azure Data Lake Storage, Azure Synapse Analytics, Azure Analysis Services, Azure Data Factory, Power BI, DAX, PowerShell, Azure DevOps, Python, ETL, CI/CD
21h
Save
Mark Applied
Hide
Data Engineer-I, SmartCommerce
Bengaluru, Karnataka, India
OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
1+ YOEBachelor's degree, 1+ year of data engineering experience, data modeling, warehousing, ETL pipeline development, query and scripting language experience; AWS and ETL tools preferred.
SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala, Python, KornShell, AWS, Redshift, Amazon S3, AWS Glue, EMR, Kinesis, Firehose, AWS Lambda, IAM, Informatica, ODI, SSIS, BODI, Datastage
21h
Save
Mark Applied
Hide
Data Engineer
Hyderabad, Telangana, India
HybridFull Time
L'Oréal
L'OréalEuronext Paris: OR: Manufactures and sells personal care, skincare, and cosmetic products globally.
4+ YOEBachelor's or master's degree and 4–6 years of data engineering experience. Requires GCP, SQL, Python, Spark, cloud data platforms, ETL/ELT, orchestration, governance, CI/CD, and Agile expertise.
Google Cloud Platform (GCP), BigQuery, Cloud Storage, Dataflow, Dataproc, Pub/Sub, Cloud Composer, SQL, Python, Apache Spark, Apache Airflow, Git, CI/CD