P
Posted 2y ago

Transunion | Data Engineer - Java , Spark & Spring Boot | Chennai | India

Photon
India
OnsiteFull Time
Responsibilities
  • Designing data systems
  • Implementing data stores
  • Programming and scripting
Requirements
  • Seeking a big data engineer with 8-10 years of experience in Java, Spark, and Spring Boot
  • With a Bachelor's degree in a related field
Technical tools mentioned
JavaSparkSpring BootSQLKafkaAWS

Job description


Greetings Everyone

 

We are seeking a big data engineer with Java experience to join our modernization initiative team. The candidate will be responsible for implementing and maintaining high volume online and offline batch and transactional client facing applications in cloud and On-prem. Candidate will also responsible for the creation and maintenance of our Code & database infrastructure, including collecting and maintaining data, ensuring the integrity of our data, and training data models. 

 

Responsibilities: 

* Design and implement efficient data handling system based on Java and Spark. 
* Perform and oversee tasks such as programming, writing scripts, calling APIs, and writing complex SQL queries. 
* Implement data stores that support the scalable processing and storage of our high-frequency data.  

 

Skill Sets: 

Must have: 
* Minimum 8 to 10 years of experience in Java, Spark , Spring boot
* Bachelor’s degree or higher in computer science, data science, or a related field. 
* Hands-on experience with data cleaning, visualization, and reporting. 
* Experience working in an agile environment. 
* Excellent analytical and problem-solving skills. 
* Excellent communication and interpersonal skills. 
 
Good to have: 
* Familiarity with the Hadoop ecosystem 
* Experience with AWS ( EMR)  is a plus. 

* At least 2 years of relevant experience with real-time data stream platforms such as Kafka and Spark Streaming. 

 
 


 

Who are we? 

For the past 20 years, we have powered many Digital Experiences for the Fortune 500. Since 1999, we have grown from a few people to more than 4000 team members across the globe that are engaged in various Digital Modernization. For a brief 1 minute video about us, you can check https://youtu.be/uJWBWQZEA6o.

 


 

What will you do?     

  • List out the Instructions

     
What are we looking for? 

 
  • List out the Instructions

About Photon

A that powers digital experiences for Fortune 500 companies.

Year founded
1999
Employees
5400

Similar jobs

Data Engineer roles
2w
Save
Mark Applied
Hide
AWS Data Engineer
Pune or Bengaluru or India
OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
7+ YOE7+ years experience with Terraform and AWS cloud, data lake architecture and data modeling, Windows Server management, PowerShell scripting; knowledge of AWS CloudWatch and AWS Glue; B.Tech required.
AWS, Python, Terraform, Windows Server, PowerShell, AWS CloudWatch, AWS Glue
2mo
Save
Mark Applied
Hide
Data Engineer
Bengaluru or Nagpur or Ahmedabad or Kolkata
OnsiteFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
5+ YOE5+ years experience; strong Databricks experience (6+ years on Databricks preferred), Py Spark/Spark, Python, SQL, cloud (AWS/Azure/GCP), data pipeline/ETL, data formats (Parquet/Avro/JSON), Apache Airflow and Kafka experience.
Databricks Unified Data Analytics Platform, Py Spark, Spark, AWS, Azure, GCP, S3, Blob Storage, Big Query, Redshift, Apache Airflow, Parquet, Avro, JSON, Python, SQL, Kafka, DBT (Data Build Tool), Informatica, Talend, Matillion, CI/CD
1y
Save
Mark Applied
Hide
Data Engineer
India
RemoteFull Time
Centific
Centific: Provides data curation and AI model evaluation services.
3+ YOE3+ years of experience in Python and PySpark for big data processing, strong experience with Azure Data Services.
Python, PySpark, Azure Data Lake, Azure Databricks, Azure Data Factory
2mo
Save
Mark Applied
Hide
Data Center Infrastructure Engineer (Req#1248)
Bangalore or Remote - India
HybridFull Time
ePlus
ePlusNASDAQ: PLUS: Provides integrated IT solutions, managed services, and cloud infrastructure.
5+ YOE5–10 years in infrastructure/data center engineering; 5+ years Kubernetes; automation (Ansible, Terraform); VMware (vSphere/ESXi/vCenter); networking; Linux; on-call support.
Kubernetes, Ansible, Terraform, VMware, vSphere, ESXi, vCenter, GitHub Actions, Jenkins, Prometheus, Grafana, Linux, Prometheus, Grafana