Visa
Posted 2mo ago

Sr. Data Engineer (3-6 years, Java/Python, Spark & Hadoop)

Visa
Bengaluru, Karnataka, India
HybridFull Time
Responsibilities
  • implementing code
  • building pipelines
  • monitoring performance
Requirements
  • 3+ years experience with data engineering
  • Bachelor's degree
  • Strong Java skills (required)
  • Experience with Spark
  • Hadoop and large-scale data pipelines
  • SQL databases
  • Unit testing
  • Automation, and troubleshooting in Agile environments
Technical tools mentioned
JavaSparkFlinkHive QueriesScoopScalaHadoopSpring FrameworkWeb servicesJ2EEOracle ServerMicrosoft SQL ServerPostgreSQL serverPythonShell ScriptGen AI toolsMCP

Job description

About Us
Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.

At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world.

Join Visa and do work that matters – to you, to your community, and to the world. Progress starts with you.

Job Description

We at Visa, dream of a future where it's easy to pay and be paid. Across the planet, Wherever, Whenever, Securely and Easily. Together, we are building leading edge full-service Payment Management solutions combining global payment processing, fraud management and payment security systems. We are looking for a talented Sr. Data Engineer to join our team!

The Sr. Data Engineer will play a pivotal role in Risk and Identity Solutions (VAS) department. In this mission critical role, it's an opportunity to design and implement solutions and taking it to the production with high quality completing all phases, following an agile methodology. The responsibilities also include gathering and clarifying requirements, facilitating communication with other groups within the organization, and guiding architectural decisions. It is an opportunity to learn, lead and work on technologies for RAIS applications.

Key Responsibilities:

  • Collaborate proactively with stakeholders to clarify requirements and identify key product stakeholders.
  • Review technical requirements, escalate potential design issues, and create component designs and documentation.
  • Implement code, apply coding patterns and best practices, and adhere to security requirements.
  • Participate in code reviews, apply feedback, and take ownership of data products or pipeline components.
  • Conduct unit testing, coding standards, and security scans; participate in user acceptance testing.
  • Build tools and simple automation processes for transforming, managing, accessing, deploying, and monitoring data processes.
  • Create queries to extract and compile raw data, implement orchestration techniques, and validate data quality.
  • Ensure adherence to data management principles, governance, and performance monitoring protocols.
  • Contribute to troubleshooting guidance and procedures for reviewing and fixing problems flagged by testing.
  • Address routine client requests requiring technical knowledge and support software upgrades and server patches for security remediation.

Visa requires at least 3 days in office, expectations of these days will be confirmed by your Hiring Manager.

Qualifications

Basic Qualifications:

  • 3-6 years of relevant work experience and a Bachelor's degree or with an Advanced degree.
  • Experience in collaborating with cross-functional teams to clarify requirements and define technical solutions.
  • Experience in designing and documenting technical components for data products or pipelines.
  • Experience in implementing code and applying coding standards and security requirements.
  • Experience in conducting unit testing and participating in user acceptance testing.
  • Experience in building automation tools for data processes.
  • Experience in creating queries and implementing data extraction and transformation techniques.
  • Experience in ensuring data quality and performance monitoring.
  • Experience in troubleshooting and resolving pipeline issues.
  • Experience in supporting software upgrades and security remediation.


Preferred Qualifications:

  • 3-6 or more years of work experience with a Bachelor’s Degree or with an Advanced Degree
  • Solid experience in software development experience (with a concentration in data centric initiatives) in technology industry with strong programming skills
  •  Solid hands-on experience with Data technologies like Java (must), Spark, Flink, Hive Queries, Scoop, Scala, Hadoop
  • Strong expertise in Java and Spring Framework , Web services, J2EE is must
  •  Experience with highly distributed, scalable, concurrent and low latency systems working with one or more of the following database technologies: Oracle Server, Microsoft SQL Server, PostgreSQL server.
  • Good to have hands-on experience with scripting languages like Python/Shell Script

  • Proficiency in creating and managing large-scale data pipelines, handling complex, high-volume, multi-dimensional data, and machine learning models.
  • Use of Gen AI tools for coding and knowledge would be must
  • Have a working expertise in building MCP tools and clients
  • Must have experience in a technical capacity and quality methodology/release process/testing techniques in order to provide guidance and leadership to junior team members is required.
  • Must have experience testing in an AGILE environment and should have exposure to testing environment migration, DB and infrastructure/system upgrades.
  •  Continuous Integration, Code/Test coverage working in different methodologies is a plus
  • Must have proactive and strong communications to work well across teams.

Visa is an EEO Employer

Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

About Visa

Global payment technology facilitating electronic funds transfers.

Similar jobs

Data Engineer roles near Bengaluru, Karnataka
20h
Save
Mark Applied
Hide
Senior Data Engineer
Bengaluru, Karnataka, India
HybridFull Time
Atlassian
AtlassianNASDAQ: TEAM: Develops software for team collaboration and project management.
6+ YOE6+ years in data engineering or related fields; STEM bachelor's or master's degree or equivalent experience; Python, advanced SQL, relational databases, ETL, data modeling, quality, visualization, optimization, and analytics experience.
Python, SQL, ETL, ELT
1d
Save
Mark Applied
Hide
Data Specialist - R01568669
Bangalore, Karnataka, India
OnsiteFull Time
Brillio
Brillio: Digital technology services and AI-led transformation partner.
5+ YOEBachelor’s or Master’s in computer science, engineering, or related field; 5+ years’ data engineering experience; expertise in Spark, Python, Scala, SQL, cloud platforms, ETL, APIs, storage, and version control.
SQL, Google BigQuery, Google Cloud Dataproc, Python, Data Catalog, Composer, Google Cloud Dataflow, Cloud Trace, Cloud Logging, Google Cloud Storage, Data Fusion, PL/SQL, T-SQL, Apache Spark, PySpark, AWS EMR, Apache Hadoop, Apache Hive, PostgreSQL, Scala, UNIX, Databricks, API, Amazon S3, Elasticsearch, Apache Airflow, Autosys, Git, SVN, HTML
1d
Save
Mark Applied
Hide
Sr.Data Engineering
Bengaluru, Karnataka, India
OnsiteFull Time
Bosch
Bosch: Global manufacturer of automotive and industrial engineering technology.
6+ YOE6–8 years of data engineering experience with Python, PySpark, SQL, ETL/ELT, Azure Databricks, Azure Data Factory, OpenShift, GitHub Actions, Grafana, and data pipeline development.
Python, PySpark, Azure Databricks, Azure Data Factory, Grafana, OpenShift, HELM, GitHub Actions, SQL Server, Azure SQL Server, Azure Key Vault, Kafka, Azure Event Hubs, Kubernetes
1d
Save
Mark Applied
Hide
Data Engineer
Bengaluru, Karnataka, India
OnsiteFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
3+ YOERequires 3+ years of experience, including 4 years with Databricks, 15 years of full-time education, and expertise in data engineering, generative and agentic AI, prompt engineering, and AI evaluation.
Databricks
1d
Save
Mark Applied
Hide
Data Engineer-Senior II
Bengaluru or Gurugram or Mumbai
OnsiteFull Time
FedEx
FedExNYSE: FDX: Global provider of courier, logistics, and transportation services.
4+ YOEBachelor's degree in computer science, engineering, mathematics, statistics, or similar; 4–7 years' experience; Python, PySpark, SAS, SQL, data modeling, cloud, ETL, and distributed data technologies.
Python, PySpark, SAS, Hadoop, Hive, Spark, Azure, Azure Data Factory, Azure Data Lake Storage, Azure DevOps, Databricks, Delta Lake, Docker, Kubernetes, Terraform, Octopus, SQL, Ab Initio, Informatica, DataStage, Power BI
1d
Save
Mark Applied
Hide
AWS Data Engineer
Gurugram or Bengaluru
HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
5+ YOEBachelor's degree and 5+ years as a data engineer; advanced SQL, Snowflake, ETL, CI/CD, Python, data modeling, and AWS services including S3 and Glue.
AWS, SQL, Snowflake, ETL, CI/CD, Amazon S3, Amazon Athena, AWS Glue, Amazon EMR, Apache Spark, Python
1d
Save
Mark Applied
Hide
Data Engineer - Axion
Sunnyvale or Washington or San Diego or Fort Walton Beach or Ann Arbor or London or Stuttgart or Munich or Stockholm or Bangalore or Seoul or Tokyo
$200k-$275k/yr OnsiteFull Time
Applied Intuition
Applied Intuition: Developing software and simulation infrastructure for autonomous vehicles.
5+ YOERequires 5+ years of relevant experience, modern ML infrastructure, large-scale GPU jobs, data software, microservices or databases, U.S. citizenship, and eligibility for security clearance.
React, TypeScript, Python, Golang, Docker, Kubernetes, Opensearch, Postgres, LLMs, VLMs, GPU
1d
Save
Mark Applied
Hide
Data Engineer-Senior II
Bengaluru or Mumbai or Gurugram
OnsiteFull Time
FedEx
FedExNYSE: FDX: Global provider of express delivery and logistics services.
4+ YOEBachelor’s degree in a relevant discipline and 4–7 years’ experience. Requires Python, PySpark, SAS, SQL, data pipelines, ETL, cloud platforms, Spark, and data modeling skills.
Python, PySpark, SAS, Hadoop, Hive, Spark, Azure, Azure Data Factory, ADLS Storage, Azure DevOps, Databricks, Delta Lake, Docker, CI/CD, Kubernetes, Terraform, Octopus, SQL, Ab Initio, Informatica, DataStage, Power BI