77 big data developer jobs at 37 companies in Union, NJ

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
1w
Save
Mark Applied
Hide
Big data Developer
Jersey City, New Jersey, United States
$100k-$120k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOE6+ years experience developing Big Data solutions using Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk and Cloudera; Bachelor's in Computer Science required.
Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk, Autosys, Cloudera, Linux
3w
Save
Mark Applied
Hide
Big Data Engineer, AVP
Whippany, New Jersey, United States
$161k-$170k/yr HybridFull Time
Barclays
BarclaysLondon Stock Exchange: BARC: Global bank providing retail, corporate, and investment financial services.
Experience building and maintaining data pipelines, data warehouses/lakes, Hadoop cluster administration, UNIX, Cloudera, Chef automation, ITIL processes, RCA for incidents, capacity planning, and collaborating with data science teams.
Hadoop, UNIX, Cloudera, Chef, RFT, BDH, Radial, ITIL
1mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
LiveRamp
LiveRampNew York Stock Exchange: RAMP: Provides a platform for secure data collaboration and identity.
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
3mo
Save
Mark Applied
Hide
Senior Java Big Data Developer - Assistant Vice President
Jersey City, New Jersey, United States
$121k-$182k/yr HybridFull Time
Citi
CitiNYSE: C: Providing global banking, investment, and wealth management services.
6+ YOE6+ years Java development experience with Core Java, Spring, Web Services/J2EE; experience with Spark, Kafka and Cloudera ecosystem (Hadoop, HDFS, Hive, Impala); REST/JSON/XSD; enterprise banking or regulatory domain experience preferred; Bachelor's degree or equivalent.
Java, J2EE, JavaScript, Spring, Spring MVC, Spark, Kafka, Hadoop, HDFS, Hive, Impala, JSON, XSD, RESTful Web services, AngularJS, CSS, HTML5, AJAX, Microsoft Excel, Microsoft Access, WebSphere, WASND, SVN, Bitbucket
3mo
Save
Mark Applied
Hide
Senior Java Big Data Developer - Assistant Vice President
Jersey City, New Jersey, United States
$121k-$182k/yr HybridFull Time
Citi
CitiNYSE: C: Global diversified financial services holding.
6+ YOE6+ years Java development with Core Java, Spring, Web Services/J2EE; experience with Spark, Kafka, Cloudera ecosystem (Hadoop, HDFS, Hive, Impala), JSON/XSD, RESTful services; enterprise Java project experience and banking domain knowledge; Bachelor's degree or equivalent.
Java, J2EE, Apache Spring, Spring MVC, Spark, Kafka, Cloudera, Hadoop, HDFS, Hive, Impala, JSON, XSD, RESTful Web Services, JavaScript, AngularJS, HTML5, CSS, AJAX, Microsoft Excel, Microsoft Access, WebSphere, WASND, SVN, Bitbucket
3w
Save
Mark Applied
Hide
DE&A - Core - Big Data Engineering - Hadoop Ecosystem
Pune or Milpitas or Seattle or Princeton or Cape Town or London or Zurich or Singapore or Mexico City
RemoteFull Time
Zensar
ZensarNational Stock Exchange of India: ZENSARTECH: Global technology firm providing digital transformation and infrastructure services.
8+ YOESenior quant/engineering role: 8+ years in quantitative development/architecture; strong Python (required), C++/Java (preferred); experience with Spark/Hadoop, SQL/NoSQL, cloud platforms (AWS/Azure/GCP), Kafka/Flink; strong quant finance knowledge and model development experience.
Python, C++, Java, NumPy, Pandas, SciPy, TensorFlow, Spark, Hadoop, SQL, NoSQL, AWS, Azure, GCP, Databricks, Snowflake, Kafka, Flink
2mo
Save
Mark Applied
Hide
Senior Lead Data Engineer
New York, New York, United States
$251k-$286k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
6+ YOE6+ years in application development; 2+ years in big data; 1+ year cloud computing (AWS/Azure/GCP).
Java, Scala, Python, SQL, Redshift, Snowflake, MongoDB, Cassandra, Hadoop, Hive, Spark, Kafka, Gurobi, Unix/Linux, Shell Scripting, AWS, Azure, Google Cloud, MapReduce, NoSQL
1mo
Save
Mark Applied
Hide
Lead Data Engineer
Cary or Bridgewater or New York
$120k-$176k/yr HybridFull Time
MetLife
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
8+ YOE8+ years data solutions experience with 4+ years in Azure/Databricks; strong SQL, Spark, Scala/Python, Big Data (Hive/HBase), Azure services, ETL/warehousing, CI/CD, data governance, and leadership/mentoring experience.
Microsoft Azure, Microsoft Azure Databricks, Databricks, Apache Spark, SQL, Scala, Python, Hive, HBase, Microsoft Azure Functions, Microsoft Cosmos DB, Microsoft Azure Data Factory, Delta Lake, Shell, Bash, Microsoft PowerShell, Microsoft Event Hub, Oracle, Microsoft SQL Server, CI/CD
3w
Save
Mark Applied
Hide
Senior Data Engineer
Brazil or New York City
$75k-$92k/yr RemoteFull Time
SecurityScorecard
SecurityScorecard: Provides continuous cybersecurity ratings and risk monitoring for organizations.
5+ YOE5+ years in data engineering building big data pipelines, Spark and strongly-typed language experience (Scala/Java), REST API design, Git, unit/integration testing, and 3+ years in agile environments.
Scala, Apache Spark, Python, Airflow, ScyllaDB, PostgreSQL, ClickHouse, Hive, Redis, Kafka, Kafka Connect, Docker, Jenkins, Terraform, AWS, Git
2d
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$145k-$223k/yr HybridFull Time
Early Warning Services
Early Warning Services: Operates payment and risk solutions for the financial industry.
8+ YOEBachelor's degree in CS or related,8+ years relevant experience building data platforms,experience with data warehouse, big data, ETL, cloud, AI/ML lifecycle, and delivering production systems.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, HDFS, Elastic Search, Oracle, SQL Server, IBM Infosphere, AppDynamics, Kubernetes
1w
Save
Mark Applied
Hide
Data Scientist & Engineer
New York, New York, United States
$85k-$110k/yr OnsiteFull Time
NYU Langone Health
NYU Langone Health: Academic medical system providing comprehensive patient care and education.
3+ YOEMaster's in a quantitative field and 3 years' data science/machine learning experience; proficiency in Python or R, scikitlearn, big data tools (Hadoop/Spark), SQL and NoSQL; strong software engineering, deployment, and communication skills.
Python, R, scikitlearn, Hadoop, MapReduce, Spark, SQL, MongoDB
1w
Save
Mark Applied
Hide
Senior Lead Software Engineer- Big Data / AWS / Java / Python
Jersey City, New Jersey, United States
$171k-$260k/yr OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years applied software engineering experience; advanced Java and/or Python; strong big-data skills (Spark, Databricks, Data Lake); AWS (ECS, EKS, EMR, Lambda); EMR and Excel proficiency not required here; experience with AI-assisted engineering and SDLC toolchain.
Java, Python, Spark, Databricks, Data Lake, AWS, ECS, EKS, EMR, Lambda, React, Java Script, CI/CD, Claude, AI, ML
1mo
Save
Mark Applied
Hide
Senior Cybersecurity Data Engineer
Columbus or Frisco or Berkeley Heights or Alpharetta or New Jersey or New York or United States
$109k-$182k/yr OnsiteFull Time
Fiserv
FiservNew York Stock Exchange: FI: Provides financial technology and payment processing services to institutions.
10+ YOE10+ years IT experience (5+ years Big Data), 5+ years building data transformation/pipeline processes, SQL and BigQuery proficiency, experience with Talend/Cribl/Spark/Kafka/PostgreSQL/AlloyDB, bachelor’s in CS/IT or equivalent military experience, and valid unrestricted U.S. work authorization.
Talend, BigQuery, SQL, Cribl, Spark, IBM Streams, Kafka, PostgreSQL, AlloyDB, NoSQL
9h
Save
Mark Applied
Hide
Data Engineer II, GTPC Tech, Compliance & Assurance, AWS Security
New York, New York, United States
$145k-$197k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOE3+ years data engineering experience building ETL pipelines, data modeling/warehousing, complex SQL, and programming (Python or similar); experience with distributed data systems and AWS big data technologies.
S3, EC2, RDS, Redshift, Kinesis, EMR, Lambda, Glue, Apache Airflow, Athena, IAM, Python, Ruby, Golang, Java, C++, C#, Rust, Perl, PostgreSQL, SQL Server, MySQL
2w
Save
Mark Applied
Hide
Director, Data Engineering
New York, New York, United States
$165k-$210k/yr OnsiteFull Time
Versant
VersantNasdaq: VSNT: Operates cable television networks and digital media entertainment platforms.
8+ YOE8+ years in data engineering; experience with cloud platforms, data warehouses, SQL/NoSQL, big data technologies, programming in Python/Java/Scala, team management, and media data platforms.
Python, Java, Scala, AWS, Google Cloud, Azure, Redshift, Snowflake, Databricks, PostgreSQL, MongoDB, BigQuery, Hadoop, Spark, Kafka, SQL, NoSQL, Tableau, Looker, Jira, Confluence
6h
Save
Mark Applied
Hide
Data and Cloud Engineer
New York City, New York, United States
$190k-$193k/yr HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
5+ YOEBachelor's in CS/Engineering plus 5 years software engineering (or Master's plus 3 years). Experience with SQL scripting, big data stack (HDFS,YARN,Spark,Hive,Sqoop,Impala,Airflow,Zookeeper,Kafka), GitHub/CI/CD, ETL, cloud platforms and Python frameworks.
SQL scripting, HDFS, YARN, Apache Spark, Spark, Hive, Sqoop, Impala, Airflow, Zookeeper, Kafka, Apache Hadoop, Elastic Search, GitHub, CI/CD, Snowflake, AWS, GCP, Databricks, Python, Django, Flask, PowerShell
1mo
Save
Mark Applied
Hide
Staff Data Engineer- Data Lake
New York, New York, United States
$170k-$190k/yr HybridFull Time
H1
H1: Data platform for healthcare professional insights and drug development.
8+ YOE8+ years building and scaling distributed data platforms; technical leadership and mentoring; strong Python (PySpark), Java/Scala, advanced SQL, Apache Spark, cloud-native big data (AWS EMR/Glue/S3/Athena/Redshift), orchestration (Argo/Airflow), containerization, observability, and experience with large-scale ingestion and data quality.
Apache Spark, Argo, Athena, Avro, CircleCI, Claude Code, Docker, EMR, Elastic MapReduce (EMR), Git, GitHub Copilot, Hudi, Java, JIRA, Kinesis, Kafka, Kubernetes, Ky, MAT, Microsoft Excel, Parquet, PySpark, Python, Redshift, S3, Scala, Spark, SQL, Delta, Glue, Airflow
4d
Save
Mark Applied
Hide
Data Engineer I-Pathology Molecular and Cell Based Medicine
New York, New York, United States
$85k-$109k/yr OnsiteFull Time
Mount Sinai Health System
Mount Sinai Health System: Integrated academic medical system providing patient care and research.
2+ YOEBachelor's in computer science or related,2+ years development experience (Linux preferred),strong SQL/NoSQL and big‑data stack knowledge,proficiency with 2+ languages and RESTful services.
LINUX, Oracle, PostgreSQL, MYSQL, Mongo DB, Scala, Python, Java, Node JS, Django, PHP, Hadoop, Spark, Kafka, Azure, AWS, JIRA, Microsoft Office Suite
4d
Save
Mark Applied
Hide
Data Engineer I-Pathology Molecular and Cell Based Medicine
New York, New York, United States
$85k-$109k/yr OnsiteFull Time
Mount Sinai Health System
Mount Sinai Health System: Provides comprehensive hospital, clinical, and medical research services.
2+ YOEBachelor's in Computer Science or related; 2+ years development experience (Linux preferred); strong SQL/NoSQL knowledge; proficiency in 2+ languages (Scala, Python, Java); experience with REST, microservices, big-data stacks, cloud (Azure/AWS).
LINUX, Oracle, PostgreSQL, MySQL, Mongo DB, Scala, Python, Java, Node JS, Django, PHP, Hadoop, Spark, Kafka, JIRA, Azure, AWS
3w
Save
Mark Applied
Hide
Lead Data Platform Engineer - 11623
New York, New York, United States
$125k-$174k/yr RemoteFull Time
Coupa
Coupa: Cloud-based platform for managing and optimizing business expenditures.
8+ YOEBachelor's degree and 8+ years managing big data technologies and pipelines; 5+ years cloud (AWS/Azure); Linux administration; MLOps/LLM operations; Bash/Python; containerization; IaC and automation tools.
S3, IAM, EMR, Redshift, ECS, Docker, Amazon ECS, EKS, Azure AKS, Terraform, Chef, Ansible, Jenkins, Rundeck, Git, helm charts, Bash, Python, Linux, ApacheSpark, MySQL Server, Looker