HiringCafe
Join our community

111 big data engineer jobs at 43 companies in Staten Island, NY

2mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
LiveRamp
LiveRampNew York Stock Exchange: RAMP: Provides a platform for secure data collaboration and identity.
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
Job PostingView all
2w
Save
Mark Applied
Hide
Big Data Developer
Jersey City, New Jersey, United States
$90k-$110k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOE6-8 years experience with Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk, Autosys; data wrangling, performance analysis, Linux experience; Bachelor's in Computer Science required.
Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk, Autosys, Cloudera, Linux
Job PostingView all
1w
Save
Mark Applied
Hide
Lead Big Data Engineer - VP
Whippany, New Jersey, United States
$170k-$230k/yr OnsiteFull Time
Barclays
BarclaysLondon Stock Exchange: BARC: Global bank providing retail, corporate, and investment financial services.
Expertise in Java, Scala, Apache Spark, Amazon S3, Hadoop, cloud big data platforms, Python, .NET, Unix/Linux shell scripting, distributed architectures, ETL/ELT, and regulated financial services.
Java, Scala, Apache Spark, Amazon S3, Hadoop, Python, .NET, Unix/Linux shell scripting, Agile
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Engineer, Big Data and Cloud
New York, New York, United States
$105k-$190k/yr HybridFull Time
Vistar Media
Vistar Media: Operates a programmatic marketplace for digital out-of-home advertising.
4+ YOE4+ years experience building scalable big-data pipelines using Python, Spark, SQL, cloud (GCP), Airflow and Kafka; strong software engineering, data architecture, and geospatial experience preferred.
Python, Spark, Scala, SQL, pandas, scikit-learn, scipy, numpy, GCP, Airflow, Kafka, Google BigQuery
Job PostingView all
3d
Save
Mark Applied
Hide
Big Data Engineer Graduate (TikTok Recommendation Architecture) - 2027 Start
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$128k-$317k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
Bachelor's degree in computer science or related field; knowledge of big data frameworks and Java or C++; strong coding and troubleshooting ability; enthusiasm for learning.
Hadoop, Hive, Flink, FlinkSQL, Apache Spark, Apache Kafka, HBase, Redis, RocksDB, Elasticsearch, Java, C++
Job PostingView all
2w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Providing global banking, investment, and wealth management services.
6+ YOEExpertise in PySpark and Hadoop ecosystem, strong SQL, data modeling, shell/Autosys automation, 6+ years apps development/systems analysis experience, bachelor’s degree or equivalent.
PySpark, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, Autosys, Apache Kafka, Shell scripting
Job PostingView all
2w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Global diversified financial services holding.
6+ YOEExpertise in PySpark and Hadoop ecosystem, complex SQL, data modeling, Autosys and shell scripting; 6+ years apps development or systems analysis experience; bachelor’s degree preferred.
PySpark, Hadoop, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, Autosys, Apache Kafka, Shell scripting
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer I, Sales Data Services (SDS)
New York, New York, United States
$111k-$185k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
1+ YOERequires 1+ year of data engineering experience, data modeling, warehousing, ETL pipelines, query and scripting languages. Big data and ETL tools are preferred.
AWS, Python, Amazon Redshift, SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala, KornShell, Hadoop, Hive, Apache Spark, EMR, Informatica, ODI, SSIS, BODI, Datastage
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Brazil or New York City
$75k-$92k/yr RemoteFull Time
SecurityScorecard
SecurityScorecard: Provides continuous cybersecurity ratings and risk monitoring for organizations.
5+ YOE5+ years in data engineering building big data pipelines, Spark and strongly-typed language experience (Scala/Java), REST API design, Git, unit/integration testing, and 3+ years in agile environments.
Scala, Apache Spark, Python, Airflow, ScyllaDB, PostgreSQL, ClickHouse, Hive, Redis, Kafka, Kafka Connect, Docker, Jenkins, Terraform, AWS, Git
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
Chapel Hill or Minneapolis or Newton or New York City
$115k-$145k/yr HybridFull Time
Well
Well: AI-powered health engagement platform for workforce wellness.
3+ YOE3+ years software development with cloud (AWS/GCP); experience with Node.js, Python, SQL, Terraform; strong systems design, TDD, and big data pipeline skills; healthcare data experience a plus.
Node.js, Python, SQL, Terraform, AWS, GCP, BigQuery
Job PostingView all
3d
Save
Mark Applied
Hide
Data Engineer, Proprietary Research
New York City, New York, United States
$160k-$220k/yr OnsiteFull Time
Point72
Point72: Global alternative investment firm managing capital and venture investments.
3+ YOERequires 3+ years in data engineering or a related field, strong Python development, experience with Spark or Scala, big data technology knowledge, and innovative problem-solving skills.
Python, Spark, Scala
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Lead Data Engineer
Richmond or Chicago or McLean or New York City or Plano
$209k-$286k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
6+ YOEBachelor's degree, 6+ years in application development, 2+ years in big data, and 1+ year in cloud computing; leadership, data engineering, programming, databases, and Agile experience required.
Java, Scala, Python, SQL, Redshift, Snowflake, AWS, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux
Job PostingView all
3w
Save
Mark Applied
Hide
Lead Data Engineer
New York City, New York, United States
$215k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience; preferred experience includes distributed data tools, streaming, NoSQL, and data warehousing.
Java, Scala, Python, RDBMS, NoSQL, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, SQL, Agile
Job PostingView all
3w
Save
Mark Applied
Hide
Lead Data Engineer
New York City, New York, United States
$215k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, 1+ year cloud experience; proficiency with Java/Scala/Python, SQL, distributed data tools, data warehousing, UNIX/Linux, and Agile practices.
Java, Scala, Python, SQL, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, shell scripting, AWS, Microsoft Azure, Google Cloud
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Scientist & Engineer
New York, New York, United States
$85k-$110k/yr OnsiteFull Time
NYU Langone Health
NYU Langone Health: Academic medical system providing comprehensive patient care and education.
3+ YOEMaster's in a quantitative field and 3 years' data science/machine learning experience; proficiency in Python or R, scikitlearn, big data tools (Hadoop/Spark), SQL and NoSQL; strong software engineering, deployment, and communication skills.
Python, R, scikitlearn, Hadoop, MapReduce, Spark, SQL, MongoDB
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Cary or Bridgewater or New York
$120k-$176k/yr HybridFull Time
MetLife
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
8+ YOE8+ years data solutions experience with 4+ years in Azure/Databricks; strong SQL, Spark, Scala/Python, Big Data (Hive/HBase), Azure services, ETL/warehousing, CI/CD, data governance, and leadership/mentoring experience.
Microsoft Azure, Microsoft Azure Databricks, Databricks, Apache Spark, SQL, Scala, Python, Hive, HBase, Microsoft Azure Functions, Microsoft Cosmos DB, Microsoft Azure Data Factory, Delta Lake, Shell, Bash, Microsoft PowerShell, Microsoft Event Hub, Oracle, Microsoft SQL Server, CI/CD
Job PostingView all
1d
Save
Mark Applied
Hide
Lead Data Engineer
Teaneck, New Jersey, United States
OnsiteFull Time
Cognizant
CognizantNASDAQ: CTSH: Provides IT consulting and technology services to global enterprises.
Extensive experience designing scalable Big Data pipelines and Azure Cloud solutions using Spark, Python, SQL, Kafka, Azure Synapse, Databricks, and distributed data-processing frameworks; technical leadership required.
Spark, PySpark, Scala, Java, Python, SQL, Hive, Kafka, Azure Synapse Analytics, Azure Data Lake Storage, Azure Data Factory, Databricks, HDFS, MapReduce, Impala, Tez, Sqoop, Oozie, HBase, Cassandra, MongoDB, Storm, Knox, Ranger, Flume, NiFi, Kerberos, Sentry, Cloudera Manager, Cloudera Navigator, Ambari, Azure Cloud
Job PostingView all
2w
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$175k-$270k/yr HybridFull Time
Early Warning Services
Early Warning Services: Operates payment and risk solutions for the financial industry.
8+ YOE8+ years building large-scale data platforms, distributed systems, cloud-native data pipelines, EM/ML operationalization, and data warehouse/Big Data solutions; Bachelor's in CS or related.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, Aerospike, Elastic Search, IBM Infosphere, Oracle, SQL Server, AppDynamics, Kubernetes
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Data Engineer- Data Lake
New York, New York, United States
$170k-$190k/yr HybridFull Time
H1
H1: Data platform for healthcare professional insights and drug development.
8+ YOE8+ years building and scaling distributed data platforms; technical leadership and mentoring; strong Python (PySpark), Java/Scala, advanced SQL, Apache Spark, cloud-native big data (AWS EMR/Glue/S3/Athena/Redshift), orchestration (Argo/Airflow), containerization, observability, and experience with large-scale ingestion and data quality.
Apache Spark, Argo, Athena, Avro, CircleCI, Claude Code, Docker, EMR, Elastic MapReduce (EMR), Git, GitHub Copilot, Hudi, Java, JIRA, Kinesis, Kafka, Kubernetes, Ky, MAT, Microsoft Excel, Parquet, PySpark, Python, Redshift, S3, Scala, Spark, SQL, Delta, Glue, Airflow
Job PostingView all
1d
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano or Delaware or Florida or New Jersey or North Carolina or Texas or United States
$82k-$127k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Global provider of digital services, consulting, and technology solutions.
Bachelor's degree or equivalent experience; Hadoop, Hive, Spark, PySpark, Python, Unix shell scripting, SQL, data warehousing, orchestration tools, Agile, and production Big Data experience required.
Hadoop, PySpark, Cloudera, Hive, Spark, Python, Unix, Autosys, Airflow, SQL, Agile, Tableau, AI, cloud, containerization
Job PostingView all

Explore Jobs

Expand Your Job Search