122 big data engineer jobs at 47 companies in Avenel, NJ

4w
Save
Mark Applied
Hide
Senior Big Data Engineer
New York City, New York, United States
$170k-$180k/yr HybridFull Time
Magnite
MagniteNASDAQ: MGNI: Independent sell-side platform for digital media advertising.
4+ YOE4+ years supporting large-scale Linux and distributed big data platforms (Kafka, Hadoop/MapR, Aerospike). Strong Linux administration, networking, scripting, monitoring, and production troubleshooting skills.
Apache Kafka, Hadoop, MapR, Aerospike, Spark, Rocky Linux, RHEL, CentOS, PostgreSQL, MySQL, ScyllaDB, Bash, Python, Terraform, Spacelift, Puppet, Ansible, Grafana, Prometheus, Graphite, Kubernetes, Ceph, AWS
2mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
LiveRamp
LiveRampNew York Stock Exchange: RAMP: Provides a platform for secure data collaboration and identity.
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
3d
Save
Mark Applied
Hide
Big Data Developer
Jersey City, New Jersey, United States
$80k-$95k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOERequires a bachelor's degree in computer science and 6–8 years of experience with Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk, Autosys, Linux, and Cloudera Big Data.
Kafka, Apache Spark, Scala, SQL, Apache Hive, Impala, Apache Hadoop, Splunk, Autosys, Cloudera, Linux
2w
Save
Mark Applied
Hide
Lead Big Data Engineer - VP
Whippany, New Jersey, United States
$170k-$230k/yr OnsiteFull Time
Barclays
BarclaysLondon Stock Exchange: BARC: Global bank providing retail, corporate, and investment financial services.
Expertise in Java, Scala, Apache Spark, Amazon S3, Hadoop, cloud big data platforms, Python, .NET, Unix/Linux shell scripting, distributed architectures, ETL/ELT, and regulated financial services.
Java, Scala, Apache Spark, Amazon S3, Hadoop, Python, .NET, Unix/Linux shell scripting, Agile
3w
Save
Mark Applied
Hide
Senior Data Engineer, Big Data and Cloud
New York, New York, United States
$105k-$190k/yr HybridFull Time
Vistar Media
Vistar Media: Operates a programmatic marketplace for digital out-of-home advertising.
4+ YOE4+ years experience building scalable big-data pipelines using Python, Spark, SQL, cloud (GCP), Airflow and Kafka; strong software engineering, data architecture, and geospatial experience preferred.
Python, Spark, Scala, SQL, pandas, scikit-learn, scipy, numpy, GCP, Airflow, Kafka, Google BigQuery
1w
Save
Mark Applied
Hide
Big Data Engineer Graduate (TikTok Recommendation Architecture) - 2027 Start
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$128k-$317k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
Bachelor's degree in computer science or related field; knowledge of big data frameworks and Java or C++; strong coding and troubleshooting ability; enthusiasm for learning.
Hadoop, Hive, Flink, FlinkSQL, Apache Spark, Apache Kafka, HBase, Redis, RocksDB, Elasticsearch, Java, C++
3w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Providing global banking, investment, and wealth management services.
6+ YOEExpertise in PySpark and Hadoop ecosystem, strong SQL, data modeling, shell/Autosys automation, 6+ years apps development/systems analysis experience, bachelor’s degree or equivalent.
PySpark, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, Autosys, Apache Kafka, Shell scripting
3w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Global diversified financial services holding.
6+ YOEExpertise in PySpark and Hadoop ecosystem, complex SQL, data modeling, Autosys and shell scripting; 6+ years apps development or systems analysis experience; bachelor’s degree preferred.
PySpark, Hadoop, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, Autosys, Apache Kafka, Shell scripting
2w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: A global financial services providing banking and credit services.
6+ YOERequires 6–10 years of applications development or systems analysis experience, PySpark and Hadoop expertise, complex SQL, distributed systems, data modeling, shell scripting, Autosys, and a bachelor's degree or equivalent.
PySpark, Hadoop, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, shell scripting, Autosys, Apache Kafka
1w
Save
Mark Applied
Hide
Data Engineer I, Sales Data Services (SDS)
New York, New York, United States
$111k-$185k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
1+ YOERequires 1+ year of data engineering experience, data modeling, warehousing, ETL pipelines, query and scripting languages. Big data and ETL tools are preferred.
AWS, Python, Amazon Redshift, SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala, KornShell, Hadoop, Hive, Apache Spark, EMR, Informatica, ODI, SSIS, BODI, Datastage
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Brazil or New York City
$75k-$92k/yr RemoteFull Time
SecurityScorecard
SecurityScorecard: Provides continuous cybersecurity ratings and risk monitoring for organizations.
5+ YOE5+ years in data engineering building big data pipelines, Spark and strongly-typed language experience (Scala/Java), REST API design, Git, unit/integration testing, and 3+ years in agile environments.
Scala, Apache Spark, Python, Airflow, ScyllaDB, PostgreSQL, ClickHouse, Hive, Redis, Kafka, Kafka Connect, Docker, Jenkins, Terraform, AWS, Git
1mo
Save
Mark Applied
Hide
Data Engineer
Chapel Hill or Minneapolis or Newton or New York City
$115k-$145k/yr HybridFull Time
Well
Well: AI-powered health engagement platform for workforce wellness.
3+ YOE3+ years software development with cloud (AWS/GCP); experience with Node.js, Python, SQL, Terraform; strong systems design, TDD, and big data pipeline skills; healthcare data experience a plus.
Node.js, Python, SQL, Terraform, AWS, GCP, BigQuery
1w
Save
Mark Applied
Hide
Data Engineer, Proprietary Research
New York City, New York, United States
$160k-$220k/yr OnsiteFull Time
Point72
Point72: Global alternative investment firm managing capital and venture investments.
3+ YOERequires 3+ years in data engineering or a related field, strong Python development, experience with Spark or Scala, big data technology knowledge, and innovative problem-solving skills.
Python, Spark, Scala
1mo
Save
Mark Applied
Hide
Senior Lead Data Engineer
Richmond or Chicago or McLean or New York City or Plano
$209k-$286k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
6+ YOEBachelor's degree, 6+ years in application development, 2+ years in big data, and 1+ year in cloud computing; leadership, data engineering, programming, databases, and Agile experience required.
Java, Scala, Python, SQL, Redshift, Snowflake, AWS, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux
1mo
Save
Mark Applied
Hide
Lead Data Engineer
New York City, New York, United States
$215k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience; preferred experience includes distributed data tools, streaming, NoSQL, and data warehousing.
Java, Scala, Python, RDBMS, NoSQL, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, SQL, Agile
1mo
Save
Mark Applied
Hide
Lead Data Engineer
New York City, New York, United States
$215k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, 1+ year cloud experience; proficiency with Java/Scala/Python, SQL, distributed data tools, data warehousing, UNIX/Linux, and Agile practices.
Java, Scala, Python, SQL, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, shell scripting, AWS, Microsoft Azure, Google Cloud
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Cary or Bridgewater or New York
$120k-$176k/yr HybridFull Time
MetLife
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
8+ YOE8+ years data solutions experience with 4+ years in Azure/Databricks; strong SQL, Spark, Scala/Python, Big Data (Hive/HBase), Azure services, ETL/warehousing, CI/CD, data governance, and leadership/mentoring experience.
Microsoft Azure, Microsoft Azure Databricks, Databricks, Apache Spark, SQL, Scala, Python, Hive, HBase, Microsoft Azure Functions, Microsoft Cosmos DB, Microsoft Azure Data Factory, Delta Lake, Shell, Bash, Microsoft PowerShell, Microsoft Event Hub, Oracle, Microsoft SQL Server, CI/CD
1w
Save
Mark Applied
Hide
Lead Data Engineer
Teaneck, New Jersey, United States
OnsiteFull Time
Cognizant
CognizantNASDAQ: CTSH: Provides IT consulting and technology services to global enterprises.
Extensive experience designing scalable Big Data pipelines and Azure Cloud solutions using Spark, Python, SQL, Kafka, Azure Synapse, Databricks, and distributed data-processing frameworks; technical leadership required.
Spark, PySpark, Scala, Java, Python, SQL, Hive, Kafka, Azure Synapse Analytics, Azure Data Lake Storage, Azure Data Factory, Databricks, HDFS, MapReduce, Impala, Tez, Sqoop, Oozie, HBase, Cassandra, MongoDB, Storm, Knox, Ranger, Flume, NiFi, Kerberos, Sentry, Cloudera Manager, Cloudera Navigator, Ambari, Azure Cloud
3mo
Save
Mark Applied
Hide
Sr. Databricks Data Engineer, Vice President
Quincy or Princeton
$120k-$203k/yr HybridFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
10+ YOESenior Databricks data engineer with 10+ years Big Data, 5+ years Databricks, Azure cloud experience.
Databricks, Delta Lake, Apache Spark, Databricks SQL, Scala, Azure, Kubernetes, Docker, Snowflake, Git, ADO, Harness, UNIX, TOAD, SQL developer
3w
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$175k-$270k/yr HybridFull Time
Early Warning Services
Early Warning Services: Operates payment and risk solutions for the financial industry.
8+ YOE8+ years building large-scale data platforms, distributed systems, cloud-native data pipelines, EM/ML operationalization, and data warehouse/Big Data solutions; Bachelor's in CS or related.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, Aerospike, Elastic Search, IBM Infosphere, Oracle, SQL Server, AppDynamics, Kubernetes