127 big data developer jobs at 46 companies in Lake Success, NY

3d
Save
Mark Applied
Hide
Big Data Developer
Jersey City, New Jersey, United States
$80k-$95k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOERequires a bachelor's degree in computer science and 6–8 years of experience with Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk, Autosys, Linux, and Cloudera Big Data.
Kafka, Apache Spark, Scala, SQL, Apache Hive, Impala, Apache Hadoop, Splunk, Autosys, Cloudera, Linux
4w
Save
Mark Applied
Hide
Senior Big Data Engineer
New York City, New York, United States
$170k-$180k/yr HybridFull Time
Magnite
MagniteNASDAQ: MGNI: Independent sell-side platform for digital media advertising.
4+ YOE4+ years supporting large-scale Linux and distributed big data platforms (Kafka, Hadoop/MapR, Aerospike). Strong Linux administration, networking, scripting, monitoring, and production troubleshooting skills.
Apache Kafka, Hadoop, MapR, Aerospike, Spark, Rocky Linux, RHEL, CentOS, PostgreSQL, MySQL, ScyllaDB, Bash, Python, Terraform, Spacelift, Puppet, Ansible, Grafana, Prometheus, Graphite, Kubernetes, Ceph, AWS
2w
Save
Mark Applied
Hide
Lead Big Data Engineer - VP
Whippany, New Jersey, United States
$170k-$230k/yr OnsiteFull Time
Barclays
BarclaysLondon Stock Exchange: BARC: Global bank providing retail, corporate, and investment financial services.
Expertise in Java, Scala, Apache Spark, Amazon S3, Hadoop, cloud big data platforms, Python, .NET, Unix/Linux shell scripting, distributed architectures, ETL/ELT, and regulated financial services.
Java, Scala, Apache Spark, Amazon S3, Hadoop, Python, .NET, Unix/Linux shell scripting, Agile
1w
Save
Mark Applied
Hide
Big Data Engineer Graduate (TikTok Recommendation Architecture) - 2027 Start
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$128k-$317k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
Bachelor's degree in computer science or related field; knowledge of big data frameworks and Java or C++; strong coding and troubleshooting ability; enthusiasm for learning.
Hadoop, Hive, Flink, FlinkSQL, Apache Spark, Apache Kafka, HBase, Redis, RocksDB, Elasticsearch, Java, C++
2mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
LiveRamp
LiveRampNew York Stock Exchange: RAMP: Provides a platform for secure data collaboration and identity.
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
3w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Global diversified financial services holding.
6+ YOEExpertise in PySpark and Hadoop ecosystem, complex SQL, data modeling, Autosys and shell scripting; 6+ years apps development or systems analysis experience; bachelor’s degree preferred.
PySpark, Hadoop, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, Autosys, Apache Kafka, Shell scripting
3w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: A global financial services providing banking and credit services.
6+ YOERequires 6–10 years of applications development or systems analysis experience, PySpark and Hadoop expertise, complex SQL, distributed systems, data modeling, shell scripting, Autosys, and a bachelor's degree or equivalent.
PySpark, Hadoop, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, shell scripting, Autosys, Apache Kafka
3w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Providing global banking, investment, and wealth management services.
6+ YOEExpertise in PySpark and Hadoop ecosystem, strong SQL, data modeling, shell/Autosys automation, 6+ years apps development/systems analysis experience, bachelor’s degree or equivalent.
PySpark, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, Autosys, Apache Kafka, Shell scripting
3w
Save
Mark Applied
Hide
Senior Data Engineer, Big Data and Cloud
New York, New York, United States
$105k-$190k/yr HybridFull Time
Vistar Media
Vistar Media: Operates a programmatic marketplace for digital out-of-home advertising.
4+ YOE4+ years experience building scalable big-data pipelines using Python, Spark, SQL, cloud (GCP), Airflow and Kafka; strong software engineering, data architecture, and geospatial experience preferred.
Python, Spark, Scala, SQL, pandas, scikit-learn, scipy, numpy, GCP, Airflow, Kafka, Google BigQuery
1mo
Save
Mark Applied
Hide
Data Engineer
Chapel Hill or Minneapolis or Newton or New York City
$115k-$145k/yr HybridFull Time
Well
Well: AI-powered health engagement platform for workforce wellness.
3+ YOE3+ years software development with cloud (AWS/GCP); experience with Node.js, Python, SQL, Terraform; strong systems design, TDD, and big data pipeline skills; healthcare data experience a plus.
Node.js, Python, SQL, Terraform, AWS, GCP, BigQuery
1mo
Save
Mark Applied
Hide
Lead Data Engineer
New York City, New York, United States
$215k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience; preferred experience includes distributed data tools, streaming, NoSQL, and data warehousing.
Java, Scala, Python, RDBMS, NoSQL, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, SQL, Agile
1mo
Save
Mark Applied
Hide
Lead Data Engineer
New York City, New York, United States
$215k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
4+ YOEBachelor’s degree, 4+ years in application development, 2+ years in big data, 1+ year in cloud computing, and experience with Python, SQL, Scala, Java, distributed systems, databases, and data warehousing.
Java, Scala, Python, SQL, Redshift, Snowflake, AWS, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, Agile
1mo
Save
Mark Applied
Hide
Lead Data Engineer
New York City, New York, United States
$215k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, 1+ year cloud experience; proficiency with Java/Scala/Python, SQL, distributed data tools, data warehousing, UNIX/Linux, and Agile practices.
Java, Scala, Python, SQL, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, shell scripting, AWS, Microsoft Azure, Google Cloud
1w
Save
Mark Applied
Hide
Data Engineer, Proprietary Research
New York City, New York, United States
$160k-$220k/yr OnsiteFull Time
Point72
Point72: Global alternative investment firm managing capital and venture investments.
3+ YOERequires 3+ years in data engineering or a related field, strong Python development, experience with Spark or Scala, big data technology knowledge, and innovative problem-solving skills.
Python, Spark, Scala
2w
Save
Mark Applied
Hide
Data Engineer I, Sales Data Services (SDS)
New York, New York, United States
$111k-$185k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
1+ YOE1+ years data engineering experience; data modeling, warehousing, and ETL development; SQL and scripting (Python) proficiency; familiarity with big data technologies and AWS.
AWS, Python, Redshift, SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala, KornShell, Hadoop, Hive, Spark, EMR, Informatica, ODI, SSIS, BODI, Datastage
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Cary or Bridgewater or New York
$120k-$176k/yr HybridFull Time
MetLife
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
8+ YOE8+ years data solutions experience with 4+ years in Azure/Databricks; strong SQL, Spark, Scala/Python, Big Data (Hive/HBase), Azure services, ETL/warehousing, CI/CD, data governance, and leadership/mentoring experience.
Microsoft Azure, Microsoft Azure Databricks, Databricks, Apache Spark, SQL, Scala, Python, Hive, HBase, Microsoft Azure Functions, Microsoft Cosmos DB, Microsoft Azure Data Factory, Delta Lake, Shell, Bash, Microsoft PowerShell, Microsoft Event Hub, Oracle, Microsoft SQL Server, CI/CD
1w
Save
Mark Applied
Hide
Lead Data Engineer
Teaneck, New Jersey, United States
OnsiteFull Time
Cognizant
CognizantNASDAQ: CTSH: Provides IT consulting and technology services to global enterprises.
Extensive experience designing scalable Big Data pipelines and Azure Cloud solutions using Spark, Python, SQL, Kafka, Azure Synapse, Databricks, and distributed data-processing frameworks; technical leadership required.
Spark, PySpark, Scala, Java, Python, SQL, Hive, Kafka, Azure Synapse Analytics, Azure Data Lake Storage, Azure Data Factory, Databricks, HDFS, MapReduce, Impala, Tez, Sqoop, Oozie, HBase, Cassandra, MongoDB, Storm, Knox, Ranger, Flume, NiFi, Kerberos, Sentry, Cloudera Manager, Cloudera Navigator, Ambari, Azure Cloud
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Brazil or New York City
$75k-$92k/yr RemoteFull Time
SecurityScorecard
SecurityScorecard: Provides continuous cybersecurity ratings and risk monitoring for organizations.
5+ YOE5+ years in data engineering building big data pipelines, Spark and strongly-typed language experience (Scala/Java), REST API design, Git, unit/integration testing, and 3+ years in agile environments.
Scala, Apache Spark, Python, Airflow, ScyllaDB, PostgreSQL, ClickHouse, Hive, Redis, Kafka, Kafka Connect, Docker, Jenkins, Terraform, AWS, Git
1w
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano or Delaware or Florida or New Jersey or North Carolina or Texas or United States
$82k-$127k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Global provider of digital services, consulting, and technology solutions.
Bachelor's degree or equivalent experience; Hadoop, Hive, Spark, PySpark, Python, Unix shell scripting, SQL, data warehousing, orchestration tools, Agile, and production Big Data experience required.
Hadoop, PySpark, Cloudera, Hive, Spark, Python, Unix, Autosys, Airflow, SQL, Agile, Tableau, AI, cloud, containerization
1w
Save
Mark Applied
Hide
Data Engineer III - Digital and Technology Partners - Hybrid/Remote
New York City, New York, United States
$109k-$164k/yr HybridFull Time
Mount Sinai Health System
Mount Sinai Health System: Provides comprehensive hospital, clinical, and medical research services.
5+ YOEBachelor's degree in computer science or related field, 5+ years of professional development experience, Azure and data engineering expertise, databases, programming, big data, cloud, Agile, and version control skills.
Microsoft Azure, Azure Data Factory, Databricks, SQL, NoSQL, Oracle, PostgreSQL, MySQL, MongoDB, Scala, Python, Java, Node.js, Django, PHP, Hadoop, Spark, Kafka, HL7, Mirth, CI/CD, Git, AWS, JIRA, VMs