52 software developer big data jobs at 23 companies in New York
2mo
Save
Mark Applied
Hide
Lead Software Engineer - Big Data
Rockville or Washington or Tysons or Colorado or Florida or Texas or Illinois or Pennsylvania or Massachusetts or Maryland or Virginia or New York or New Jersey
$114k-$249k/yr HybridFull Time
7+ YOEBachelor's in CS or related + 7+ years experience; deep Big Data (Hadoop, Spark, Hive, Trino), SQL, AWS (S3, EMR, Glue, Lambda, Athena, EKS), Python/Scala, system design, CI/CD, DevOps, security, and team mentoring experience.
Hadoop, Spark, Hive, Trino, SQL, S3, EMR, Glue, Lambda, Athena, EKS, Python, Scala, GitHub Copilot, Q Developer, ChatGPT, Claude, Scrum, Kanban, CI/CD, DevOps
1w
Save
Mark Applied
Hide
Big Data Engineer Graduate (TikTok Recommendation Architecture) - 2027 Start
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$128k-$317k/yr OnsiteFull Time
Bachelor's degree in computer science or related field; knowledge of big data frameworks and Java or C++; strong coding and troubleshooting ability; enthusiasm for learning.
Hadoop, Hive, Flink, FlinkSQL, Apache Spark, Apache Kafka, HBase, Redis, RocksDB, Elasticsearch, Java, C++
3mo
Save
Mark Applied
Hide
Software Engineer (L3) Data Substrate
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or District of Columbia or Washington or California or San Francisco or Oakland or San Jose or Washington
$139k-$204k/yr RemoteFull Time
5+ YOEBachelor's or Master's in CS/Engineering, 5+ years software development, proficiency in Python/Java/Scala, experience with big data tools (Kafka, Spark, Hive, Hudi, Presto, Airflow) and AWS services, strong problem-solving and communication skills.
Kafka, Spark, Hive, Hudi, Presto, Airflow, AWS Lakeformation, Glue, Athena, Python, Java, Scala
3w
Save
Mark Applied
Hide
Senior Data Engineer, Big Data and Cloud
New York, New York, United States
$105k-$190k/yr HybridFull Time
4+ YOE4+ years experience building scalable big-data pipelines using Python, Spark, SQL, cloud (GCP), Airflow and Kafka; strong software engineering, data architecture, and geospatial experience preferred.
Python, Spark, Scala, SQL, pandas, scikit-learn, scipy, numpy, GCP, Airflow, Kafka, Google BigQuery
1mo
Save
Mark Applied
Hide
Data Engineer
Chapel Hill or Minneapolis or Newton or New York City
$115k-$145k/yr HybridFull Time
3+ YOE3+ years software development with cloud (AWS/GCP); experience with Node.js, Python, SQL, Terraform; strong systems design, TDD, and big data pipeline skills; healthcare data experience a plus.
Node.js, Python, SQL, Terraform, AWS, GCP, BigQuery
2mo
Save
Mark Applied
Hide
Software Development Engineer, Data Platform, Prime Video Personalization & Discovery
New York or Sunnyvale or Seattle
OnsiteFull Time
3+ YOE3+ years professional software development; design/architecture experience; large-scale distributed systems; Java/C#/C++/Python; big data with AWS/Hadoop/Spark; BS in CS preferred.
Java, C++, C#, Python, AWS, Hadoop, Spark, Pig, Hive, Lucene/SOLR, Storm/Samza, Git, CI/CD
3w
Save
Mark Applied
Hide
Software Engineer, Data Platform (All Teams)
San Francisco or Seattle or Sunnyvale or New York City
$131k-$285k/yr OnsiteFull Time
2+ YOEComputer science degree or equivalent, 2+ years industry experience at I4 or 5+ years at I5, AI coding tool proficiency, and experience building scalable big data infrastructure and governance.
Apache Spark, Apache Flink, Apache Kafka, Apache Airflow, Cassandra, ClickHouse, Apache Iceberg, DataHub, Claude Code, Codex, Cursor
1w
Save
Mark Applied
Hide
Lead Data Engineer
New York City or McLean or Richmond
$179k-$246k/yr OnsiteFull Time
4+ YOEBachelor's degree; 4+ years application development, 2+ years big data, and 1+ year cloud computing experience. Preferred: Python, SQL, Scala, Java, distributed data, streaming, NoSQL, warehousing, Linux, and Agile.
Java, Scala, Python, SQL, Redshift, Snowflake, AWS, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, shell scripting, Agile
1mo
Save
Mark Applied
Hide
Senior Lead Data Engineer
Richmond or Chicago or McLean or New York City or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree, 6+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience; leadership and data engineering expertise required.
Java, Scala, Python, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, AWS, Microsoft Azure, Google Cloud, SQL, Agile
1w
Save
Mark Applied
Hide
Lead Data Engineer
New York City or McLean or Richmond or United States
$215k-$246k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience. Preferred experience includes Python, SQL, Scala, Java, distributed systems, streaming, NoSQL, and data warehousing.
Java, Scala, Python, SQL, Redshift, Snowflake, AWS, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, Agile
4w
Save
Mark Applied
Hide
Principal Software Engineer, Real Time Data Enrichment Platform (Hybrid)
New York City or Austin or Sunnyvale or Redmond
$195k-$290k/yr HybridFull Time
12+ YOEExtensive experience designing and operating very high-scale data platforms; deep expertise in distributed systems, big-data frameworks, and JVM languages; advanced degree and 12+ years experience preferred.
Spark, Flink, Iceberg, Pinot, Ray, Scala, Java, Kotlin, Postgres, MySQL, Cassandra, DynamoDB, Presto, Trino, Druid, Kafka, Hadoop, Linux, Go, Kubernetes, Mesos
1w
Save
Mark Applied
Hide
Software Engineer, Partner Engineering
United States or Redwood City or Los Angeles or New York City
$141k-$205k/yr RemoteFull Time
5+ YOERequires 5+ years of related experience, a bachelor's degree, programming proficiency, strong SQL and big data analysis skills, troubleshooting ability, and customer-focused communication.
Golang, Python, JavaScript, Java, SQL
1mo
Save
Mark Applied
Hide
Senior Software Engineer (Java)
New York City, New York, United States
$143k-$186k/yr HybridFull Time
5+ YOE5+ years experience; strong Java (3+ years), PostgreSQL, Linux, and Git skills; experience with big data, design patterns, algorithms, and using AI tools across the SDLC; Bachelor's in CS or related field required.
Java, PostgreSQL, Linux, Git, Claude, Copilot
2mo
Save
Mark Applied
Hide
Software Engineer 5 - Ads Identity & Privacy
New York, New York, United States
$388k-$619k/yr OnsiteFull Time
Design and build privacy-preserving features for ad platforms; strong knowledge of data privacy, governance, and regional regulations; proficiency in Java/Python/C++ and big data tools; experience with distributed cloud systems.
Java, Python, C++, Spark
1w
Save
Mark Applied
Hide
Product Software Engineer I
New York City or Seattle or San Francisco
$102k-$143k/yr HybridFull Time
1+ YOEBachelor's degree or equivalent experience; big data tools such as Databricks or Snowflake; reliable code in SQL, Python, or Scala; large-scale systems experience; AI/ML familiarity preferred.
Databricks, Snowflake, SQL, Python, Scala, AI/ML, RAG
3mo
Save
Mark Applied
Hide
Software Engineer 5 - Ads Audience Activation
New York or Los Angeles or Los Gatos or Seattle
$388k-$619k/yr OnsiteFull Time
Experience in designing scalable batch and streaming data onboarding systems; proficiency in Java, Python, C++, or similar; familiarity with Kafka, Flink; big data tools like Spark; distributed cloud applications; knowledge of ad tech and privacy considerations.
Kafka, Flink, Spark, Java, Python, C++
4d
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
San Francisco or Scottsdale or Chicago or New York City or Phoenix
$174k-$223k/yr HybridFull Time
8+ YOEBachelor's degree and 8+ years' experience, including 7+ years developing complex data platforms and 6+ years with data warehouses, lakes, and big data. Requires AWS, Python, Databricks, Snowflake, Spark, and Terraform expertise.
Snowflake, Databricks, Apache Iceberg, Amazon S3, Python, PySpark, Apache Spark, Amazon SNS, Amazon SQS, Amazon Kinesis, Apache Kafka, AWS, Terraform, CI/CD, Agile, Scrum, Lean, DevOps, AWS Glue, Amazon Airflow, Amazon Redshift, AWS Lambda, Amazon Athena, Delta Lake, Kubernetes, Amazon EKS, EMR
2w
Save
Mark Applied
Hide
Government and Public Sector - AI & Data - GenAI Developer
McLean or Washington, D.C. or New York or Washington or California
$76k-$126k/yr HybridFull Time
1+ YOEBachelor's degree and 1–2+ years of web and backend development experience. Requires JavaScript/TypeScript, Python or Node.js, generative AI integration, cloud deployment, data engineering, big data, and Secret Clearance eligibility.
JavaScript, React, Next.js, Python, FastAPI, AWS, Azure, Vercel, Svelte, Vue, Remix, React Router, Node.js, TypeScript, openAI, Anthropic, Hortonworks, Microsoft, Hadoop, RAG
1mo
Save
Mark Applied
Hide
Backend Software Engineer - Platforms
New York, New York, United States
OnsiteFull Time
3+ YOEBS in CS or equivalent, experience with web apps, Unix/Linux, distributed systems, networking, and large systems; DICM/ITOM/ITSM experience required; GPU or big data (Hadoop/Kafka/Apache) experience valuable; Golang or Python development experience and production troubleshooting skills.
Golang, Python, Unix/Linux, Hadoop, Kafka, Apache, GPU, Discovery, Insights, and Configuration Management (DICM), IT Operation Management (ITOM), IT Service Management (ITSM)
2mo
Save
Mark Applied
Hide
Senior Manager, Software Engineering
New York, New York, United States
$141k-$262k/yr OnsiteFull Time
10+ YOE3+ Mgmt10+ years in software engineering; 3+ years in engineering management; leadership of product-focused teams; experience with big data (Databricks, Spark), cloud platforms, and AI-enabled workflows.
Databricks, Spark, AWS, Azure, GCP, Cursor, GitHub Copilot
Explore Jobs
Expand Your Job Search
Top Cities in New York for Software Developer Big Data
- Software Developer Big Data jobs in New York, NY
- Software Developer Big Data jobs in Brooklyn, NY
- Software Developer Big Data jobs in Queens, NY
- Software Developer Big Data jobs in Manhattan, NY
- Software Developer Big Data jobs in The Bronx, NY
- Software Developer Big Data jobs in Staten Island, NY
- Software Developer Big Data jobs in Buffalo, NY
- Software Developer Big Data jobs in Rochester, NY
- Software Developer Big Data jobs in Yonkers, NY
- Software Developer Big Data jobs in Syracuse, NY
- Software Developer Big Data jobs in Amherst, NY
- Software Developer Big Data jobs in Albany, NY
- Software Developer Big Data jobs in Greenburgh, NY
- Software Developer Big Data jobs in New Rochelle, NY
- Software Developer Big Data jobs in Cheektowaga, NY
- Software Developer Big Data jobs in Mount Vernon, NY
- Software Developer Big Data jobs in Schenectady, NY
- Software Developer Big Data jobs in Utica, NY
- Software Developer Big Data jobs in White Plains, NY
- Software Developer Big Data jobs in Clay, NY