HiringCafe
Join our community

156 hadoop developer jobs at 48 companies in New York

2mo
Save
Mark Applied
Hide
Software Development Engineer
New York, New York, United States
$149k-$215k/yr OnsiteFull Time
Adobe
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
Backend and data applications development; Java/Scala; RESTful APIs; SQL and NoSQL databases; distributed systems (Spark, Kafka, Hadoop); cloud (AWS/Azure); CS degree or equivalent experience; strong communication and documentation.
Java, Scala, RESTful APIs, SQL, NoSQL, Apache Spark, Kafka, Hadoop, AWS, Azure
Job PostingView all
3w
Save
Mark Applied
Hide
Spark Engineer
Jersey City or New York City
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Spark/Hadoop ecosystem, Kafka, HBase/Hive/Impala, Python/SQL/PySpark/Shell; bachelor's degree or equivalent experience; ability to work full SDLC; US work authorization required.
Spark, Hadoop, HDFS, YARN, Confluent Kafka, HBase, Hive, Impala, NoSQL, PySpark, SQL, Python, Shell
Job PostingView all
2mo
Save
Mark Applied
Hide
Software Development Engineer, Data Platform, Prime Video Personalization & Discovery
New York or Sunnyvale or Seattle
OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOE3+ years professional software development; design/architecture experience; large-scale distributed systems; Java/C#/C++/Python; big data with AWS/Hadoop/Spark; BS in CS preferred.
Java, C++, C#, Python, AWS, Hadoop, Spark, Pig, Hive, Lucene/SOLR, Storm/Samza, Git, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
AML Surveillance Tools Engineer/Developer
New York City, New York, United States
$105k-$155k/yr HybridFull Time
TD Bank
TD BankToronto Stock Exchange: TD: Provide retail, commercial, and wholesale banking and financial services.
3+ YOE3+ years experience; strong Java, some Python; data engineering, ETL, Apache Spark, Databricks/Hadoop; experience with large datasets, messaging (Solace, Kafka), system integration; familiarity with AML, trade/payments surveillance and capital markets.
Java, Python, Apache Spark, Databricks, Hadoop, Solace, Kafka, NICE Actimize, SMART, Trading Hub
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Compute Platform Engineer
Prague or Berlin or San Francisco or New York City
Kč70k-Kč85k/yr OnsiteFull Time
Zeta Global
Zeta GlobalNYSE: ZETA: Provides an AI-powered marketing platform for enterprise customer engagement.
7+ YOE7+ years software engineering experience; strong Scala and Spark skills; experience with large-scale data-processing frameworks, Hadoop, Airflow, and AWS; mentoring and improving platform reliability.
Scala, Spark, Iceberg, Hadoop, Airflow, Kubernetes, Amazon Web Services (EC2, S3, Athena), JVM
Job PostingView all
3d
Save
Mark Applied
Hide
Senior Software Engineer, Distributed Data Systems
New York City, New York, United States
$200k-$350k/yr OnsiteFull Time
Clera
Clera: AI talent agent matching professionals with high-growth startup roles
4+ YOERequires 4+ years building data infrastructure, OLAP lakehouse architecture, query and join optimization, Haskell or TypeScript, Spark or Hadoop, distributed systems, databases, algorithms, and zero-to-one product delivery.
Haskell, TypeScript, Apache Spark, Hadoop
Job PostingView all
1mo
Save
Mark Applied
Hide
Backend Software Engineer - Platforms
New York, New York, United States
OnsiteFull Time
ByteDance
ByteDance: Developing AI-driven content platforms and mobile applications.
3+ YOEBS in CS or equivalent, experience with web apps, Unix/Linux, distributed systems, networking, and large systems; DICM/ITOM/ITSM experience required; GPU or big data (Hadoop/Kafka/Apache) experience valuable; Golang or Python development experience and production troubleshooting skills.
Golang, Python, Unix/Linux, Hadoop, Kafka, Apache, GPU, Discovery, Insights, and Configuration Management (DICM), IT Operation Management (ITOM), IT Service Management (ITSM)
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Software Engineer - Big Data
Rockville or Washington or Tysons or Colorado or Florida or Texas or Illinois or Pennsylvania or Massachusetts or Maryland or Virginia or New York or New Jersey
$114k-$249k/yr HybridFull Time
FINRA
FINRA: Regulates brokerage firms and exchange markets in the United States.
7+ YOEBachelor's in CS or related + 7+ years experience; deep Big Data (Hadoop, Spark, Hive, Trino), SQL, AWS (S3, EMR, Glue, Lambda, Athena, EKS), Python/Scala, system design, CI/CD, DevOps, security, and team mentoring experience.
Hadoop, Spark, Hive, Trino, SQL, S3, EMR, Glue, Lambda, Athena, EKS, Python, Scala, GitHub Copilot, Q Developer, ChatGPT, Claude, Scrum, Kanban, CI/CD, DevOps
Job PostingView all
23h
Save
Mark Applied
Hide
Senior Machine Learning Engineer, TikTok BRIC Community Health
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$162k-$388k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
2+ YOEMaster's degree or above in a relevant technical field and 2+ years of machine learning experience. Requires strong software engineering, machine learning, Python or Java/C++/Go, and Spark, Hadoop, or Hive experience.
Python, Java, C++, Go, Spark, Hadoop, Hive, LLMs
Job PostingView all
2w
Save
Mark Applied
Hide
Solutions Engineer - East Coast
Georgia or Massachusetts or New Jersey or Connecticut or Pennsylvania or New York
$150k-$180k/yr RemoteFull Time
Cloudera
Cloudera: Provides hybrid data platforms for enterprise analytics and AI.
5+ YOE5+ years pre-sales experience, technical discovery, solution design, demos/POCs; experience with public cloud, Hadoop ecosystem, SQL, streaming, and basic software development; Bachelor’s degree or equivalent.
AWS, Azure, GCP, IBM Cloud, Apache Spark, Iceberg, NiFi, Kafka, Flink, Apache Hadoop, HDFS, YARN, Hive, Impala, Kudu, Solr, Java, Scala, Python, Kubernetes, OpenShift, Teradata, Netezza, GreenPlum, Exadata, HBase, Phoenix, Accumlo, Druid, Cassandra, MongoDB, Talend, DataStage, Informatica BDM, Qlik, Tableau, Zoomdata, Tibco, MuleSoft, IBM, Oracle, Spring Integration, R, Anaconda, Jupyter
Job PostingView all
1w
Save
Mark Applied
Hide
MuleSoft Developer- Enterprise
Atlanta or Austin or Boston or Charlotte or Chicago or Columbus or Dallas or Denver or Detroit or Grand Rapids or Houston or Kansas City or Miami or Minneapolis or Nashville or New Brunswick or New York City or Orange County or Philadelphia or Phoenix or Portland or Raleigh or San Diego or San Francisco or Seattle or Tampa or Washington
$106k-$154k/yr OnsiteFull Time
Slalom
Slalom: A global business and technology consulting firm.
Develop MuleSoft API-led integrations; requires programming, enterprise applications, web services, databases, cloud, microservices, data architecture, testing, and agile delivery knowledge.
MuleSoft, Java, C#, Python, JavaScript, NetSuite, SAP, Oracle ERP, Salesforce, Dynamics AX, Dynamics CRM, Workday, WS*, JSON, REST, GraphQL, Microsoft SQL Server, MySQL, PostgreSQL, MongoDB, Hadoop, Scrum
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff, Software Engineer
Sunnyvale or Bentonville or New York
$143k-$286k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Operates a chain of hypermarkets, discount stores, and grocery stores.
6+ YOERequires 6 years of software engineering experience or a bachelor's degree and 4 years' experience. Requires Java, distributed systems, Spring, search engines, scripting, and software development tools.
Java, JEE, Python, Perl, Shell, Spring, Solr, Lucene, Elasticsearch, Eclipse, Jenkins, Hudson, Maven, Sonar, Gerrit, PMD, FindBugs, Checkstyle, Emma, Cobertura, JIRA, GitHub, SVN, CVS, ClearCase, Apache, JBoss, Tomcat, Jetty, JMS, WebLogic, Hive, Hadoop, Spark, WCAG 2.2 AA
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior AI Cloud Developer
New York City or Los Angeles or Washington
$110k-$164k/yr HybridFull Time
Protiviti
ProtivitiNew York Stock Exchange: RHI: Global consulting firm providing risk, advisory, and technology services.
2+ YOE2+ years designing and deploying analytics or ML projects,1+ year hands-on generative AI experience,Bachelor's in a relevant field,proficiency in cloud and AI development,security and responsible AI practices.
AWS, Microsoft Azure, Google Cloud, Python, R, SQL, TensorFlow, PyTorch, Scikit-learn, Langchain, Hadoop, Spark
Job PostingView all
3mo
Save
Mark Applied
Hide
Lead Software Engineer - Middleware
New York, New York, United States
$152k-$215k/yr OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years middleware software development; design, development, testing, and operational stability; strong programming language; CI/CD; SDLC; agile; cloud/AI/ML focus; AWS with Terraform.
Java, Spring, Kafka, Cassandra, Spark, Hadoop, Oracle, SQL Server, WebSphere MQ, JMS, RabbitMQ, JUnit, Mockito, Cucumber, Gherkin, Git, AWS, Terraform
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Data Engineer (Bank Tech)
New York City or Wilmington
$179k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
4+ YOEBachelor's degree; 4+ years application development, 2+ years big data, and 1+ year cloud computing experience. Preferred: 7+ years development and expertise in cloud, distributed data, streaming, NoSQL, warehousing, UNIX/Linux, and Agile.
Java, Scala, Python, RDBMS, NoSQL, Redshift, Snowflake, SQL, AWS, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, Agile
Job PostingView all
1d
Save
Mark Applied
Hide
Lead Data Engineer
New York City or McLean or Richmond
$179k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
4+ YOEBachelor's degree; 4+ years application development, 2+ years big data, and 1+ year cloud computing experience. Preferred: Python, SQL, Scala, Java, distributed data, streaming, NoSQL, warehousing, Linux, and Agile.
Java, Scala, Python, SQL, Redshift, Snowflake, AWS, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, shell scripting, Agile
Job PostingView all
1d
Save
Mark Applied
Hide
Lead Data Engineer
New York City or McLean or Richmond or United States
$215k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience. Preferred experience includes Python, SQL, Scala, Java, distributed systems, streaming, NoSQL, and data warehousing.
Java, Scala, Python, SQL, Redshift, Snowflake, AWS, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, Agile
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. Backend Engineer - Activations
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr HybridFull Time
LiveRamp
LiveRampNew York Stock Exchange: RAMP: Provides a platform for secure data collaboration and identity.
5+ YOE5+ years writing production code; strong Java/Scala/Golang skills; 3+ years with Big Data ecosystems (Spark, Hadoop/MR, Kafka); distributed systems and RESTful API experience; Spring Boot; cloud experience (GCP/AWS/Azure).
Java, Scala, Golang, Spark, Hadoop/MR, Kafka, RESTful APIs, OAuth, GCP, AWS, Azure, Spring Boot, Singlestore
Job PostingView all
3w
Save
Mark Applied
Hide
AWS Data Engineer
New York, New York, United States
$100k-$115k/yr OnsiteFull Time
Capgemini
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
8+ YOEBachelor's degree,8+ years data engineering experience,strong AWS experience (S3,Glue,Redshift,RDS,Lambda,Kinesis),proficiency in SQL and Python/Scala/Java,knowledge of Spark/Hadoop,CI/CD and Git.
Amazon S3, AWS Glue, Amazon Redshift, RDS, AWS Lambda, Kinesis, SQL, Python, Scala, Java, Apache Spark, Hadoop, Git, Terraform, CloudFormation, Databricks, Apache Kafka, Power BI, Tableau
Job PostingView all
1w
Save
Mark Applied
Hide
Lead AI / ML Engineer
New York City or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$294k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
6+ YOEBachelor's degree or equivalent experience, 6+ years developing and deploying AI/ML solutions, programming proficiency, experience with ML frameworks, big data, databases, and cloud platforms.
Python, R, Java, TensorFlow, PyTorch, Hadoop, Spark, AWS, Microsoft Azure, Google Cloud, D3.js, ggplot
Job PostingView all

Explore Jobs

Expand Your Job Search