209 hadoop developer jobs at 45 companies in Deer Park, NY

1mo
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Hadoop, PySpark, Hive, Spark, Python, SQL, Autosys/Airflow, Unix shell; bachelor\u0002s degree or equivalent; strong communication and SDLC experience required.
Hadoop, PySpark, Hive, Spark, Python, SQL, Unix Shell, Autosys, Airflow, Cloudera, Tableau
1w
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano or Delaware or Florida or New Jersey or North Carolina or Texas or United States
$82k-$127k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Global provider of digital services, consulting, and technology solutions.
Bachelor's degree or equivalent experience; Hadoop, Hive, Spark, PySpark, Python, Unix shell scripting, SQL, data warehousing, orchestration tools, Agile, and production Big Data experience required.
Hadoop, PySpark, Cloudera, Hive, Spark, Python, Unix, Autosys, Airflow, SQL, Agile, Tableau, AI, cloud, containerization
2mo
Save
Mark Applied
Hide
Software Development Engineer
New York, New York, United States
$149k-$215k/yr OnsiteFull Time
Adobe
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
Backend and data applications development; Java/Scala; RESTful APIs; SQL and NoSQL databases; distributed systems (Spark, Kafka, Hadoop); cloud (AWS/Azure); CS degree or equivalent experience; strong communication and documentation.
Java, Scala, RESTful APIs, SQL, NoSQL, Apache Spark, Kafka, Hadoop, AWS, Azure
1w
Save
Mark Applied
Hide
Software Engineer, Backend Engineer- Credit Coverage
New York City, New York, United States
$157k-$235k/yr HybridFull Time
Stripe
Stripe: Provides online payment processing and financial infrastructure for businesses.
2+ YOEBachelor's degree in computer science, software engineering, or related field plus 2 years' software development experience. Requires Ruby, Java, Scala, SQL, AWS, gRPC, GraphQL, MongoDB, Spark, Hadoop, Kafka, Grafana, and Prometheus.
Ruby, Java, Scala, SQL, gRPC, GraphQL, AWS, MongoDB, Spark, Hadoop, Kafka, Grafana, Prometheus, macOS, Unix
1w
Save
Mark Applied
Hide
Big Data Developer
Jersey City, New Jersey, United States
$80k-$95k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOERequires a bachelor's degree in computer science and 6–8 years of experience with Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk, Autosys, Linux, and Cloudera Big Data.
Kafka, Apache Spark, Scala, SQL, Apache Hive, Impala, Apache Hadoop, Splunk, Autosys, Cloudera, Linux
2mo
Save
Mark Applied
Hide
Software Development Engineer, Data Platform, Prime Video Personalization & Discovery
New York or Sunnyvale or Seattle
OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOE3+ years professional software development; design/architecture experience; large-scale distributed systems; Java/C#/C++/Python; big data with AWS/Hadoop/Spark; BS in CS preferred.
Java, C++, C#, Python, AWS, Hadoop, Spark, Pig, Hive, Lucene/SOLR, Storm/Samza, Git, CI/CD
3w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Global diversified financial services holding.
6+ YOEExpertise in PySpark and Hadoop ecosystem, complex SQL, data modeling, Autosys and shell scripting; 6+ years apps development or systems analysis experience; bachelor’s degree preferred.
PySpark, Hadoop, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, Autosys, Apache Kafka, Shell scripting
3w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: A global financial services providing banking and credit services.
6+ YOERequires 6–10 years of applications development or systems analysis experience, PySpark and Hadoop expertise, complex SQL, distributed systems, data modeling, shell scripting, Autosys, and a bachelor's degree or equivalent.
PySpark, Hadoop, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, shell scripting, Autosys, Apache Kafka
2mo
Save
Mark Applied
Hide
Senior Compute Platform Engineer
Prague or Berlin or San Francisco or New York City
Kč70k-Kč85k/yr OnsiteFull Time
Zeta Global
Zeta GlobalNYSE: ZETA: Provides an AI-powered marketing platform for enterprise customer engagement.
7+ YOE7+ years software engineering experience; strong Scala and Spark skills; experience with large-scale data-processing frameworks, Hadoop, Airflow, and AWS; mentoring and improving platform reliability.
Scala, Spark, Iceberg, Hadoop, Airflow, Kubernetes, Amazon Web Services (EC2, S3, Athena), JVM
1mo
Save
Mark Applied
Hide
Backend Software Engineer - Platforms
New York, New York, United States
OnsiteFull Time
ByteDance
ByteDance: Developing AI-driven content platforms and mobile applications.
3+ YOEBS in CS or equivalent, experience with web apps, Unix/Linux, distributed systems, networking, and large systems; DICM/ITOM/ITSM experience required; GPU or big data (Hadoop/Kafka/Apache) experience valuable; Golang or Python development experience and production troubleshooting skills.
Golang, Python, Unix/Linux, Hadoop, Kafka, Apache, GPU, Discovery, Insights, and Configuration Management (DICM), IT Operation Management (ITOM), IT Service Management (ITSM)
1w
Save
Mark Applied
Hide
Senior Machine Learning Engineer, TikTok BRIC Community Health
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$162k-$388k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
2+ YOEMaster's degree or above in a relevant technical field and 2+ years of machine learning experience. Requires strong software engineering, machine learning, Python or Java/C++/Go, and Spark, Hadoop, or Hive experience.
Python, Java, C++, Go, Spark, Hadoop, Hive, LLMs
3mo
Save
Mark Applied
Hide
Lead Software Engineer - Middleware
New York, New York, United States
$152k-$215k/yr OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years middleware software development; design, development, testing, and operational stability; strong programming language; CI/CD; SDLC; agile; cloud/AI/ML focus; AWS with Terraform.
Java, Spring, Kafka, Cassandra, Spark, Hadoop, Oracle, SQL Server, WebSphere MQ, JMS, RabbitMQ, JUnit, Mockito, Cucumber, Gherkin, Git, AWS, Terraform
2mo
Save
Mark Applied
Hide
Lead Data Engineer (Bank Tech)
New York City or Wilmington
$179k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
4+ YOEBachelor's degree; 4+ years application development, 2+ years big data, and 1+ year cloud computing experience. Preferred: 7+ years development and expertise in cloud, distributed data, streaming, NoSQL, warehousing, UNIX/Linux, and Agile.
Java, Scala, Python, RDBMS, NoSQL, Redshift, Snowflake, SQL, AWS, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, Agile
1w
Save
Mark Applied
Hide
Lead Data Engineer
New York City or McLean or Richmond
$179k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
4+ YOEBachelor's degree; 4+ years application development, 2+ years big data, and 1+ year cloud computing experience. Preferred: Python, SQL, Scala, Java, distributed data, streaming, NoSQL, warehousing, Linux, and Agile.
Java, Scala, Python, SQL, Redshift, Snowflake, AWS, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, shell scripting, Agile
3w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Providing global banking, investment, and wealth management services.
6+ YOEExpertise in PySpark and Hadoop ecosystem, strong SQL, data modeling, shell/Autosys automation, 6+ years apps development/systems analysis experience, bachelor’s degree or equivalent.
PySpark, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, Autosys, Apache Kafka, Shell scripting
1w
Save
Mark Applied
Hide
Lead Data Engineer
New York City or McLean or Richmond or United States
$215k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience. Preferred experience includes Python, SQL, Scala, Java, distributed systems, streaming, NoSQL, and data warehousing.
Java, Scala, Python, SQL, Redshift, Snowflake, AWS, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, Agile
1mo
Save
Mark Applied
Hide
AWS Data Engineer
New York, New York, United States
$100k-$115k/yr OnsiteFull Time
Capgemini
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
8+ YOEBachelor's degree,8+ years data engineering experience,strong AWS experience (S3,Glue,Redshift,RDS,Lambda,Kinesis),proficiency in SQL and Python/Scala/Java,knowledge of Spark/Hadoop,CI/CD and Git.
Amazon S3, AWS Glue, Amazon Redshift, RDS, AWS Lambda, Kinesis, SQL, Python, Scala, Java, Apache Spark, Hadoop, Git, Terraform, CloudFormation, Databricks, Apache Kafka, Power BI, Tableau
2w
Save
Mark Applied
Hide
Lead AI / ML Engineer
New York City or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$294k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
6+ YOEBachelor's degree or equivalent experience, 6+ years developing and deploying AI/ML solutions, programming proficiency, experience with ML frameworks, big data, databases, and cloud platforms.
Python, R, Java, TensorFlow, PyTorch, Hadoop, Spark, AWS, Microsoft Azure, Google Cloud, D3.js, ggplot
2w
Save
Mark Applied
Hide
Lead AI / ML Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$294k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
6+ YOERequires 6+ years developing AI/ML solutions, programming in Python, R, or Java, machine learning frameworks, data analysis, cloud platforms, and strong communication skills.
Python, R, Java, TensorFlow, PyTorch, Hadoop, Spark, AWS, Azure, Google Cloud, D3.js, ggplot
1mo
Save
Mark Applied
Hide
Senior Big Data Engineer
New York City, New York, United States
$170k-$180k/yr HybridFull Time
Magnite
MagniteNASDAQ: MGNI: Independent sell-side platform for digital media advertising.
4+ YOE4+ years supporting large-scale Linux and distributed big data platforms (Kafka, Hadoop/MapR, Aerospike). Strong Linux administration, networking, scripting, monitoring, and production troubleshooting skills.
Apache Kafka, Hadoop, MapR, Aerospike, Spark, Rocky Linux, RHEL, CentOS, PostgreSQL, MySQL, ScyllaDB, Bash, Python, Terraform, Spacelift, Puppet, Ansible, Grafana, Prometheus, Graphite, Kubernetes, Ceph, AWS