161 hadoop engineer jobs at 56 companies in Bethpage, NY
3w
Save
Mark Applied
Hide
Hadoop PySpark Data Engineer
Charlotte or Jersey City or Newark or Plano
$82k-$127k/yr OnsiteFull Time
Experience with Hadoop ecosystem (Cloudera), PySpark, Spark, Hive, Python, Unix shell scripting, Autosys/Airflow, SQL; Bachelor\u0002s or equivalent experience; ability to work across SDLC and travel/relocate as needed.
Hadoop, Cloudera, PySpark, Spark, Hive, Python, Unix shell scripting, Autosys, Airflow, SQL, Tableau
2d
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano or Delaware or Florida or New Jersey or North Carolina or Texas or United States
$82k-$127k/yr OnsiteFull Time
Bachelor's degree or equivalent experience; Hadoop, Hive, Spark, PySpark, Python, Unix shell scripting, SQL, data warehousing, orchestration tools, Agile, and production Big Data experience required.
Hadoop, PySpark, Cloudera, Hive, Spark, Python, Unix, Autosys, Airflow, SQL, Agile, Tableau, AI, cloud, containerization
2w
Save
Mark Applied
Hide
Senior Data Platform Engineer
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yr RemoteFull Time
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Python, Golang, PostgreSQL (RDS), OpenSearch, Redshift, EMR, Spark, Docker, Lambda, AWS, EKS, SQS, SNS, S3, Kubernetes, Hadoop, Kafka, Microsoft Azure, GCP
2w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
6+ YOEExpertise in PySpark and Hadoop ecosystem, strong SQL, data modeling, shell/Autosys automation, 6+ years apps development/systems analysis experience, bachelor’s degree or equivalent.
PySpark, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, Autosys, Apache Kafka, Shell scripting
3w
Save
Mark Applied
Hide
AWS Data Engineer
New York, New York, United States
$100k-$115k/yr OnsiteFull Time
8+ YOEBachelor's degree,8+ years data engineering experience,strong AWS experience (S3,Glue,Redshift,RDS,Lambda,Kinesis),proficiency in SQL and Python/Scala/Java,knowledge of Spark/Hadoop,CI/CD and Git.
Amazon S3, AWS Glue, Amazon Redshift, RDS, AWS Lambda, Kinesis, SQL, Python, Scala, Java, Apache Spark, Hadoop, Git, Terraform, CloudFormation, Databricks, Apache Kafka, Power BI, Tableau
21h
Save
Mark Applied
Hide
Software Engineer, Backend Engineer- Credit Coverage
New York City, New York, United States
$157k-$235k/yr HybridFull Time
2+ YOEBachelor's degree in computer science, software engineering, or related field plus 2 years' software development experience. Requires Ruby, Java, Scala, SQL, AWS, gRPC, GraphQL, MongoDB, Spark, Hadoop, Kafka, Grafana, and Prometheus.
Ruby, Java, Scala, SQL, gRPC, GraphQL, AWS, MongoDB, Spark, Hadoop, Kafka, Grafana, Prometheus, macOS, Unix
1mo
Save
Mark Applied
Hide
Senior Compute Platform Engineer
Prague or Berlin or San Francisco or New York City
Kč70k-Kč85k/yr OnsiteFull Time
7+ YOE7+ years software engineering experience; strong Scala and Spark skills; experience with large-scale data-processing frameworks, Hadoop, Airflow, and AWS; mentoring and improving platform reliability.
Scala, Spark, Iceberg, Hadoop, Airflow, Kubernetes, Amazon Web Services (EC2, S3, Athena), JVM
1mo
Save
Mark Applied
Hide
Data Scientist & Engineer
New York, New York, United States
$85k-$110k/yr OnsiteFull Time
3+ YOEMaster's in a quantitative field and 3 years' data science/machine learning experience; proficiency in Python or R, scikitlearn, big data tools (Hadoop/Spark), SQL and NoSQL; strong software engineering, deployment, and communication skills.
Python, R, scikitlearn, Hadoop, MapReduce, Spark, SQL, MongoDB
1mo
Save
Mark Applied
Hide
AML Surveillance Tools Engineer/Developer
New York City, New York, United States
$105k-$155k/yr HybridFull Time
3+ YOE3+ years experience; strong Java, some Python; data engineering, ETL, Apache Spark, Databricks/Hadoop; experience with large datasets, messaging (Solace, Kafka), system integration; familiarity with AML, trade/payments surveillance and capital markets.
Java, Python, Apache Spark, Databricks, Hadoop, Solace, Kafka, NICE Actimize, SMART, Trading Hub
3w
Save
Mark Applied
Hide
Principal Engineer - Channels Data Platforms and Analytics
Addison or Jersey City or Charlotte
$157k-$230k/yr OnsiteFull Time
12+ YOE12+ years data/software engineering with 8+ years designing enterprise data platforms; cloud modernization experience (Microsoft Azure, Databricks, Snowflake); strong SQL and Python; legacy modernization and NFR-driven design expertise.
Microsoft Azure, ADLS Gen2, Event Hubs, Key Vault, Databricks, Delta, Snowflake, Informatica, Hadoop, Kafka, Mainframe, Oracle, Postgres, Python, SQL, Java, Scala, Git, Microsoft Azure DevOps, Jenkins, Docker, Kubernetes, OpenShift, Collibra, AppDynamics, Splunk, Grafana, Terraform, Bicep, dbt, LookML, Great Expectations, Deequ, Purview, Starburst, Spark
2mo
Save
Mark Applied
Hide
Senior Engineer, Ceph
Austin or Toronto or New York City or Montreal or Kitchener or London or San Francisco
RemoteFull Time
Experience building, maintaining, and troubleshooting Ceph and Rook at scale; IaC and config management (Salt, Ansible, Puppet, Terraform); storage replication, capacity planning, disaster recovery, monitoring, automation and CI/CD; strong cross-team communication and mentoring skills.
Ceph, Rook, Hadoop, Spark, Aerospike, Kafka, Salt, Ansible, Puppet, Terraform, IaC, CI/CD
3w
Save
Mark Applied
Hide
Principal Engineer - Channels Data Platforms and Analytics
Jersey City or Charlotte or Addison
OnsiteFull Time
12+ YOE12+ years data/software engineering with 8+ years designing enterprise data platforms; cloud modernization experience (Azure, Databricks, Snowflake, Kafka); legacy modernization (Informatica, Hadoop, mainframe); strong SQL and Python skills; leadership and communication in regulated environments.
Azure, ADLS Gen2, Event Hubs, Key Vault, Databricks, Delta, Snowflake, Informatica, Kafka, Mainframe, Oracle, Postgres, Python, SQL, Java, Scala, Spark, Git, Azure DevOps, Jenkins, Docker, Kubernetes, OpenShift, Collibra, AppDynamics, Splunk, Grafana, Terraform, Bicep, dbt, LookML, Great Expectations, Deequ, Purview, Starburst
3w
Save
Mark Applied
Hide
Java Developer
Jersey City, New Jersey, United States
$100k-$120k/yr OnsiteFull Time
6+ YOEProficient in Java/J2EE, Spring/Spring Boot, Kafka, application servers (Tomcat/WebSphere/WebLogic), Linux; Hadoop/Spark a plus. Bachelor of Computer Science required. 6+ years experience.
Java, J2EE, Spring, Spring Boot, Kafka, Tomcat, WebSphere, WebLogic, Linux, Hadoop, Spark
2d
Save
Mark Applied
Hide
Senior Machine Learning Engineer, TikTok BRIC Community Health
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$162k-$388k/yr OnsiteFull Time
2+ YOEMaster's degree or above in a relevant technical field and 2+ years of machine learning experience. Requires strong software engineering, machine learning, Python or Java/C++/Go, and Spark, Hadoop, or Hive experience.
Python, Java, C++, Go, Spark, Hadoop, Hive, LLMs
2mo
Save
Mark Applied
Hide
Software Development Engineer
New York, New York, United States
$149k-$215k/yr OnsiteFull Time
Backend and data applications development; Java/Scala; RESTful APIs; SQL and NoSQL databases; distributed systems (Spark, Kafka, Hadoop); cloud (AWS/Azure); CS degree or equivalent experience; strong communication and documentation.
Java, Scala, RESTful APIs, SQL, NoSQL, Apache Spark, Kafka, Hadoop, AWS, Azure
2w
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$175k-$270k/yr HybridFull Time
8+ YOE8+ years building large-scale data platforms, distributed systems, cloud-native data pipelines, EM/ML operationalization, and data warehouse/Big Data solutions; Bachelor's in CS or related.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, Aerospike, Elastic Search, IBM Infosphere, Oracle, SQL Server, AppDynamics, Kubernetes
1mo
Save
Mark Applied
Hide
Senior Lead Data Engineer
Richmond or McLean or Chicago or New York City or Plano
$209k-$239k/yr OnsiteFull Time
6+ YOEBachelor's degree, 6+ years application development, 2+ years big data, 1+ year cloud (AWS/Azure/GCP), experience with Java/Scala/Python, SQL, Redshift/Snowflake, distributed data tools, UNIX/Linux, Agile, and team leadership.
Java, Scala, Python, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, SQL, AWS, Microsoft Azure, Google Cloud, Agile
4d
Save
Mark Applied
Hide
Senior Software Engineer, Distributed Data Systems
New York City, New York, United States
$200k-$350k/yr OnsiteFull Time
4+ YOERequires 4+ years building data infrastructure, OLAP lakehouse architecture, query and join optimization, Haskell or TypeScript, Spark or Hadoop, distributed systems, databases, algorithms, and zero-to-one product delivery.
Haskell, TypeScript, Apache Spark, Hadoop
1w
Save
Mark Applied
Hide
Lead Big Data Engineer - VP
Whippany, New Jersey, United States
$170k-$230k/yr OnsiteFull Time
Expertise in Java, Scala, Apache Spark, Amazon S3, Hadoop, cloud big data platforms, Python, .NET, Unix/Linux shell scripting, distributed architectures, ETL/ELT, and regulated financial services.
Java, Scala, Apache Spark, Amazon S3, Hadoop, Python, .NET, Unix/Linux shell scripting, Agile
1mo
Save
Mark Applied
Hide
Backend Software Engineer - Platforms
New York, New York, United States
OnsiteFull Time
3+ YOEBS in CS or equivalent, experience with web apps, Unix/Linux, distributed systems, networking, and large systems; DICM/ITOM/ITSM experience required; GPU or big data (Hadoop/Kafka/Apache) experience valuable; Golang or Python development experience and production troubleshooting skills.
Golang, Python, Unix/Linux, Hadoop, Kafka, Apache, GPU, Discovery, Insights, and Configuration Management (DICM), IT Operation Management (ITOM), IT Service Management (ITSM)
Explore Jobs