179 hadoop engineer jobs at 51 companies in Bohemia, NY

1mo
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Global leader in next-generation digital services and consulting.
Experience with Hadoop, PySpark, Hive, Spark, Python, SQL, Autosys/Airflow, Unix shell; bachelor\u0002s degree or equivalent; strong communication and SDLC experience required.
Hadoop, PySpark, Hive, Spark, Python, SQL, Unix Shell, Autosys, Airflow, Cloudera, Tableau
2w
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano or Delaware or Florida or New Jersey or North Carolina or Texas or United States
$82k-$127k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Global leader in next-generation digital services and consulting.
Bachelor's degree or equivalent experience; Hadoop, Hive, Spark, PySpark, Python, Unix shell scripting, SQL, data warehousing, orchestration tools, Agile, and production Big Data experience required.
Hadoop, PySpark, Cloudera, Hive, Spark, Python, Unix, Autosys, Airflow, SQL, Agile, Tableau, AI, cloud, containerization
1mo
Save
Mark Applied
Hide
Senior Data Platform Engineer
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yr RemoteFull Time
SentiLink
SentiLink: Your fraud and risk partner
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Python, Golang, PostgreSQL (RDS), OpenSearch, Redshift, EMR, Spark, Docker, Lambda, AWS, EKS, SQS, SNS, S3, Kubernetes, Hadoop, Kafka, Microsoft Azure, GCP
1mo
Save
Mark Applied
Hide
Senior Big Data Engineer
New York City, New York, United States
$170k-$180k/yr HybridFull Time
Magnite
MagniteNasdaq Global Select Market: MGNI: Public sell-side advertising technology helping publishers monetize CTV, video, display, and audio inventory.
4+ YOE4+ years supporting large-scale Linux and distributed big data platforms (Kafka, Hadoop/MapR, Aerospike). Strong Linux administration, networking, scripting, monitoring, and production troubleshooting skills.
Apache Kafka, Hadoop, MapR, Aerospike, Spark, Rocky Linux, RHEL, CentOS, PostgreSQL, MySQL, ScyllaDB, Bash, Python, Terraform, Spacelift, Puppet, Ansible, Grafana, Prometheus, Graphite, Kubernetes, Ceph, AWS
1mo
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Global financial services organization enabling growth and economic progress.
6+ YOEExpertise in PySpark and Hadoop ecosystem, strong SQL, data modeling, shell/Autosys automation, 6+ years apps development/systems analysis experience, bachelor’s degree or equivalent.
PySpark, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, Autosys, Apache Kafka, Shell scripting
1mo
Save
Mark Applied
Hide
AWS Data Engineer
New York, New York, United States
$100k-$115k/yr OnsiteFull Time
Capgemini
CapgeminiEuronext Paris: CAP: Global leader in consulting, digital transformation, and engineering services.
8+ YOEBachelor's degree,8+ years data engineering experience,strong AWS experience (S3,Glue,Redshift,RDS,Lambda,Kinesis),proficiency in SQL and Python/Scala/Java,knowledge of Spark/Hadoop,CI/CD and Git.
Amazon S3, AWS Glue, Amazon Redshift, RDS, AWS Lambda, Kinesis, SQL, Python, Scala, Java, Apache Spark, Hadoop, Git, Terraform, CloudFormation, Databricks, Apache Kafka, Power BI, Tableau
2w
Save
Mark Applied
Hide
Software Engineer, Backend Engineer- Credit Coverage
New York City, New York, United States
$157k-$235k/yr HybridFull Time
Stripe
Stripe: Financial infrastructure platform for online businesses and enterprises.
2+ YOEBachelor's degree in computer science, software engineering, or related field plus 2 years' software development experience. Requires Ruby, Java, Scala, SQL, AWS, gRPC, GraphQL, MongoDB, Spark, Hadoop, Kafka, Grafana, and Prometheus.
Ruby, Java, Scala, SQL, gRPC, GraphQL, AWS, MongoDB, Spark, Hadoop, Kafka, Grafana, Prometheus, macOS, Unix
2mo
Save
Mark Applied
Hide
Senior Compute Platform Engineer
Prague or Berlin or San Francisco or New York City
Kč70k-Kč85k/yr OnsiteFull Time
Zeta Global
Zeta GlobalNYSE: ZETA: AI-powered marketing cloud for consumer intelligence and automation.
7+ YOE7+ years software engineering experience; strong Scala and Spark skills; experience with large-scale data-processing frameworks, Hadoop, Airflow, and AWS; mentoring and improving platform reliability.
Scala, Spark, Iceberg, Hadoop, Airflow, Kubernetes, Amazon Web Services (EC2, S3, Athena), JVM
3d
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Scottsdale or San Francisco or Chicago or New York City or Phoenix or California
$124k-$223k/yr HybridFull Time
Early Warning Services
Early Warning Services: U.S. bank-owned fintech and consumer reporting agency providing identity, fraud-risk, and real-time payment solutions to financial institutions.
8+ YOEBachelor's degree or equivalent experience, 8+ years relevant experience, and extensive data engineering expertise across scalable platforms, distributed systems, cloud, AI/ML, data warehouses, and real-time processing.
SQL Server, HDFS, Elastic Search, IBM Infosphere, Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, CI/CD, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Oracle, Aerospike, Scality S3, AppDynamics, Kubernetes, HBase, Hive, Solr, Scala, Databricks, Snowflake
1mo
Save
Mark Applied
Hide
Lead Data Engineer – Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Global financial services organization enabling growth and economic progress.
6+ YOE3+ MgmtBachelor's degree or equivalent experience; 6+ years in data or software engineering, including 3+ years in technical leadership; expert Python and SQL; distributed systems, streaming, ML infrastructure, and cloud data platforms.
Python, SQL, Apache Iceberg, Starburst, StarTree, Apache Pinot, Apache Kafka, Apache Flink, Delta Lake, Databricks, Apache Hudi, Apache Airflow, Java, Milvus, Pinecone, Qdrant, Chroma, Docker, Kubernetes, Terraform, Hive, HDFS
1mo
Save
Mark Applied
Hide
Principal Engineer - Channels Data Platforms and Analytics
Addison or Jersey City or Charlotte
$157k-$230k/yr OnsiteFull Time
Bank of America
Bank of AmericaNYSE: BAC: Global financial services and banking institution.
12+ YOE12+ years data/software engineering with 8+ years designing enterprise data platforms; cloud modernization experience (Microsoft Azure, Databricks, Snowflake); strong SQL and Python; legacy modernization and NFR-driven design expertise.
Microsoft Azure, ADLS Gen2, Event Hubs, Key Vault, Databricks, Delta, Snowflake, Informatica, Hadoop, Kafka, Mainframe, Oracle, Postgres, Python, SQL, Java, Scala, Git, Microsoft Azure DevOps, Jenkins, Docker, Kubernetes, OpenShift, Collibra, AppDynamics, Splunk, Grafana, Terraform, Bicep, dbt, LookML, Great Expectations, Deequ, Purview, Starburst, Spark
2mo
Save
Mark Applied
Hide
Senior Engineer, Ceph
Austin or Toronto or New York City or Montreal or Kitchener or London or San Francisco
RemoteFull Time
Index Exchange
Index Exchange: Independent ad-tech supply-side platform helping media owners monetize digital content and enabling brands to buy programmatic advertising.
Experience building, maintaining, and troubleshooting Ceph and Rook at scale; IaC and config management (Salt, Ansible, Puppet, Terraform); storage replication, capacity planning, disaster recovery, monitoring, automation and CI/CD; strong cross-team communication and mentoring skills.
Ceph, Rook, Hadoop, Spark, Aerospike, Kafka, Salt, Ansible, Puppet, Terraform, IaC, CI/CD
1mo
Save
Mark Applied
Hide
Principal Engineer - Channels Data Platforms and Analytics
Jersey City or Charlotte or Addison
OnsiteFull Time
Bank of America
Bank of AmericaNYSE: BAC: Global financial services and banking institution.
12+ YOE12+ years data/software engineering with 8+ years designing enterprise data platforms; cloud modernization experience (Azure, Databricks, Snowflake, Kafka); legacy modernization (Informatica, Hadoop, mainframe); strong SQL and Python skills; leadership and communication in regulated environments.
Azure, ADLS Gen2, Event Hubs, Key Vault, Databricks, Delta, Snowflake, Informatica, Kafka, Mainframe, Oracle, Postgres, Python, SQL, Java, Scala, Spark, Git, Azure DevOps, Jenkins, Docker, Kubernetes, OpenShift, Collibra, AppDynamics, Splunk, Grafana, Terraform, Bicep, dbt, LookML, Great Expectations, Deequ, Purview, Starburst
1mo
Save
Mark Applied
Hide
Java Developer
Jersey City, New Jersey, United States
$100k-$120k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesBSE: 532540: Global leader in IT services, consulting, and business solutions.
6+ YOEProficient in Java/J2EE, Spring/Spring Boot, Kafka, application servers (Tomcat/WebSphere/WebLogic), Linux; Hadoop/Spark a plus. Bachelor of Computer Science required. 6+ years experience.
Java, J2EE, Spring, Spring Boot, Kafka, Tomcat, WebSphere, WebLogic, Linux, Hadoop, Spark
2w
Save
Mark Applied
Hide
Senior Machine Learning Engineer, TikTok BRIC Community Health
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$162k-$388k/yr OnsiteFull Time
TikTok
TikTok: Short-form mobile video and social media platform.
2+ YOEMaster's degree or above in a relevant technical field and 2+ years of machine learning experience. Requires strong software engineering, machine learning, Python or Java/C++/Go, and Spark, Hadoop, or Hive experience.
Python, Java, C++, Go, Spark, Hadoop, Hive, LLMs
2mo
Save
Mark Applied
Hide
Software Development Engineer
New York, New York, United States
$149k-$215k/yr OnsiteFull Time
Adobe
AdobeNASDAQ: ADBE: Empowering everyone to create through innovative digital experiences.
Backend and data applications development; Java/Scala; RESTful APIs; SQL and NoSQL databases; distributed systems (Spark, Kafka, Hadoop); cloud (AWS/Azure); CS degree or equivalent experience; strong communication and documentation.
Java, Scala, RESTful APIs, SQL, NoSQL, Apache Spark, Kafka, Hadoop, AWS, Azure
2mo
Save
Mark Applied
Hide
Senior Lead Data Engineer
Richmond or McLean or Chicago or New York City or Plano
$209k-$239k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
6+ YOEBachelor's degree, 6+ years application development, 2+ years big data, 1+ year cloud (AWS/Azure/GCP), experience with Java/Scala/Python, SQL, Redshift/Snowflake, distributed data tools, UNIX/Linux, Agile, and team leadership.
Java, Scala, Python, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, SQL, AWS, Microsoft Azure, Google Cloud, Agile
2d
Save
Mark Applied
Hide
Responsible AI Engineer
New York City or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$68k-$220k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services delivering 360° value.
3+ YOEBachelor's degree or equivalent experience, 3+ years developing AI and machine learning solutions, 3+ years with programming, frameworks, APIs, version control, databases, and cloud platforms; responsible AI experience preferred.
Python, R, Java, Scikit-learn, TensorFlow, PyTorch, Django, Flask, FastAPI, GitHub, Bitbucket, AWS, Azure, Google Cloud, Hadoop, Spark
6d
Save
Mark Applied
Hide
Senior Data Platform Engineer
Calgary or Vancouver or Canada or Toronto or Burnaby or Dublin or Manchester or Sydney or Barcelona or Bogotá or London or New York City
$157k-$213k/yr HybridFull Time
Clio
Clio: Cloud-based legal practice management and software platform.
5+ YOE5+ years of relevant experience building enterprise-scale logging and data ingestion systems, with expertise in data architecture, streaming, cloud storage, infrastructure automation, data pipelines, APIs, and observability.
Splunk, OpenSearch, ElasticSearch, ELK Stack, MapReduce, Hadoop, Cassandra, Apache Kafka, Amazon Kinesis, AWS Glue, Azure Event Hubs, AWS S3, Azure Data Lake, GCS, Terraform, CloudFormation, Apache Spark, Flink, Python, Ruby, Go, Scala, SQL, Kubernetes, Splunk Enterprise, Sumo Logic, AWS, Azure, GCP
1mo
Save
Mark Applied
Hide
Backend Software Engineer - Platforms
New York, New York, United States
OnsiteFull Time
ByteDance
ByteDance: Global technology specializing in AI-powered content platforms.
3+ YOEBS in CS or equivalent, experience with web apps, Unix/Linux, distributed systems, networking, and large systems; DICM/ITOM/ITSM experience required; GPU or big data (Hadoop/Kafka/Apache) experience valuable; Golang or Python development experience and production troubleshooting skills.
Golang, Python, Unix/Linux, Hadoop, Kafka, Apache, GPU, Discovery, Insights, and Configuration Management (DICM), IT Operation Management (ITOM), IT Service Management (ITSM)