35 hadoop engineer jobs at 21 companies in Yardley, PA

2mo
Save
Mark Applied
Hide
Hadoop Hive Software Engineer - 6269346
Morristown, New Jersey, United States
$50-$54/hr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
5+ YOE5+ years experience; Hadoop, Hive, Spark, SQL; large data sets; Bachelor’s degree.
Apache Hadoop, Hadoop, Hive, Spark, SQL
5d
Save
Mark Applied
Hide
Hadoop Hive Software Engineer - 6269346
Morristown, New Jersey, United States
$50-$54/hr HybridFull Time, Contract
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
5+ YOERequires 5+ years of experience, a bachelor's degree, advanced Apache Hadoop, SQL, Hive, and Spark proficiency, large data set experience, and Hadoop database development, debugging, and performance tuning skills.
Apache Hadoop, Apache Hive, Apache Spark, Structured Query Language (SQL)
3w
Save
Mark Applied
Hide
Sr. Platform Engineer, Kubernetes
West Chester, Pennsylvania, United States
OnsiteFull Time
Comcast
ComcastNASDAQ: CMCSA: Provides global telecommunications, media content, and entertainment services.
7+ YOE7+ years in DevOps/Systems Engineering with deep Apache Spark, Kubernetes, cloud (AWS/Azure/GCP), Terraform/Ansible, Python/Java/Scala, observability (Prometheus/Grafana), networking, and CI/CD experience.
Prometheus, Grafana, Apache Spark, Apache Flyte, Terraform, Ansible, Python, Java, Scala, Bash, SQL, GitHub, Apache Iceberg, Unity Catalog, Delta Lake, Apache Kafka, Hadoop, Amazon S3, HDFS, Databricks Platform, Snowflake, Alluxio, Docker, Kubernetes, AWS, Azure, GCP, Linux, Adobe Spark, Go Programming Language
2mo
Save
Mark Applied
Hide
Agentic AI Engineer
New Brunswick, New Jersey, United States
$90k-$172k/yr HybridFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
1+ YOEExperience designing and deploying autonomous AI agents; strong Python, SQL, Pandas; hands-on with Azure AI Foundry or AWS Bedrock; prompt engineering, RAG, vector DBs, LangChain/LangGraph/Semantic Kernel/MCP Server; API/backend and Hadoop/Hive experience.
Microsoft Azure AI Foundry, AWS Bedrock, LangChain, LangGraph, Semantic Kernel, MCP Server, Python, SQL, Pandas, Hadoop, Hive, Pinecone, FAISS, ChromaDB, Flask, FastAPI, Oracle
1mo
Save
Mark Applied
Hide
Sr ETL Developer, AVP
Whippany, New Jersey, United States
$190k-$195k/yr HybridFull Time
Barclays
BarclaysLondon Stock Exchange: BARC: Global bank providing retail, corporate, and investment financial services.
Design and develop ETL/data-lake solutions; strong experience with Python, Apache Spark, Hadoop, Sqoop, Hive, PIG, SQL, Ab Initio and Unix; knowledge of Kafka/messaging; secure coding and unit testing; team leadership and stakeholder communication.
Python, Apache Spark, Hadoop, Sqoop, Hive, PIG, SQL, AbInitio, Unix, Kafka, Messaging Queue, Continuous Flow, Express It, Query It, Metadata Hub, Control Center
1mo
Save
Mark Applied
Hide
Senior Data Engineer (Customer Data Products)
Philadelphia, Pennsylvania, United States
$127k-$160k/yr HybridFull Time
NBME
NBME: Develops and manages medical licensing and healthcare professional assessments.
7+ YOEBachelor's degree, 7+ years application development experience, 4+ years in big data and AWS, proficiency in Python/SQL/Scala/Java, distributed data tools, PySpark, NoSQL, Redshift, UNIX/Linux, process orchestration and CI/CD; experience with ML/LLM pipelines and vector DBs preferred.
AWS, Python, SQL, Scala, Java, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, PySpark, AirFlow, KubeFlow, AWS step functions, Luigi, Pinecone, Milvus, pgvector, Git, CI/CD, Feature Stores, Vector Databases, APIs, MLOps
3d
Save
Mark Applied
Hide
Data Engineer, Specialist - DADES3001
Malvern or Charlotte
HybridFull Time
Vanguard
Vanguard: Provides mutual funds, ETFs, and investment management services.
8+ YOE8+ years in data or software engineering; scalable pipelines and cloud platforms; SQL, data modeling, Python, databases, modern data platforms, AI-assisted engineering, leadership, and collaboration.
SQL, Python, Scala, Java, AWS, Azure, GCP, Spark, Databricks, Snowflake, Kafka, Hadoop, Infrastructure as Code, DevOps, CI/CD, machine learning, GenAI
3d
Save
Mark Applied
Hide
Data Engineer, Specialist - DADES3001
Charlotte or Malvern
HybridFull Time
Vanguard
Vanguard: Global investment management and financial services provider.
8+ YOERequires 8+ years in data or software engineering, strong SQL, Python, data modeling, scalable pipelines, cloud platforms, modern data technologies, AI-assisted engineering, and technical leadership.
SQL, Python, Scala, Java, AWS, Azure, GCP, Spark, Databricks, Snowflake, Kafka, Hadoop, Infrastructure as Code, DevOps, CI/CD
3w
Save
Mark Applied
Hide
Data Engineer II
Bridgewater, New Jersey, United States
$103k-$133k/yr HybridFull Time
MetLife
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
3+ YOEBachelor's degree, 3+ years data engineering experience, strong SQL and Python/Scala skills, Databricks and cloud (Azure/AWS/GCP) experience, ETL/ELT and dimensional modeling knowledge.
Databricks, Azure, Azure Data Factory, Synapse, Event Hub, Spark, Hadoop, Hive, Git, CI/CD, Power BI, Cognos, Tableau, SQL, Python, Scala, AWS, GCP
6d
Save
Mark Applied
Hide
Junior Data Engineer (Philadelphia, PA)
Philadelphia, Pennsylvania, United States
$63k-$75k/yr HybridFull Time
B Lab
B Lab: Certifies businesses for meeting high social and environmental standards.
2+ YOE2+ years of data engineering experience; SQL and scripting proficiency; Git, infrastructure as code, ETL/ELT, data pipeline, cloud, DevOps, and data solution experience. Bachelor's degree preferred.
Git, Terraform, CloudFormation, CDK, SQL, Python, Java, Scala, Hadoop, Spark, Hive, Google Meet, Zoom
1w
Save
Mark Applied
Hide
Lead, Infrastructure Security Engineer
Newark, New Jersey, United States
$134k-$220k/yr OnsiteFull Time
Prudential Financial
Prudential FinancialNYSE: PRU: Provides insurance, investment management, and retirement services globally.
Bachelor's in computer science or engineering or related experience; advanced security expertise, cloud and database security experience, programming, infrastructure automation, agile development, and mentoring skills.
AWS, Azure, Windows, Linux, Unix, Python, Shell, PowerShell, SQL, Ansible, CloudFormation, Terraform, IBM Guardium, Imperva DAM, MSSQL, Oracle, DB2, PostgreSQL, Redshift, Couchbase, MongoDB, Hadoop, Aurora PostgreSQL, Amazon DynamoDB, DocumentDB, RDS, Azure SQL, Cosmos DB, Snowflake, Docker, Kubernetes, TCP/IP, SNOW, Splunk
2mo
Save
Mark Applied
Hide
Software Engineer
Arlington or Mount Laurel or Fall River or San Diego
$74k-$184k/yr HybridFull Time
Innovative Defense Technologies
Innovative Defense Technologies: A defense technology delivering mission-critical software and systems solutions to the U.S. government.
0+ YOEAbility to obtain/maintain Secret clearance, BS in CS or equivalent experience, 0-5 years professional experience, proficiency in C/C++/Python/Java/JavaScript, Linux, Git, Agile, and ability to travel up to 10%.
C, C++, Python, JavaScript, Java, Linux, shell scripting, Git, Make, Maven, Ant, X-Windows, Jenkins, Jira, Atlassian, VMware vSphere, Azure, AWS, GCP, Hadoop, Spark, Kafka, Cassandra, React, Angular, Vue, Storybook, Postgres, SQL, REST, gRPC, CORBA, DDS, TCP/IP, UDP, GitHub Copilot, ChatGPT, Claude, Cursor, Codeium
2w
Save
Mark Applied
Hide
AWS Lead Software Engineer-Big Data/ETL
Wilmington or Houston or Plano
OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years software engineering experience; advanced Java or Python; AWS and container experience; Big Data/ETL pipeline experience; SRE, monitoring, security, and AI-assisted development familiarity.
Java, Python, AWS, Docker, Kubernetes, ECS, Hortonworks, Grafana, Dynatrace, Prometheus, Datadog, Splunk
2d
Save
Mark Applied
Hide
Data Engineer (AWS, Azure, GCP)
Philadelphia, Pennsylvania, United States
HybridFull Time
CapTech
CapTech: Provides technology and management consulting services to large enterprises.
Experience delivering cloud solutions, designing data architectures, building production pipelines, and working with databases, SQL, scripting, and modern cloud technologies.
Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), SQL, Python, Java, R, C#, C++, C, SQL Server, PostgreSQL, Snowflake, Redshift, Aurora, Presto, BigQuery, Oracle, git, docker, subversion, Kubernetes, Jenkins, Spark, Databricks, Kafka, Kinesis, Hadoop, Lambda, EMR
2mo
Save
Mark Applied
Hide
AWS Data Migration Engineer
Philadelphia, Pennsylvania, United States
OnsiteFull Time
Algonomy
Algonomy: AI-powered algorithmic customer engagement platform for retailers.
8+ YOE8+ years software development; experience with Big Data technologies; Scala, PySpark, Python; data pipeline migration, automation, and monitoring; AWS services and Databricks.
Databricks, AWS Glue, EMR, Step Functions, AWS Lambda, PySpark, Hadoop, Scala, Python
2w
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
McLean or New York City or Richmond or San Francisco or Philadelphia or Canada or United Kingdom or Philippines
$179k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, and 1+ year cloud computing; Python, SQL, data pipelines, and cloud technologies required.
Python, Amazon Web Services (AWS), Apache Spark, Apache Kafka, SQL, Snowflake, Databricks, Generative AI (GenAI), Open Source RDBMS, NoSQL, MapReduce, Hadoop, Hive, Amazon EMR, MySQL, Mongo, Cassandra, Redshift, UNIX, Linux, Claude Code, GitHub Copilot, AWS Glue, ETL
1mo
Save
Mark Applied
Hide
AI ML Solution Architect & Developer Manager
Atlanta or Chicago or Dallas or Houston or Philadelphia
$136k-$217k/yr HybridFull Time
Protiviti
ProtivitiNYSE: RHI: Global consulting firm providing risk management and internal audit services.
5+ YOEBachelor's degree, 5+ years professional services experience, 3+ years hands-on generative AI experience, experience building/deploying AI/LLM solutions, cloud and security knowledge, leadership and client-facing skills.
AWS, Microsoft Azure, Google Cloud, Python, R, SQL, TensorFlow, PyTorch, Scikit-learn, Langchain, Hadoop, Spark
1mo
Save
Mark Applied
Hide
AI ML Solution Architect & Developer Senior Manager
Dallas or Atlanta or Houston or Chicago or Philadelphia
$149k-$239k/yr HybridFull Time
Protiviti
ProtivitiNew York Stock Exchange: RHI: Global consulting firm providing risk, advisory, and technology services.
7+ YOEBachelor's degree,7+ years professional experience,4+ years hands-on generative AI experience; cloud platform and programming proficiency; leadership and client-facing consulting experience.
AWS, Microsoft Azure, Google Cloud, Python, R, SQL, TensorFlow, PyTorch, Scikit-learn, Langchain, Hadoop, Spark
1mo
Save
Mark Applied
Hide
Sr. Director, Software Engineering – Data Platform & MDM Integration
New York City or Princeton
$185k-$265k/yr OnsiteFull Time
S&P Global
S&P GlobalNYSE: SPGI: Provides independent credit ratings, market benchmarks, and financial analytics.
9+ YOE7+ MgmtBachelor's in CS/Engineering, 9+ years in software engineering/data platform development, 7+ years people management, Databricks or Snowflake expertise, AWS (S3/EMR/Glue/Lambda) experience, large-scale migrations and modernization experience.
Databricks, Unity Catalog, Delta Live Tables, Databricks Mosaic AI, NeoXam, Informatica MDM, IBM InfoSphere, Snowflake, S3, EMR, Glue, Lambda, MLflow, Kubeflow, SageMaker, LangChain, Hugging Face, Apache Spark, Hadoop, Flink
1mo
Save
Mark Applied
Hide
Sr. Director, Software Engineering – Data Platform & MDM Integration
New York or Princeton
$185k-$265k/yr OnsiteFull Time
S&P Global
S&P GlobalNYSE: SPGI: Provides financial data, analytics, and credit ratings worldwide.
9+ YOE7+ MgmtBachelor's in CS/Engineering, 9+ years in software engineering/data platforms, 7+ years managing technical teams, expertise with Databricks/Snowflake and AWS (S3, EMR, Glue, Lambda), MDM integration experience, large-scale data migration and AI/ML exposure.
Databricks, Unity Catalog, Delta Live Tables, Databricks Mosaic AI, NeoXam, Snowflake, S3, EMR, Glue, Lambda, Informatica MDM, IBM InfoSphere, MLflow, Kubeflow, SageMaker, LangChain, Hugging Face, Apache Spark, Hadoop, Flink