HiringCafe
Join our community

35 hadoop developer jobs at 18 companies in Pennsylvania

2d
Save
Mark Applied
Hide
Quality Engineer Principal - Big Data / Hadoop / Data Warehousing
Pittsburgh or Strongsville
$91k-$169k/yr OnsiteFull Time
PNC Financial Services
PNC Financial ServicesNYSE: PNC: Provides banking, lending, and investment services to customers.
5+ YOEBachelor's degree and 5+ years of relevant experience. Requires Python, Big Data, Hadoop, Spark/PySpark, HQL/SQL, data warehouse and ETL testing, AWS/cloud, automation, and QA team leadership.
Python, Big Data, Hadoop, Data Warehouse, Apache Spark, PySpark, HQL, SQL, AWS, Hive, HDFS, YARN, CI/CD, Agile, Scrum, DevOps, API
Job PostingView all
2mo
Save
Mark Applied
Hide
Kafka/Spark Developer
Pittsburgh, Pennsylvania, United States
$71k-$157k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
5+ YOE5+ years in big data development with hands-on Kafka, Spark, Hadoop, Impala, strong Java/Scala/Python skills, SQL proficiency, and experience in Agile teams.
Apache Kafka, Apache Spark, Hadoop Ecosystem (HDFS), Impala, PySpark, Scala, Java, Kafka Connect, Schema Registry, Hive, Oracle, PostgreSQL, Python, SQL, Neo4j
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Software Engineer - Big Data
Rockville or Washington or Tysons or Colorado or Florida or Texas or Illinois or Pennsylvania or Massachusetts or Maryland or Virginia or New York or New Jersey
$114k-$249k/yr HybridFull Time
FINRA
FINRA: Regulates brokerage firms and exchange markets in the United States.
7+ YOEBachelor's in CS or related + 7+ years experience; deep Big Data (Hadoop, Spark, Hive, Trino), SQL, AWS (S3, EMR, Glue, Lambda, Athena, EKS), Python/Scala, system design, CI/CD, DevOps, security, and team mentoring experience.
Hadoop, Spark, Hive, Trino, SQL, S3, EMR, Glue, Lambda, Athena, EKS, Python, Scala, GitHub Copilot, Q Developer, ChatGPT, Claude, Scrum, Kanban, CI/CD, DevOps
Job PostingView all
2w
Save
Mark Applied
Hide
Solutions Engineer - East Coast
Georgia or Massachusetts or New Jersey or Connecticut or Pennsylvania or New York
$150k-$180k/yr RemoteFull Time
Cloudera
Cloudera: Provides hybrid data platforms for enterprise analytics and AI.
5+ YOE5+ years pre-sales experience, technical discovery, solution design, demos/POCs; experience with public cloud, Hadoop ecosystem, SQL, streaming, and basic software development; Bachelor’s degree or equivalent.
AWS, Azure, GCP, IBM Cloud, Apache Spark, Iceberg, NiFi, Kafka, Flink, Apache Hadoop, HDFS, YARN, Hive, Impala, Kudu, Solr, Java, Scala, Python, Kubernetes, OpenShift, Teradata, Netezza, GreenPlum, Exadata, HBase, Phoenix, Accumlo, Druid, Cassandra, MongoDB, Talend, DataStage, Informatica BDM, Qlik, Tableau, Zoomdata, Tibco, MuleSoft, IBM, Oracle, Spring Integration, R, Anaconda, Jupyter
Job PostingView all
1w
Save
Mark Applied
Hide
Lead AI / ML Engineer
New York City or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$294k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
6+ YOEBachelor's degree or equivalent experience, 6+ years developing and deploying AI/ML solutions, programming proficiency, experience with ML frameworks, big data, databases, and cloud platforms.
Python, R, Java, TensorFlow, PyTorch, Hadoop, Spark, AWS, Microsoft Azure, Google Cloud, D3.js, ggplot
Job PostingView all
6d
Save
Mark Applied
Hide
Big Data Engineer
Pittsburgh or Cleveland or Dallas
$100k-$130k/yr HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
7+ YOERequires 7–10 years of data engineering experience, strong Python and Apache Spark skills, Hadoop ecosystem expertise, CA7 or Control-M experience, SQL knowledge, and technical leadership and mentoring experience.
Python, Hadoop, Hive, Impala, HDFS, Apache Spark, CA7, Control-M, SQL, Shell Scripting
Job PostingView all
1w
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
McLean or New York City or Richmond or San Francisco or Philadelphia or Canada or United Kingdom or Philippines
$179k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, and 1+ year cloud computing; Python, SQL, data pipelines, and cloud technologies required.
Python, Amazon Web Services (AWS), Apache Spark, Apache Kafka, SQL, Snowflake, Databricks, Generative AI (GenAI), Open Source RDBMS, NoSQL, MapReduce, Hadoop, Hive, Amazon EMR, MySQL, Mongo, Cassandra, Redshift, UNIX, Linux, Claude Code, GitHub Copilot, AWS Glue, ETL
Job PostingView all
1mo
Save
Mark Applied
Hide
AI ML Solution Architect & Developer Senior Manager
Dallas or Atlanta or Houston or Chicago or Philadelphia
$149k-$239k/yr HybridFull Time
Protiviti
ProtivitiNYSE: RHI: Global consulting firm providing risk management and internal audit services.
7+ YOE7+ years professional experience in technology consulting, 4+ years hands-on generative AI, Bachelor's in relevant field, experience with cloud platforms, programming (Python/R/SQL), AI frameworks, and leadership of technical teams.
AWS, Microsoft Azure, Google Cloud, Python, R, SQL, TensorFlow, PyTorch, Scikit-learn, Langchain, Hadoop, Spark
Job PostingView all
2mo
Save
Mark Applied
Hide
AWS Data Migration Engineer
Philadelphia, Pennsylvania, United States
OnsiteFull Time
Algonomy
Algonomy: AI-powered algorithmic customer engagement platform for retailers.
8+ YOE8+ years software development; experience with Big Data technologies; Scala, PySpark, Python; data pipeline migration, automation, and monitoring; AWS services and Databricks.
Databricks, AWS Glue, EMR, Step Functions, AWS Lambda, PySpark, Hadoop, Scala, Python
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer (Customer Data Products)
Philadelphia, Pennsylvania, United States
$127k-$160k/yr HybridFull Time
NBME
NBME: Develops and manages medical licensing and healthcare professional assessments.
7+ YOEBachelor's degree, 7+ years application development experience, 4+ years in big data and AWS, proficiency in Python/SQL/Scala/Java, distributed data tools, PySpark, NoSQL, Redshift, UNIX/Linux, process orchestration and CI/CD; experience with ML/LLM pipelines and vector DBs preferred.
AWS, Python, SQL, Scala, Java, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, PySpark, AirFlow, KubeFlow, AWS step functions, Luigi, Pinecone, Milvus, pgvector, Git, CI/CD, Feature Stores, Vector Databases, APIs, MLOps
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer
Mechanicsburg or Yorktown
OnsiteFull Time
Entarian
Entarian: Provides mission-critical engineering and technology solutions for government agencies.
10+ YOERequires Secret clearance, U.S. citizenship, Security+ and cloud or database certification, degree or equivalent experience, and 10+ years relevant experience; requires data warehousing, ETL, PostgreSQL, SQL, Oracle migration, modeling, and optimization expertise.
AWS GovCloud, Pentaho, PostgreSQL, SQL, Oracle PL/SQL, Amazon Aurora DB, MySQL, GitLab, Liquibase, CI/CD, Apache Hadoop, Spark, Kafka, Debezium, RabbitMQ, AWS, Azure, GCP, AWS RDS, RedShift, MicroStrategy, Erwin Data Modeler, Python, Java, Scala, Go
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or Florida or South Carolina or Pennsylvania or Arizona or Iowa or Indiana or Nebraska or Texas or Alabama or Georgia or North Carolina or Tennessee or Michigan or Alaska or Hawaii or Puerto Rico
$125k-$150k/yr RemoteFull Time
Akumin
Akumin: Nationwide provider of outpatient diagnostic imaging and oncology services.
5+ YOEBachelor's in data-related field, 5+ years in data management/ETL/ELT/data warehousing, strong SQL/T-SQL, Python or JavaScript, experience with dbt/Fivetran and cloud platforms (GCP/AWS/Azure), data modeling and governance, regulated-domain experience.
SQL, T-SQL, Python, JavaScript, Fivetran, dbt, GCP, AWS, Azure, BigQuery, S3, Snowflake, Kafka, Hadoop, Spark, Docker, Kubernetes, FHIR, EHR, DICOM, ICD, CPT
Job PostingView all
2d
Save
Mark Applied
Hide
Junior Data Engineer (Philadelphia, PA)
Philadelphia, Pennsylvania, United States
$63k-$75k/yr HybridFull Time
B Lab
B Lab: Certifies businesses for meeting high social and environmental standards.
2+ YOE2+ years of data engineering experience; SQL and scripting proficiency; Git, infrastructure as code, ETL/ELT, data pipeline, cloud, DevOps, and data solution experience. Bachelor's degree preferred.
Git, Terraform, CloudFormation, CDK, SQL, Python, Java, Scala, Hadoop, Spark, Hive, Google Meet, Zoom
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer | Active Top Secret clearance
Yorktown or Mechanicsburg
$130k-$150k/yr OnsiteFull Time
General Dynamics Information TechnologyNYSE: GD: Provides mission-critical IT services to government and defense organizations.
10+ YOERequires active Top Secret clearance, U.S. citizenship, 10+ years of data engineering experience, SQL, PostgreSQL, data modeling, ETL, cloud databases, and 8570/8140 IAT II Security+ certification.
Amazon Relational Database Service (RDS), Java, MySQL, PostgreSQL, Pentaho, GitLab, Liquibase, CI/CD, Apache Hadoop, Spark, Kafka, Debezium, RabbitMQ, Python, Scala, Go, AWS, Azure, GCP, Amazon Aurora, Redshift, MicroStrategy, Erwin Data Modeler, Oracle PL/SQL, SQL, AWS GovCloud, SAFe, EHR
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer | Active Top Secret clearance
Yorktown or Mechanicsburg
$130k-$150k/yr OnsiteFull Time
GDIT
GDITNYSE: GD: Delivers IT and mission services to government agencies.
10+ YOERequires 10+ years of data engineering experience, active Top Secret clearance, U.S. citizenship, SQL, PostgreSQL, data modeling, ETL, cloud databases, and 8570/8140 IAT II Security+ CE certification.
Amazon Relational Database Service (RDS), Java, MySQL, PostgreSQL, Pentaho, SQL, Oracle PL/SQL, GitLab, Liquibase, Apache Hadoop, Spark, Kafka, Debezium, RabbitMQ, AWS, Azure, GCP, Aurora DB, RedShift, MicroStrategy, Erwin Data Modeler, Python, Scala, Go, AWS GovCloud, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Science Engineer/Specialist
Johnstown, Pennsylvania, United States
RemoteFull Time
Concurrent Technologies Corporation
Concurrent Technologies Corporation: Conducts applied research and development for national security.
4+ YOEBachelor's degree in a quantitative field, 4+ years data science experience, advanced proficiency in Python/R/MATLAB, expertise in statistical and ML methods, visualization tools, and ability to lead projects and mentor staff.
Python, R, MATLAB, Tableau, Microsoft Power BI, matplotlib, TensorFlow, PyTorch, Scikit-learn, SQL, NoSQL, AWS, Azure, Google Cloud, Hadoop, Spark
Job PostingView all
1w
Save
Mark Applied
Hide
Sr. Solutions Engineer - Digital Native Business, Named Accounts
Florida or Massachusetts or New York or North Carolina or Pennsylvania or Virginia
$152k-$209k/yr RemoteFull Time
Databricks
Databricks: A unified platform for data analytics and artificial intelligence.
3+ YOE3+ years in data engineering/architecture or pre-sales, experience with distributed data systems, Python and SQL proficiency, public cloud experience (AWS/Azure/GCP), travel to customer sites, and domain expertise in data engineering or ML technologies.
Python, SQL, Spark, Hadoop, Kafka, pandas, scikit-learn, PyTorch, TensorFlow, AWS, Azure, GCP, MLflow, Delta Lake
Job PostingView all
1mo
Save
Mark Applied
Hide
AI ML Solution Architect & Developer Manager
Atlanta or Houston or Chicago or Dallas or Philadelphia
$136k-$217k/yr HybridFull Time
Protiviti
ProtivitiNew York Stock Exchange: RHI: Global consulting firm providing risk, advisory, and technology services.
5+ YOEBachelor's degree,5+ years professional services experience,3+ years hands-on generative AI,cloud AI familiarity,leadership experience; preferred AWS/Azure architect certs.
AWS, Microsoft Azure, Google Cloud, Python, R, SQL, TensorFlow, PyTorch, Scikit-learn, Langchain, Hadoop, Spark
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineering Team Leader
Towson or Harrisburg
OnsiteFull Time
Orrstown Bank
Orrstown BankNASDAQ: ORRF: Offers personal banking, commercial lending, and wealth management services.
7+ YOEBachelor's degree in computer science, information systems, or related field; 7+ years of systems engineering experience; SQL, programming, databases, cloud, ETL, data modeling, governance, and leadership expertise.
SQL, Oracle, SQL Server, MySQL, Python, Java, Scala, Hadoop, Spark, AWS, Azure, Google Cloud, Snowflake, Redshift, BigQuery, Apache Airflow, Azure Data Factory, Qlik Talend
Job PostingView all
3w
Save
Mark Applied
Hide
Data Architect
Alabama or Arizona or California or Colorado or Connecticut or Florida or Georgia or Illinois or Iowa or Kentucky or Maryland or Massachusetts or Michigan or Minnesota or Missouri or New Jersey or New York or North Carolina or Ohio or Pennsylvania or South Carolina or Tennessee or Texas or Utah
$100k-$200k/yr RemoteFull Time
RegEd
RegEd: Enterprise software for regulatory compliance and risk management.
10+ YOEBachelor's in CS/Data Science,10+ years data engineering/development experience,expertise in data modeling,warehousing,and integrations,experience with Databricks,Azure/AWS,Big Data and governance tools.
Databricks, Azure Data Lake Storage Gen2, Unity Catalog, Azure Data Factory, Microsoft Purview, Hadoop, Spark, AWS, Azure, Phyton, R, SQL
Job PostingView all

Explore Jobs

Expand Your Job Search