HiringCafe
Join our community

44 hadoop engineer jobs at 22 companies in Pennsylvania

3w
Save
Mark Applied
Hide
Quality Engineer Principal - Big Data / Hadoop / Data Warehousing
Pittsburgh or Strongsville
$91k-$169k/yr OnsiteFull Time
PNC Financial Services Group
PNC Financial Services GroupNYSE: PNC: Diversified financial services providing banking and investment solutions.
5+ YOEBachelor's degree and 5+ years of relevant experience. Requires Python, Big Data, Hadoop, Spark/PySpark, HQL/SQL, data warehouse and ETL testing, AWS/cloud, automation, and QA team leadership.
Python, Big Data, Hadoop, Data Warehouse, Apache Spark, PySpark, HQL, SQL, AWS, Hive, HDFS, YARN, CI/CD, Agile, Scrum, DevOps, API
Job PostingView all
4w
Save
Mark Applied
Hide
Sr. Solutions Engineer - Digital Native Business, Named Accounts
Florida or Massachusetts or New York or North Carolina or Pennsylvania or Virginia
$152k-$209k/yr RemoteFull Time
Databricks
Databricks: Data and AI software providing a unified platform.
3+ YOE3+ years in data engineering/architecture or pre-sales, experience with distributed data systems, Python and SQL proficiency, public cloud experience (AWS/Azure/GCP), travel to customer sites, and domain expertise in data engineering or ML technologies.
Python, SQL, Spark, Hadoop, Kafka, pandas, scikit-learn, PyTorch, TensorFlow, AWS, Azure, GCP, MLflow, Delta Lake
Job PostingView all
1mo
Save
Mark Applied
Hide
Solutions Engineer - East Coast
Georgia or Massachusetts or New Jersey or Connecticut or Pennsylvania or New York
$150k-$180k/yr RemoteFull Time
Cloudera
Cloudera: American hybrid data-and-AI platform serving enterprises with cloud, on-premises, and edge data management software.
5+ YOE5+ years pre-sales experience, technical discovery, solution design, demos/POCs; experience with public cloud, Hadoop ecosystem, SQL, streaming, and basic software development; Bachelor’s degree or equivalent.
AWS, Azure, GCP, IBM Cloud, Apache Spark, Iceberg, NiFi, Kafka, Flink, Apache Hadoop, HDFS, YARN, Hive, Impala, Kudu, Solr, Java, Scala, Python, Kubernetes, OpenShift, Teradata, Netezza, GreenPlum, Exadata, HBase, Phoenix, Accumlo, Druid, Cassandra, MongoDB, Talend, DataStage, Informatica BDM, Qlik, Tableau, Zoomdata, Tibco, MuleSoft, IBM, Oracle, Spring Integration, R, Anaconda, Jupyter
Job PostingView all
5d
Save
Mark Applied
Hide
Responsible AI Engineer
New York City or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$68k-$220k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services delivering 360° value.
3+ YOEBachelor's degree or equivalent experience, 3+ years developing AI and machine learning solutions, 3+ years with programming, frameworks, APIs, version control, databases, and cloud platforms; responsible AI experience preferred.
Python, R, Java, Scikit-learn, TensorFlow, PyTorch, Django, Flask, FastAPI, GitHub, Bitbucket, AWS, Azure, Google Cloud, Hadoop, Spark
Job PostingView all
1w
Save
Mark Applied
Hide
Sr Talend Data Engineer
Johnston or Iselin or Pittsburgh or Irving or Nashville or Massachusetts
$105k-$158k/yr HybridFull Time
Citizens Financial Group
Citizens Financial GroupNYSE: CFG: US regional bank holding providing diverse financial services.
5+ YOEBachelor's degree in analytics, mathematics, statistics, or computer science; 5+ years of professional experience building data solutions; expertise in ETL, big data, cloud platforms, databases, scripting, and AWS.
Talend, Datastage, Informatica, Sqoop, Hadoop, HDFS, Hive, PIG, Hbase, Hiveql, Teradata, Oracle, MS-SQL, DB2, RedShift, Snowflakes, SQL, PL/SQL, Python, Java, Spark, Scala, AWS, S3, RDS, Glue, Athena, Autosys, Tidal, Oozie, Bitbucket, Jira, Starteam, SVN, Windows, Unix/Linux, R, SAS, Machine learning, Tableau, Cognos
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Software Engineer - Big Data
Rockville or Washington or Tysons or Colorado or Florida or Texas or Illinois or Pennsylvania or Massachusetts or Maryland or Virginia or New York or New Jersey
$114k-$249k/yr HybridFull Time
FINRA
FINRA: Private nonprofit self-regulatory organization that supervises U.S. broker-dealers and protects investors.
7+ YOEBachelor's in CS or related + 7+ years experience; deep Big Data (Hadoop, Spark, Hive, Trino), SQL, AWS (S3, EMR, Glue, Lambda, Athena, EKS), Python/Scala, system design, CI/CD, DevOps, security, and team mentoring experience.
Hadoop, Spark, Hive, Trino, SQL, S3, EMR, Glue, Lambda, Athena, EKS, Python, Scala, GitHub Copilot, Q Developer, ChatGPT, Claude, Scrum, Kanban, CI/CD, DevOps
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer
Pittsburgh, Pennsylvania, United States
$71k-$157k/yr OnsiteFull Time
CGI
CGITSX: GIB.A: Global IT consulting and business services firm.
4+ YOEBachelor's degree in computer science or related field; 4+ years in data engineering and big data, 3+ years with Spark Streaming and Kafka, plus Spark, PySpark, SQL, Airflow, data modeling, shell scripting, and data integration expertise.
Apache Spark, Spark Core, Spark SQL, PySpark, Kafka, Apache Airflow, Oracle, SQL Server, Hive, HDFS, S3, Iceberg, SQL, shell scripting, CA7, Control-M, Jenkins, Python, MongoDB, Neo4j, GraphQL, Azure, AutoGen, Large Language Model (LLM)
Job PostingView all
1w
Save
Mark Applied
Hide
Engineer
Pittsburgh, Pennsylvania, United States
$100k-$120k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesBSE: 532540: Global leader in IT services, consulting, and business solutions.
8+ YOEBachelor's degree in computer science and 8+ years of experience. Requires Python, Apache Spark/PySpark, SQL, big data ecosystems, distributed computing, Git, and Linux/Unix expertise.
Python, Apache Spark, PySpark, Hadoop, Hive, HDFS, Kafka, SQL, Git, Linux, Unix
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Lead Data Engineer (Bank Tech)
McLean or Wilmington or Richmond or New York or California or Pennsylvania
$209k-$262k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
6+ YOEBachelor's degree, 6+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience; strong programming and data engineering skills required.
Java, Scala, Python, RDBMS, NoSQL, Redshift, Snowflake, machine learning, microservices, Agile, SQL, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, shell scripting, AWS, Microsoft Azure, Google Cloud
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
Mechanicsburg or Yorktown
OnsiteFull Time
Entarian
Entarian: Private engineering and federal technology services provider serving U.S. space, defense, and civilian government agencies.
10+ YOERequires Secret clearance, U.S. citizenship, Security+ and cloud or database certification, degree or equivalent experience, and 10+ years relevant experience; requires data warehousing, ETL, PostgreSQL, SQL, Oracle migration, modeling, and optimization expertise.
AWS GovCloud, Pentaho, PostgreSQL, SQL, Oracle PL/SQL, Amazon Aurora DB, MySQL, GitLab, Liquibase, CI/CD, Apache Hadoop, Spark, Kafka, Debezium, RabbitMQ, AWS, Azure, GCP, AWS RDS, RedShift, MicroStrategy, Erwin Data Modeler, Python, Java, Scala, Go
Job PostingView all
2d
Save
Mark Applied
Hide
Data Engineer, Specialist
Malvern, Pennsylvania, United States
HybridFull Time
Vanguard
Vanguard: Global investment management firm owned by its client funds.
5+ YOEBachelor’s degree or equivalent experience; 5+ years relevant experience, including 2+ years designing data pipelines, ETL processes, and database architectures; expertise in SQL, Python, or Scala.
SQL, Python, Scala, Apache Spark, Hadoop, Kafka, AWS Redshift, Google BigQuery, Azure Synapse, PostgreSQL, MySQL, MongoDB, Cassandra
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or Florida or South Carolina or Pennsylvania or Arizona or Iowa or Indiana or Nebraska or Texas or Alabama or Georgia or North Carolina or Tennessee or Michigan or Alaska or Hawaii or Puerto Rico
$125k-$150k/yr RemoteFull Time
Akumin
Akumin: Nationwide provider of outpatient radiology and oncology services.
5+ YOEBachelor's in data-related field, 5+ years in data management/ETL/ELT/data warehousing, strong SQL/T-SQL, Python or JavaScript, experience with dbt/Fivetran and cloud platforms (GCP/AWS/Azure), data modeling and governance, regulated-domain experience.
SQL, T-SQL, Python, JavaScript, Fivetran, dbt, GCP, AWS, Azure, BigQuery, S3, Snowflake, Kafka, Hadoop, Spark, Docker, Kubernetes, FHIR, EHR, DICOM, ICD, CPT
Job PostingView all
2d
Save
Mark Applied
Hide
Data Engineer, Specialist
Malvern, Pennsylvania, United States
HybridFull Time
Vanguard
Vanguard: Global investment management firm owned by its client funds.
5+ YOERequires 5+ years of relevant experience, including 2+ years designing and maintaining data pipelines, ETL processes, and database architectures; bachelor's degree or equivalent; SQL, Python or Scala; big data and cloud platform expertise.
ETL, SQL, Python, Scala, Apache Spark, Hadoop, Kafka, AWS Redshift, Google BigQuery, Azure Synapse, PostgreSQL, MySQL, MongoDB, Cassandra
Job PostingView all
6d
Save
Mark Applied
Hide
Software Developer | Trade Finance and Internal Positions | Experienced Hire
Bala Cynwyd, Pennsylvania, United States
OnsiteFull Time
Susquehanna International Group
Susquehanna International Group: Global quantitative trading and technology firm.
5+ YOEBachelor's degree in computer science, engineering, mathematics, or related discipline, or equivalent experience; 5+ years developing software with object-oriented languages and hands-on .NET and C# experience.
Microsoft .NET Core, C#, Kafka, Redis, Hadoop, ASP.NET MVC, Blazor, Vue.js, WPF, WCF, WinForms, Oracle
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer (AWS, Azure, GCP)
Philadelphia, Pennsylvania, United States
HybridFull Time
CapTech Consulting
CapTech Consulting: Technology and management consulting firm.
Experience delivering cloud solutions, designing data architectures, building production pipelines, and working with databases, SQL, scripting, and modern cloud technologies.
Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), SQL, Python, Java, R, C#, C++, C, SQL Server, PostgreSQL, Snowflake, Redshift, Aurora, Presto, BigQuery, Oracle, git, docker, subversion, Kubernetes, Jenkins, Spark, Databricks, Kafka, Kinesis, Hadoop, Lambda, EMR
Job PostingView all
2d
Save
Mark Applied
Hide
Senior Data Engineer (Customer Data Products)
Philadelphia, Pennsylvania, United States
$127k-$160k/yr HybridFull Time
National Board of Medical Examiners
National Board of Medical Examiners: Nonprofit medical assessment organization developing examinations and learning tools for health professionals and medical educators.
7+ YOEBachelor's degree and 7+ years of application development, including 4+ years in big data, AWS, distributed computing, streaming, NoSQL, data warehousing, PySpark, and SQL optimization.
AWS, Git, Python, SQL, Scala, Java, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, PySpark, AirFlow, KubeFlow, AWS Step Functions, Luigi, Pinecone, Milvus, pgvector, APIs, Data-as-a-Service (DaaS), CI/CD, MLOps, LLM
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Science Engineer/Specialist
Johnstown, Pennsylvania, United States
RemoteFull Time
Concurrent Technologies Corporation (CTC)
Concurrent Technologies Corporation (CTC): An independent nonprofit applied scientific research and development organization delivering full-lifecycle solutions to government and private-sector clients.
4+ YOEBachelor's degree in a quantitative field, 4+ years data science experience, advanced proficiency in Python/R/MATLAB, expertise in statistical and ML methods, visualization tools, and ability to lead projects and mentor staff.
Python, R, MATLAB, Tableau, Microsoft Power BI, matplotlib, TensorFlow, PyTorch, Scikit-learn, SQL, NoSQL, AWS, Azure, Google Cloud, Hadoop, Spark
Job PostingView all
1w
Save
Mark Applied
Hide
Software Engineer | Python & SQL Development | Experienced Hire
Bala Cynwyd, Pennsylvania, United States
OnsiteContract
Susquehanna International Group
Susquehanna International Group: Global quantitative trading and technology firm.
3+ YOERequires 3–6 years of development experience, strong Python and SQL, data pipeline or data-intensive service experience, analytical skills, and a bachelor's degree or equivalent experience.
Python, SQL, Hadoop, HBase, Druid
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
McLean or New York City or Richmond or San Francisco or Philadelphia or Canada or United Kingdom or Philippines
$179k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, and 1+ year cloud computing; Python, SQL, data pipelines, and cloud technologies required.
Python, Amazon Web Services (AWS), Apache Spark, Apache Kafka, SQL, Snowflake, Databricks, Generative AI (GenAI), Open Source RDBMS, NoSQL, MapReduce, Hadoop, Hive, Amazon EMR, MySQL, Mongo, Cassandra, Redshift, UNIX, Linux, Claude Code, GitHub Copilot, AWS Glue, ETL
Job PostingView all
1mo
Save
Mark Applied
Hide
AI ML Solution Architect & Developer Manager
Atlanta or Chicago or Dallas or Houston or Philadelphia
$136k-$217k/yr HybridFull Time
Protiviti
Protiviti: Private global consulting firm serving businesses and governments with technology, risk, compliance, finance, and internal-audit services.
5+ YOEBachelor's degree, 5+ years professional services experience, 3+ years hands-on generative AI experience, experience building/deploying AI/LLM solutions, cloud and security knowledge, leadership and client-facing skills.
AWS, Microsoft Azure, Google Cloud, Python, R, SQL, TensorFlow, PyTorch, Scikit-learn, Langchain, Hadoop, Spark
Job PostingView all

Explore Jobs

Expand Your Job Search