11 big data developer jobs at 10 companies in Pennsylvania

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
4d
Save
Mark Applied
Hide
Senior Data Engineer - Hadoop/Spark/OCP/Big Data
Pittsburgh or Strongsville or Denver or Phoenix or Birmingham or Dallas
$50k-$186k/yr OnsiteFull Time
PNC Financial Services
PNC Financial ServicesNYSE: PNC: Provides banking, lending, and investment services to customers.
5+ YOEDesign and maintain scalable data pipelines with Spark/SQL; containerize workloads; optimize Spark performance; CI/CD and data governance experience; 5+ years industry experience.
Hadoop, Spark, SQL, Docker, Kubernetes, OCP, S3, ADLS, Apache Iceberg, Jenkins, GitHub, Bitbucket, Azure DevOps
1mo
Save
Mark Applied
Hide
Lead Software Engineer - Big Data
Rockville or Washington or Tysons or Colorado or Florida or Texas or Illinois or Pennsylvania or Massachusetts or Maryland or Virginia or New York or New Jersey
$114k-$249k/yr HybridFull Time
FINRA
FINRA: Regulates brokerage firms and exchange markets in the United States.
7+ YOEBachelor's in CS or related + 7+ years experience; deep Big Data (Hadoop, Spark, Hive, Trino), SQL, AWS (S3, EMR, Glue, Lambda, Athena, EKS), Python/Scala, system design, CI/CD, DevOps, security, and team mentoring experience.
Hadoop, Spark, Hive, Trino, SQL, S3, EMR, Glue, Lambda, Athena, EKS, Python, Scala, GitHub Copilot, Q Developer, ChatGPT, Claude, Scrum, Kanban, CI/CD, DevOps
1mo
Save
Mark Applied
Hide
Sr. Software Engineer - Big Data, Data Lake
Oregon or Washington or California or Florida or Idaho or Iowa or Kentucky or Maryland or Massachusetts or Michigan or Minnesota or Nevada or New Jersey or Ohio or Pennsylvania or Tennessee or Texas or Arizona or Illinois or Colorado or New Hampshire
$120k-$150k/yr RemoteFull Time
Foureyes
Foureyes: Data platform providing sales intelligence for automotive dealerships.
7+ YOE7+ years software development experience with 5+ years in AWS; hands-on with AWS data services (S3, Glue, Athena, Lake Formation, Step Functions, Lambda, Kinesis), Python, SQL, TypeScript/Node.js, data pipeline design, and on-call experience.
S3, Glue, Data Catalog, DataBrew, Athena, Lake Formation, Step Functions, Lambda, Kinesis Data Stream, API Gateway, Python, SQL, TypeScript, Node.js, Snowflake, Metabase, Redshift, BigQuery, SNS, SQS, EventBridge, Pub/Sub, webhooks, AWS CDK, CI/CD, Spec Kit, Claude Code, Cursor, GitHub Copilot
1mo
Save
Mark Applied
Hide
AWS Data Migration Engineer
Philadelphia, Pennsylvania, United States
OnsiteFull Time
Algonomy
Algonomy: AI-powered algorithmic customer engagement platform for retailers.
8+ YOE8+ years software development; experience with Big Data technologies; Scala, PySpark, Python; data pipeline migration, automation, and monitoring; AWS services and Databricks.
Databricks, AWS Glue, EMR, Step Functions, AWS Lambda, PySpark, Hadoop, Scala, Python
1mo
Save
Mark Applied
Hide
Data Engineer (Python Analytical Environment)
Farmers Branch or Pittsburgh or Birmingham or Cleveland
$86k-$173k/yr OnsiteFull Time
PNC Financial Services
PNC Financial ServicesNYSE: PNC: Provides banking, lending, and investment services to customers.
3+ YOEBachelor's-level data engineer with 3+ years relevant experience. In-office 5 days/week at Cleveland, Pittsburgh, Birmingham or Dallas. Requires Python, Hadoop/Hive, Impala, REST API, Linux, shell scripting, big data concepts; Azure and Power BI preferred. Comfortable with rotating on-call.
Python, Hadoop, Hive, Impala, REST API, Linux, Shell Scripting, Microsoft Azure, Microsoft Power BI
2w
Save
Mark Applied
Hide
Senior Data Engineer (Customer Data Products)
Philadelphia, Pennsylvania, United States
$127k-$160k/yr HybridFull Time
NBME
NBME: Develops and manages medical licensing and healthcare professional assessments.
7+ YOEBachelor's degree, 7+ years application development experience, 4+ years in big data and AWS, proficiency in Python/SQL/Scala/Java, distributed data tools, PySpark, NoSQL, Redshift, UNIX/Linux, process orchestration and CI/CD; experience with ML/LLM pipelines and vector DBs preferred.
AWS, Python, SQL, Scala, Java, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, PySpark, AirFlow, KubeFlow, AWS step functions, Luigi, Pinecone, Milvus, pgvector, Git, CI/CD, Feature Stores, Vector Databases, APIs, MLOps
3mo
Save
Mark Applied
Hide
Staff Software Engineer (L4) Data Platform
United States or California or Washington or New York or New Jersey or Pennsylvania or Connecticut
$171k-$214k/yr RemoteFull Time
Twilio
TwilioNYSE: TWLO: Cloud communications platform for building customer engagement applications.
8+ YOEBachelor's degree in CS/Engineering, 8+ years software development experience, expertise in big data technologies (Hadoop, Spark, Kafka), AWS, Python/Java/Scala, data lakehouse formats (Hudi/Iceberg/Delta), and leadership/mentoring skills.
Hadoop, Spark, Kafka, AWS, Python, Java, Scala, Hudi, Iceberg, Delta
5d
Save
Mark Applied
Hide
Senior Software Engineer (Data Engineering and Infrastructure)
Pittsburgh, Pennsylvania, United States
$146k-$234k/yr HybridFull Time
Aurora
AuroraNASDAQ: AUR: Developing autonomous driving technology for trucking and passenger mobility.
5+ YOE5+ years software engineering experience focused on data projects, proficiency in Python/Go/C++, big-data frameworks, cloud data services, SQL, Airflow and DBT; strong communication and cross-functional collaboration skills.
Python, Go, C++, Presto, Trino, EMR, Apache Spark, Flink, Kinesis Data Stream, AWS, GCP, Azure, S3, Redshift, BigQuery, Glue, SQL, DBT, Apache Airflow, Snowflake
2mo
Save
Mark Applied
Hide
Sr Application Developer
Pittsburgh or Warrendale
HybridFull Time
Federated Hermes
Federated HermesNYSE: FHI: Global investment management firm providing diversified financial strategies.
5+ YOEBachelor's in CS/Engineering, 5+ years programming experience including ≥1 year with big data (Databricks preferred). Experience with Python, SQL, Azure, data lakehouse principles, Kimball modeling, version control. CI/CD and Databricks certification preferred.
Databricks, Python, SQL, Azure, Spark, Delta Lake, PySpark
1mo
Save
Mark Applied
Hide
Principal Machine Learning Engineer
Denver or Arizona or Arkansas or California or Florida or Georgia or Illinois or Indiana or Iowa or Kansas or Maryland or Massachusetts or Michigan or Minnesota or Missouri or Montana or Nevada or New Jersey or New York or North Carolina or Ohio or Oklahoma or Pennsylvania or Tennessee or Texas or Utah or Virginia or Washington or Wisconsin
$228k-$253k/yr HybridFull Time
Ibotta
IbottaNYSE: IBTA: Provides a cash-back rewards and performance marketing platform.
10+ YOE10+ years building and deploying large-scale ML systems; expertise with cloud (AWS), big-data tools, ML frameworks, and leading ML strategy and mentoring engineers.
Python, Apache Spark, Databricks, AWS, Amazon SageMaker, scikit-learn, TensorFlow, Spark ML, Apache Kafka
2mo
Save
Mark Applied
Hide
Postdoctoral Scholar, Environmental Health Science and Geospatial Data Science, Gong Lab
University Park, Pennsylvania, United States
OnsiteFull Time, Temporary
Pennsylvania State University
Pennsylvania State University: Public research university providing academic education and research.
PhD in GIScience, Environmental Science, Geography, Statistics, Computer Science, Public Health, Epidemiology or related field; strong publications; programming and GIS; English proficiency; collaboration; experience with HPC/big data/AI preferred.
GIS, Geospatial Analysis, Machine Learning, Python, R, High-Performance Computing