35 hadoop engineer jobs at 13 companies in Wayne, PA
3w
Save
Mark Applied
Hide
Hadoop PySpark Data Engineer
Charlotte or Jersey City or Newark or Plano
$82k-$127k/yr OnsiteFull Time
Experience with Hadoop ecosystem (Cloudera), PySpark, Spark, Hive, Python, Unix shell scripting, Autosys/Airflow, SQL; Bachelor\u0002s or equivalent experience; ability to work across SDLC and travel/relocate as needed.
Hadoop, Cloudera, PySpark, Spark, Hive, Python, Unix shell scripting, Autosys, Airflow, SQL, Tableau
1d
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano or Delaware or Florida or New Jersey or North Carolina or Texas or United States
$82k-$127k/yr OnsiteFull Time
Bachelor's degree or equivalent experience; Hadoop, Hive, Spark, PySpark, Python, Unix shell scripting, SQL, data warehousing, orchestration tools, Agile, and production Big Data experience required.
Hadoop, PySpark, Cloudera, Hive, Spark, Python, Unix, Autosys, Airflow, SQL, Agile, Tableau, AI, cloud, containerization
2w
Save
Mark Applied
Hide
Sr. Platform Engineer, Kubernetes
West Chester, Pennsylvania, United States
OnsiteFull Time
7+ YOE7+ years in DevOps/Systems Engineering with deep Apache Spark, Kubernetes, cloud (AWS/Azure/GCP), Terraform/Ansible, Python/Java/Scala, observability (Prometheus/Grafana), networking, and CI/CD experience.
Prometheus, Grafana, Apache Spark, Apache Flyte, Terraform, Ansible, Python, Java, Scala, Bash, SQL, GitHub, Apache Iceberg, Unity Catalog, Delta Lake, Apache Kafka, Hadoop, Amazon S3, HDFS, Databricks Platform, Snowflake, Alluxio, Docker, Kubernetes, AWS, Azure, GCP, Linux, Adobe Spark, Go Programming Language
2w
Save
Mark Applied
Hide
Principal Engineer- Network Engineering
Basking Ridge or Bloomington or Collegeville or Irving or Worcester or Pittsburgh or Aurora or Kent or Downers Grove or Bloomington
$107k-$205k/yr HybridFull Time
6+ YOE6+ years in technical facilities planning or related disciplines; experience with PSC design, Python automation, LLM integrations, SQL/databases, Looker/Tableau, and cloud platforms; bachelor's degree or equivalent experience.
AutoCAD, Python, AWS, Azure, Kubernetes, Git, SVN, Looker, Tableau, PostgreSQL, pgvector, Oracle, SQL Server, Hadoop, REST, GraphQL, Anthropic Claude, GPT-4, Gemini, Microsoft Teams, dcTrack, Canvas, Clarity, vSAP, ERP-SAP Portal, COEP, 1ERP, NSAP, 1PSC-UNO, NPP, DRAAS, CCP
1mo
Save
Mark Applied
Hide
Senior Data Engineer (Customer Data Products)
Philadelphia, Pennsylvania, United States
$127k-$160k/yr HybridFull Time
7+ YOEBachelor's degree, 7+ years application development experience, 4+ years in big data and AWS, proficiency in Python/SQL/Scala/Java, distributed data tools, PySpark, NoSQL, Redshift, UNIX/Linux, process orchestration and CI/CD; experience with ML/LLM pipelines and vector DBs preferred.
AWS, Python, SQL, Scala, Java, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, PySpark, AirFlow, KubeFlow, AWS step functions, Luigi, Pinecone, Milvus, pgvector, Git, CI/CD, Feature Stores, Vector Databases, APIs, MLOps
3w
Save
Mark Applied
Hide
Lead Data Engineer
Wilmington or McLean
$179k-$225k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, 1+ year cloud experience, proficiency in Java/Scala/Python and data engineering tools.
Java, Scala, Python, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, AWS, Microsoft Azure, Google Cloud, SQL
1w
Save
Mark Applied
Hide
Software Engineer [Multiple Positions Available]
Wilmington, Delaware, United States
OnsiteFull Time
5+ YOEBachelor's in Computer/Software/Electronic Engineering or related plus 5+ years experience; experience designing and implementing microservices, streaming, databases, containers, and performance tooling.
SpringBoot, Apache Kafka, Cassandra DB, CockroachDB, Cloud Foundry, Hadoop, Gemfire, GoJS, TopHat, TrueCD, Dynatrace, Newman, Spring Integration, Apache Camel, Apache Flux, Reactor framework, socket.io, CF-for-K8s, Splunk, Graffana, Resilience4j, Sleuth, Postman, Java
3d
Save
Mark Applied
Hide
Junior Data Engineer (Philadelphia, PA)
Philadelphia, Pennsylvania, United States
$63k-$75k/yr HybridFull Time
2+ YOE2+ years of data engineering experience; SQL and scripting proficiency; Git, infrastructure as code, ETL/ELT, data pipeline, cloud, DevOps, and data solution experience. Bachelor's degree preferred.
Git, Terraform, CloudFormation, CDK, SQL, Python, Java, Scala, Hadoop, Spark, Hive, Google Meet, Zoom
1mo
Save
Mark Applied
Hide
Senior Lead Data Engineer (Bank Tech)
McLean or Wilmington or Richmond or New York or California or Pennsylvania
$209k-$262k/yr OnsiteFull Time
6+ YOEBachelor's degree, 6+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience; strong programming and data engineering skills required.
Java, Scala, Python, RDBMS, NoSQL, Redshift, Snowflake, machine learning, microservices, Agile, SQL, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, shell scripting, AWS, Microsoft Azure, Google Cloud
2mo
Save
Mark Applied
Hide
Software Engineer
Arlington or Mount Laurel or Fall River or San Diego
$74k-$184k/yr HybridFull Time
0+ YOEAbility to obtain/maintain Secret clearance, BS in CS or equivalent experience, 0-5 years professional experience, proficiency in C/C++/Python/Java/JavaScript, Linux, Git, Agile, and ability to travel up to 10%.
C, C++, Python, JavaScript, Java, Linux, shell scripting, Git, Make, Maven, Ant, X-Windows, Jenkins, Jira, Atlassian, VMware vSphere, Azure, AWS, GCP, Hadoop, Spark, Kafka, Cassandra, React, Angular, Vue, Storybook, Postgres, SQL, REST, gRPC, CORBA, DDS, TCP/IP, UDP, GitHub Copilot, ChatGPT, Claude, Cursor, Codeium
2d
Save
Mark Applied
Hide
Lead Data Engineer
Wilmington, Delaware, United States
$179k-$205k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience; preferred experience with Python, SQL, Scala, Java, databases, and distributed systems.
Java, Scala, Python, SQL, Redshift, Snowflake, AWS, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, Agile, AI
1w
Save
Mark Applied
Hide
Lead AI / ML Engineer
New York City or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$294k/yr HybridFull Time
6+ YOEBachelor's degree or equivalent experience, 6+ years developing and deploying AI/ML solutions, programming proficiency, experience with ML frameworks, big data, databases, and cloud platforms.
Python, R, Java, TensorFlow, PyTorch, Hadoop, Spark, AWS, Microsoft Azure, Google Cloud, D3.js, ggplot
1w
Save
Mark Applied
Hide
Lead AI / ML Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$294k/yr HybridFull Time
6+ YOERequires 6+ years developing AI/ML solutions, programming in Python, R, or Java, machine learning frameworks, data analysis, cloud platforms, and strong communication skills.
Python, R, Java, TensorFlow, PyTorch, Hadoop, Spark, AWS, Azure, Google Cloud, D3.js, ggplot
2mo
Save
Mark Applied
Hide
AWS Data Migration Engineer
Philadelphia, Pennsylvania, United States
OnsiteFull Time
8+ YOE8+ years software development; experience with Big Data technologies; Scala, PySpark, Python; data pipeline migration, automation, and monitoring; AWS services and Databricks.
Databricks, AWS Glue, EMR, Step Functions, AWS Lambda, PySpark, Hadoop, Scala, Python
1mo
Save
Mark Applied
Hide
AI ML Solution Architect & Developer Manager
Atlanta or Chicago or Dallas or Houston or Philadelphia
$136k-$217k/yr HybridFull Time
5+ YOEBachelor's degree, 5+ years professional services experience, 3+ years hands-on generative AI experience, experience building/deploying AI/LLM solutions, cloud and security knowledge, leadership and client-facing skills.
AWS, Microsoft Azure, Google Cloud, Python, R, SQL, TensorFlow, PyTorch, Scikit-learn, Langchain, Hadoop, Spark
1mo
Save
Mark Applied
Hide
AI ML Solution Architect & Developer Senior Manager
Dallas or Atlanta or Houston or Chicago or Philadelphia
$149k-$239k/yr HybridFull Time
7+ YOEBachelor's degree,7+ years professional experience,4+ years hands-on generative AI experience; cloud platform and programming proficiency; leadership and client-facing consulting experience.
AWS, Microsoft Azure, Google Cloud, Python, R, SQL, TensorFlow, PyTorch, Scikit-learn, Langchain, Hadoop, Spark
1mo
Save
Mark Applied
Hide
Sr. Director, Software Engineering – Data Platform & MDM Integration
New York City or Princeton
$185k-$265k/yr OnsiteFull Time
9+ YOE7+ MgmtBachelor's in CS/Engineering, 9+ years in software engineering/data platform development, 7+ years people management, Databricks or Snowflake expertise, AWS (S3/EMR/Glue/Lambda) experience, large-scale migrations and modernization experience.
Databricks, Unity Catalog, Delta Live Tables, Databricks Mosaic AI, NeoXam, Informatica MDM, IBM InfoSphere, Snowflake, S3, EMR, Glue, Lambda, MLflow, Kubeflow, SageMaker, LangChain, Hugging Face, Apache Spark, Hadoop, Flink
1mo
Save
Mark Applied
Hide
Sr. Director, Software Engineering – Data Platform & MDM Integration
New York or Princeton
$185k-$265k/yr OnsiteFull Time
9+ YOE7+ MgmtBachelor's in CS/Engineering, 9+ years in software engineering/data platforms, 7+ years managing technical teams, expertise with Databricks/Snowflake and AWS (S3, EMR, Glue, Lambda), MDM integration experience, large-scale data migration and AI/ML exposure.
Databricks, Unity Catalog, Delta Live Tables, Databricks Mosaic AI, NeoXam, Snowflake, S3, EMR, Glue, Lambda, Informatica MDM, IBM InfoSphere, MLflow, Kubeflow, SageMaker, LangChain, Hugging Face, Apache Spark, Hadoop, Flink
1d
Save
Mark Applied
Hide
Data Architect
Jersey City or Pennington
$120k-$136k/yr OnsiteFull Time
5+ YOERequires 10+ years overall experience, 5+ years relevant technology experience, database expertise in Oracle, DB2, and Sybase, scripting in shell and Python, Informatica, data modeling, and a bachelor's degree in computer science or equivalent engineering.
Oracle, DB2, Sybase, Hadoop, Impala, Iceberg, Power Designer, Erwin, Shell, Python, Informatica, IBM
Explore Jobs