71 spark engineer jobs at 40 companies in Brookhaven, PA
1mo
Save
Mark Applied
Hide
Principal Data Engineer
Philadelphia, Pennsylvania, United States
HybridFull Time
10+ YOE3+ Mgmt10+ years in data or software engineering, 7+ years building production data pipelines, strong Databricks/Spark/PySpark/SQL experience, Azure and streaming expertise, plus leadership and production operations experience.
Databricks, PySpark, Spark SQL, Spark, Python, SQL, Delta Lake, Databricks Workflows, CI/CD, Azure, Azure Event Hubs, Azure Stream Analytics, Azure Service Bus, Azure Data Factory, Azure Functions, ADLS, Azure Cosmos DB, Event Grid
1mo
Save
Mark Applied
Hide
Senior Engineer-GenAI Platform Engineering
Addison or Pennington or Charlotte
$122k-$200k/yr OnsiteFull Time
10+ YOE10+ years building enterprise-scale Generative AI and data platforms; Bachelor's/Master's in CS/Engineering/Data Science; expertise in Python, Kubernetes, Kafka, Spark; strong architecture, CI/CD, and platform leadership skills.
Python, Kafka, Apache Spark, Flink, Kubernetes, CI/CD, DevSecOps, MCP
3d
Save
Mark Applied
Hide
Senior Managing Engineer (US)
Mount Laurel, New Jersey, United States
$124k-$200k/yr OnsiteFull Time
10+ YOEBachelor's or graduate degree, strong academic background in computer science or engineering, and 10+ years of relevant experience. Expert Azure data platform, distributed processing, software engineering, and DevOps expertise required.
Azure, Databricks, Spark, Delta Lake, ADLS, Azure Data Factory, Event Hubs, Python, SQL, Scala, APIs, microservices, DataOps, DevOps, CI/CD, GitOps
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteContract
5+ YOE5+ years in data engineering with strong Python and experience with modern data platforms (Spark, Databricks, Trino, Iceberg, Snowflake, Kafka); capital markets/financial services experience required.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
4w
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Berwyn or Princeton or Clifton
$90k-$158k/yr OnsiteFull Time
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, APIs, MLOps, LLMOps, RAG
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteContract
5+ YOE5+ years data engineering experience in large-scale distributed processing; strong Python; experience with Spark/Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka; capital markets domain experience.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteFull Time
5+ YOE5+ years data engineering experience, capital markets domain knowledge, strong Python skills, experience with Spark/Databricks/Trino/Snowflake/Kafka and large-scale batch/stream processing, ability to support off-hours/weekend needs.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
1w
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
McLean or New York City or Richmond or San Francisco or Philadelphia or Canada or United Kingdom or Philippines
$179k-$246k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, and 1+ year cloud computing; Python, SQL, data pipelines, and cloud technologies required.
Python, Amazon Web Services (AWS), Apache Spark, Apache Kafka, SQL, Snowflake, Databricks, Generative AI (GenAI), Open Source RDBMS, NoSQL, MapReduce, Hadoop, Hive, Amazon EMR, MySQL, Mongo, Cassandra, Redshift, UNIX, Linux, Claude Code, GitHub Copilot, AWS Glue, ETL
1w
Save
Mark Applied
Hide
Distinguished Engineer -Developer Insights & AI Telemetry
New York City or McLean or Richmond or Wilmington
$294k-$335k/yr OnsiteFull Time
7+ YOEBachelor’s degree and 7+ years in software, solution, or enterprise architecture; expertise in big data, streaming, ML/AI, cloud computing, distributed systems, and technical leadership.
Spark, Kafka, Kinesis, ClickHouse, Snowflake, AWS, Microsoft Azure, Google Cloud, Python, Go, Java, TypeScript, OpenTelemetry, Protobuf, DORA, SPACE
2w
Save
Mark Applied
Hide
Lead Software Engineer - Python, Databricks and AWS
Jersey City or Wilmington
$152k-$215k/yr OnsiteFull Time
5+ YOE5+ years SDLC experience, strong data engineering with Databricks Lakehouse, Delta Lake, Spark; AWS (S3, IAM, KMS); streaming and batch pipelines; CI/CD and Terraform; governance and monitoring.
Databricks, Delta Lake, Spark, Delta Live Tables (DLT), Databricks Workflows, Structured Streaming, AWS, S3, IAM, KMS, Unity Catalog, Terraform
1mo
Save
Mark Applied
Hide
Data Engineer
Belcamp or Aberdeen Proving Ground
$78k-$176k/yr OnsiteFull Time
5+ YOE5+ years building enterprise data applications; 3+ years creating ETL/ELT workflows; experience with PySpark, Spark SQL, Palantir Foundry (Ontology, Workshop, Data Pipeline Builder); scripting, log debugging; Secret clearance; Bachelor’s degree.
PySpark, Spark SQL, Palantir Foundry, Foundry Ontology, Foundry Workshop, Palantir Foundry Data Pipeline Builder, Python, SQL, Scala, Java, UNIX, Linux, Shell scripting, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake
3d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
1w
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
3w
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano
OnsiteFull Time
Experience with Hadoop, PySpark, Hive, Spark, Python, SQL, Autosys/Airflow, Unix shell; bachelor\u0002s degree or equivalent; strong communication and SDLC experience required.
Hadoop, PySpark, Hive, Spark, Python, SQL, Unix Shell, Autosys, Airflow, Cloudera, Tableau
1mo
Save
Mark Applied
Hide
Senior Data Engineer (Customer Data Products)
Philadelphia, Pennsylvania, United States
$127k-$160k/yr HybridFull Time
7+ YOEBachelor's degree, 7+ years application development experience, 4+ years in big data and AWS, proficiency in Python/SQL/Scala/Java, distributed data tools, PySpark, NoSQL, Redshift, UNIX/Linux, process orchestration and CI/CD; experience with ML/LLM pipelines and vector DBs preferred.
AWS, Python, SQL, Scala, Java, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, PySpark, AirFlow, KubeFlow, AWS step functions, Luigi, Pinecone, Milvus, pgvector, Git, CI/CD, Feature Stores, Vector Databases, APIs, MLOps
1mo
Save
Mark Applied
Hide
Gen AI Engineer
Atlanta or Richmond or Lake Mary or Nashville or Indianapolis or Wilmington or Mason or Grand Prairie or Norfolk or United States
HybridFull Time
4+ YOEBachelor's in a quantitative field (or equivalent) and 4+ years experience; advanced Python and SQL; hands-on experience with LLM/GenAI, NLP, Hugging Face, TensorFlow, Keras, PyTorch, Spark; cloud (GCP/AWS) and MLOps/model deployment experience.
Python, SQL, Hugging Face, TensorFlow, Keras, PyTorch, Spark, GCP, AWS, vLLM, Text Generation Inference, FastAPI, GPTQ, AWQ, bitsandbytes, AWS EKS, AWS ECS, GCP GKE, Azure AKS
4w
Save
Mark Applied
Hide
Principal Machine Learning Engineer
Philadelphia, Pennsylvania, United States
OnsiteContract
5+ YOE5+ years ML model development, 3+ years production model operationalization, strong Python and SQL skills, experience with Databricks/Spark/MLflow, model evaluation and MLOps, and stakeholder communication.
Python, SQL, Spark, Databricks, MLflow, scikit-learn, XGBoost, Snowflake, Azure, AWS
1mo
Save
Mark Applied
Hide
Machine learning Engineer
Pennington, New Jersey, United States
$105k-$125k/yr OnsiteFull Time
10+ YOEHands-on ML engineer with expertise in model development, MLOps, deployment, feature engineering, and scalable ML pipelines; strong Python, cloud, and data engineering skills.
MLflow, Kubeflow, SageMaker, Azure ML, Docker, Kubernetes, Python, NumPy, pandas, scikit-learn, PyTorch, TensorFlow, AWS, Azure, GCP, Spark, Databricks, Airflow, Great Expectations, XGBoost, LightGBM
3mo
Save
Mark Applied
Hide
Data Engineer
Philadelphia, Pennsylvania, United States
OnsiteFull Time
2+ YOEMinimum 2 years of production data engineering experience; proficient in Python and SQL; experience with AWS, Redshift, ETL tools; able to design data pipelines and collaborate across teams.
AWS, Redshift, Glue, Fivetran, Airflow, ECS, DMS, DataHub, Terraform, Python, SQL, Spark
3mo
Save
Mark Applied
Hide
Sr. Data Engineer
Austin or Chicago or New Hartford or Philadelphia
$130k-$144k/yr RemoteFull Time
5+ YOE5+ years data engineering; project leadership; strong problem-solving; excellent communication; continuous learning; experience with AI/LLM tooling.
Python, SQL, Terraform, Spark, Databricks, Structured Streaming, Postgres, DynamoDB, CircleCI, DroneCI, Github Actions, Spacelift, DataDog, AWS, Azure, data governance, AI/ML integration, Claude Code, Cursor, Copilot, MCP, Agent Orchestrators, Git, Github
Explore Jobs