41 spark data engineer jobs at 26 companies in Cornwall, NY
3w
Save
Mark Applied
Hide
Senior Data Engineer
North Hollywood or New York
$140k-$160k/yr HybridFull Time
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
2mo
Save
Mark Applied
Hide
Data Engineer
Jersey City or Irving or New York or Tampa
$142k-$213k/yr HybridFull Time
5+ YOE5-8 years of data engineering experience; strong ETL, data warehousing, Python, Spark; AWS Glue, Snowflake; SQL databases; project experience.
AWS Glue, AWS Athena, Airflow, Snowflake, MongoDB, Oracle, PostgreSQL, Unix Shell, Python, PySpark, Ab Initio
6d
Save
Mark Applied
Hide
Data Engineer
Whippany or New Jersey
$100k-$135k/yr HybridFull Time
6+ YOE6+ years experience, strong SQL, Python and Spark; Python expertise mandatory; hands-on AWS and/or Databricks; experience with cloud data platforms (AWS/Azure); knowledge of data modeling, governance, and metadata.
SQL, Python, Spark, AWS, Databricks, Azure
2w
Save
Mark Applied
Hide
Data Engineer
Manhattan or United States
$140k-$180k/yr RemoteFull Time
Hands-on experience with Kubernetes and AWS, distributed computing (Spark, Ray), workflow orchestration (Airflow), Python and SQL; experience building multi-terabyte and streaming data pipelines for audio/video is preferred.
Kubernetes, AWS, Spark, Ray, Airflow, Dagster, Prefect, Luigi, Python, SQL, Golang
1mo
Save
Mark Applied
Hide
Data Engineer - AVP
Whippany, New Jersey, United States
$190k-$195k/yr OnsiteFull Time
Experience building Java-based data pipelines, data warehouses and lakes; strong skills in Java, Spark, Kafka, Kubernetes, OAuth2/JWT, JUnit, Mockito, GitLab/Bitbucket; experience leading technical teams and ensuring data governance and observability.
Java, Spark, Kafka, Kubernetes, OAuth2, JWT, JUnit, Mockito, GitLab, Bitbucket
2w
Save
Mark Applied
Hide
Staff Data Engineer - Data Engineering
Livingston or New York City or Sunnyvale or San Francisco or Bellevue
$207k-$275k/yr OnsiteFull Time
10+ YOE10+ years in data or software engineering with enterprise data architecture experience; expertise in lakehouse architectures, data modeling, governance, SQL and production programming (Python/Scala/Java/Rust); strong cross-team leadership.
Apache Iceberg, Delta Lake, Apache Hudi, Apache Paimon, Apache Fluss, StarRocks, ClickHouse, Trino, Spark, Flink, Kafka, AutoMQ, Pulsar, SQL, Python, Scala, Java, Rust, Kubernetes
2mo
Save
Mark Applied
Hide
Senior Data Engineer - PGIM Technology (Hybrid - Newark, NJ)
Newark, New Jersey, United States
$115k-$155k/yr HybridFull Time
3+ YOEBachelor's or Master's in CS/data engineering, 3+ years data/AI engineering, strong Python and SQL, experience with Spark/PySpark, Microsoft Fabric/Azure Data Factory/AWS Glue, ML model deployment, CI/CD and data governance.
Microsoft Fabric, Azure Data Factory, AWS Glue, PySpark, Spark, Python, SQL, REST APIs, GitHub Actions, Azure DevOps, Git, LLM APIs
6d
Save
Mark Applied
Hide
Senior Data Engineer (Azure & Databricks)
New York, New York, United States
$149k-$190k/yr HybridFull Time
7+ YOE7-10 years data engineering experience with Databricks, Spark, Delta Lake, strong SQL and Python skills, enterprise ETL/ELT, experience with MDM, cloud data platforms, and data architecture.
Databricks, Apache Spark, Delta Lake, Python, SQL, AWS, Azure, GCP, Deltek, SAP, Oracle
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Poughkeepsie, New York, United States
$100k-$126k/yr OnsiteFull Time
5+ YOEBachelor’s degree in CS or related; Master’s preferred. 5+ years of Data Engineer experience; Databricks Certifications preferred; Azure Data Engineer certification preferred; strong Python, Databricks, and data warehousing experience.
Databricks, Spark, PySpark, Scala, Delta Lake, Azure Data Lake Storage Gen2, CI/CD, ITSM, SDLC, MLOps
2mo
Save
Mark Applied
Hide
Senior Data Engineer - PGIM Technology (Hybrid - Newark, NJ)
Newark, New Jersey, United States
$115k-$155k/yr HybridFull Time
3+ YOE3–6 years data/AI engineering experience; strong Python, SQL, Spark/PySpark; experience with data pipelines (ETL/ELT) and tools like Microsoft Fabric or Azure Data Factory; ML deployment and basic MLOps; knowledge of generative AI (embeddings, RAG).
Microsoft Fabric, Azure Data Factory, PySpark, Spark, SQL, Python, AWS Glue, REST APIs, GitHub Actions, Azure DevOps, Git
2w
Save
Mark Applied
Hide
Sr. Engineer, Data & Analytics
Stamford or United States
RemoteFull Time
5+ YOEBachelor's in CS/Data/Engineering,5+ years in data engineering and analytics,expertise in Microsoft Power BI and Microsoft Fabric,SQL,Python/PySpark,DAX,Data modeling,CI/CD and stakeholder partnership.
Microsoft Power BI, Microsoft Fabric, OneLake, Microsoft Data Factory, Dataflows Gen2, Spark, SQL, Python, PySpark, Direct Lake, Git, Microsoft Purview, Databricks, Snowflake, Redshift, BigQuery, DAX, Delta Lake, Parquet
1mo
Save
Mark Applied
Hide
Data Engineering Lead
New York, New York, United States
$200k-$280k/yr OnsiteFull Time
15+ YOE5+ Mgmt15+ years in data engineering with 5+ years in senior leadership; deep hands-on expertise in Python, SQL, Spark/PySpark, cloud data platforms (Azure/AWS/GCP), orchestration tooling (Prefect, Airflow, dbt), enterprise security, and large-scale legacy-to-cloud migrations.
Python, SQL, Spark, PySpark, Prefect, Airflow, dbt, Azure, AWS, GCP, Azure API Management, Kong, Collibra, Atlan, Alation, Terraform, CI/CD
3w
Save
Mark Applied
Hide
Head of Data Engineering
Fort Lee, New Jersey, United States
$200k/yr OnsiteFull Time
10+ YOE4+ Mgmt10+ years data engineering, 4+ years leading teams, hands-on Databricks/PostgreSQL, Python and SQL expertise, experience with data governance/security and AI-assisted engineering; BS in CS required.
Databricks, PostgreSQL, Python, SQL, Unity Catalog, Delta Lake, Spark, Apache Airflow, SQL Server, Azure, AWS, Terraform, Bicep, CloudFormation
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Poughkeepsie, New York, United States
$100k-$126k/yr OnsiteFull Time
5+ YOEFive+ years data engineering experience; Databricks and Azure data stack expertise; Python; strong data warehousing/lakehouse skills.
Databricks, Spark, Delta Lake, Azure Data Lake Storage Gen2, Databricks Workflows, CI/CD, MLOps, Python
1w
Save
Mark Applied
Hide
Director Data Engineering
New York or Chicago
$168k-$252k/yr OnsiteFull Time
Deep data engineering expertise, hands-on cloud and distributed processing experience, ability to lead teams and drive client outcomes, proficiency with SQL, Python, DBT, Spark, and cloud data platforms.
SQL, DBT, Python, Spark, PySpark, Java, JavaScript, Scala, Terraform, CloudFormation, Azure Resource Manager, Helm, Google Cloud Deployment Manager, Amazon Web Services, Microsoft Azure, Google Cloud Platform, Snowflake, Databricks, Delta Lake, OpenMetadata, DataHub, Alation, AWS Glue Catalog, Google Data Catalog, Vertex AI, Azure AI services, AWS AI services, Pi, Hermes Agent
1mo
Save
Mark Applied
Hide
Lead Data Scientist (49748)
Florham Park, New Jersey, United States
$170k/yr HybridFull Time
6+ YOEBachelor's in Computer Science (or equivalent) and 6 years' relevant experience; experience with data engineering, machine learning, deep learning, Hadoop ecosystems, databases, Python, Spark, JavaScript, Git, CI/CD tools, BI tools and enterprise data architecture.
MySQL, SQL Server, MongoDB, Hadoop, Oracle, Python, Spark, JavaScript, Git, Jira, Bitbucket, Tableau, PowerBI, Jenkins, OCP
1mo
Save
Mark Applied
Hide
Director, Data Science
East Hanover, New Jersey, United States
$195k-$312k/yr OnsiteFull Time
10+ YOEAdvanced degree in CS/Engineering/Statistics,10+ years data science experience,experience building/deploying ML models on AWS/Azure,LLM and deep learning expertise,Python/Spark/TensorFlow/PyTorch skills,pharma experience preferred.
AWS, Azure, Python, Spark, TensorFlow, PyTorch, GPT, BERT, Cohere
6h
Save
Mark Applied
Hide
Sr. Lead Software Engineer - Data Engineer
Jersey City or Boston
$171k-$260k/yr OnsiteFull Time
5+ YOERequires 5+ years of software engineering experience, advanced Python, Spark, Java, and SQL, system design, data modeling, AI/ML, agentic AI frameworks, cloud, Agile, CI/CD, and a related technical field.
Python, Java, Spark, SQL, Agentic AI, ADK, LangChain, LangGraph, AutoGen, CrewAI, CI/CD, Databricks, CockroachDB, Apache Iceberg, Trino, Spring Boot, Kafka, RESTful APIs, AWS
2w
Save
Mark Applied
Hide
Staff Data Scientist
Erlanger or Miami or White Plains
$174k-$235k/yr OnsiteFull Time
5+ YOEMaster's or PhD in a quantitative field, 5+ years data science experience, expertise in Python/R, SQL, machine learning, optimization, and production-grade software engineering practices.
Python, R, SQL, Pandas, Spark, scikit-learn, PyTorch, TensorFlow, git, Databricks, AWS, GCP, Azure, OR-Tools, Gurobi, CPLEX
1w
Save
Mark Applied
Hide
Director Data Engineering
New York or Chicago
$168k-$252k/yr HybridFull Time
Proven data engineering and distributed computing expertise, hands-on with cloud-native platforms, strong Python and SQL skills, experience leading teams, client-facing consulting experience, and ability to design AI-ready data platforms.
SQL, DBT, Python, Spark, PySpark, Java, JavaScript, Scala, Amazon Web Services, Microsoft Azure, Google Cloud Platform, Snowflake, Databricks, Terraform, CloudFormation, Azure Resource Manager, Helm, Google Cloud Deployment Manager, OpenMetadata, DataHub, Alation, AWS Glue Catalog, Google Data Catalog, Vertex AI, Azure AI services, AWS AI services, Pi, Hermes Agent
Explore Jobs