28 spark data engineer jobs at 20 companies in Brewster, NY
4w
Save
Mark Applied
Hide
Senior Data Engineer
North Hollywood or New York
$140k-$160k/yr HybridFull Time
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
2w
Save
Mark Applied
Hide
Data Engineer
Manhattan or United States
$140k-$180k/yr RemoteFull Time
Hands-on experience with Kubernetes and AWS, distributed computing (Spark, Ray), workflow orchestration (Airflow), Python and SQL; experience building multi-terabyte and streaming data pipelines for audio/video is preferred.
Kubernetes, AWS, Spark, Ray, Airflow, Dagster, Prefect, Luigi, Python, SQL, Golang
2d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
6d
Save
Mark Applied
Hide
Lead Data Engineer
New York City or United States
HybridFull Time
4+ YOERequires 4+ years in data engineering, a bachelor's or master's degree, SQL, Python, PySpark, cloud data platforms, ETL/ELT pipelines, data modeling, Airflow, cloud ecosystems, and engineering team leadership.
SQL, Python, PySpark, Snowflake, Databricks, Apache Airflow, AWS, Azure, GCP, Tableau, Microsoft Power BI, Looker, Spark, Hadoop, Hive, HBase, Kafka
1w
Save
Mark Applied
Hide
Senior Data Engineer (Azure & Databricks)
New York, New York, United States
$149k-$190k/yr HybridFull Time
7+ YOE7-10 years data engineering experience with Databricks, Spark, Delta Lake, strong SQL and Python skills, enterprise ETL/ELT, experience with MDM, cloud data platforms, and data architecture.
Databricks, Apache Spark, Delta Lake, Python, SQL, AWS, Azure, GCP, Deltek, SAP, Oracle
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Poughkeepsie, New York, United States
$100k-$126k/yr OnsiteFull Time
5+ YOEBachelor’s degree in CS or related; Master’s preferred. 5+ years of Data Engineer experience; Databricks Certifications preferred; Azure Data Engineer certification preferred; strong Python, Databricks, and data warehousing experience.
Databricks, Spark, PySpark, Scala, Delta Lake, Azure Data Lake Storage Gen2, CI/CD, ITSM, SDLC, MLOps
2w
Save
Mark Applied
Hide
Sr. Engineer, Data & Analytics
Stamford or United States
RemoteFull Time
5+ YOEBachelor's in CS/Data/Engineering,5+ years in data engineering and analytics,expertise in Microsoft Power BI and Microsoft Fabric,SQL,Python/PySpark,DAX,Data modeling,CI/CD and stakeholder partnership.
Microsoft Power BI, Microsoft Fabric, OneLake, Microsoft Data Factory, Dataflows Gen2, Spark, SQL, Python, PySpark, Direct Lake, Git, Microsoft Purview, Databricks, Snowflake, Redshift, BigQuery, DAX, Delta Lake, Parquet
1w
Save
Mark Applied
Hide
Intern - Data Engineer
Long Island City, New York, United States
$35/hr OnsiteInternship
1+ YOEDegree in related field or equivalent experience, 1–2 years relevant experience preferred, intermediate SQL and Python, exposure to cloud data warehouses and ETL, strong problem-solving and communication skills.
Google BigQuery, Snowflake, Databricks, AWS Redshift, SQL, Python, PySpark, Spark, Linux, Bash, Git, GitHub
1mo
Save
Mark Applied
Hide
Data Engineering Lead
New York, New York, United States
$200k-$280k/yr OnsiteFull Time
15+ YOE5+ Mgmt15+ years in data engineering with 5+ years in senior leadership; deep hands-on expertise in Python, SQL, Spark/PySpark, cloud data platforms (Azure/AWS/GCP), orchestration tooling (Prefect, Airflow, dbt), enterprise security, and large-scale legacy-to-cloud migrations.
Python, SQL, Spark, PySpark, Prefect, Airflow, dbt, Azure, AWS, GCP, Azure API Management, Kong, Collibra, Atlan, Alation, Terraform, CI/CD
4w
Save
Mark Applied
Hide
Head of Data Engineering
Fort Lee, New Jersey, United States
$200k/yr OnsiteFull Time
10+ YOE4+ Mgmt10+ years data engineering, 4+ years leading teams, hands-on Databricks/PostgreSQL, Python and SQL expertise, experience with data governance/security and AI-assisted engineering; BS in CS required.
Databricks, PostgreSQL, Python, SQL, Unity Catalog, Delta Lake, Spark, Apache Airflow, SQL Server, Azure, AWS, Terraform, Bicep, CloudFormation
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Poughkeepsie, New York, United States
$100k-$126k/yr OnsiteFull Time
5+ YOEFive+ years data engineering experience; Databricks and Azure data stack expertise; Python; strong data warehousing/lakehouse skills.
Databricks, Spark, Delta Lake, Azure Data Lake Storage Gen2, Databricks Workflows, CI/CD, MLOps, Python
2mo
Save
Mark Applied
Hide
Analytics Engineer, Data Science
Chicago or Austin or Baltimore or Denver or Boulder or Hartford or New Haven or Philadelphia or Providence or Miami
$118k-$173k/yr HybridFull Time
2+ YOE2-6+ years in BI/analytics/data engineering; SQL; Python/Scala; Looker/Tableau/Sigma; database fundamentals; data quality checks; strong communication; fast-paced; self-starter.
SQL, Python, Scala, Looker, Tableau, Sigma, S3, Hive, Spark, Pydeequ, Great Expectations
2w
Save
Mark Applied
Hide
Director Data Engineering
New York or Chicago
$168k-$252k/yr OnsiteFull Time
Deep data engineering expertise, hands-on cloud and distributed processing experience, ability to lead teams and drive client outcomes, proficiency with SQL, Python, DBT, Spark, and cloud data platforms.
SQL, DBT, Python, Spark, PySpark, Java, JavaScript, Scala, Terraform, CloudFormation, Azure Resource Manager, Helm, Google Cloud Deployment Manager, Amazon Web Services, Microsoft Azure, Google Cloud Platform, Snowflake, Databricks, Delta Lake, OpenMetadata, DataHub, Alation, AWS Glue Catalog, Google Data Catalog, Vertex AI, Azure AI services, AWS AI services, Pi, Hermes Agent
2w
Save
Mark Applied
Hide
Staff Data Scientist
Erlanger or Miami or White Plains
$174k-$235k/yr OnsiteFull Time
5+ YOEMaster's or PhD in a quantitative field, 5+ years data science experience, expertise in Python/R, SQL, machine learning, optimization, and production-grade software engineering practices.
Python, R, SQL, Pandas, Spark, scikit-learn, PyTorch, TensorFlow, git, Databricks, AWS, GCP, Azure, OR-Tools, Gurobi, CPLEX
4w
Save
Mark Applied
Hide
Data Engineer I-Pathology Molecular and Cell Based Medicine
New York, New York, United States
$85k-$109k/yr OnsiteFull Time
2+ YOEBachelor's in computer science or related,2+ years development experience (Linux preferred),strong SQL/NoSQL and big‑data stack knowledge,proficiency with 2+ languages and RESTful services.
LINUX, Oracle, PostgreSQL, MYSQL, Mongo DB, Scala, Python, Java, Node JS, Django, PHP, Hadoop, Spark, Kafka, Azure, AWS, JIRA, Microsoft Office Suite
4w
Save
Mark Applied
Hide
Data Engineer I-Pathology Molecular and Cell Based Medicine
New York, New York, United States
$85k-$109k/yr OnsiteFull Time
2+ YOEBachelor's in Computer Science or related; 2+ years development experience (Linux preferred); strong SQL/NoSQL knowledge; proficiency in 2+ languages (Scala, Python, Java); experience with REST, microservices, big-data stacks, cloud (Azure/AWS).
LINUX, Oracle, PostgreSQL, MySQL, Mongo DB, Scala, Python, Java, Node JS, Django, PHP, Hadoop, Spark, Kafka, JIRA, Azure, AWS
1mo
Save
Mark Applied
Hide
Sr Data Scientist
Stamford or Irving
$113k-$147k/yr HybridFull Time
6+ YOE6+ years in ML engineering and product development, 2+ years deploying LLMs, experience designing agents, proficiency in Python and deep learning frameworks, strong communication and leadership skills.
Python, PyTorch, TensorFlow, Hugging Face, LangChain, LangGraph, LlamaIndex, SQL, Oracle, MongoDB, Pinecone, Weaviate, Spark, AWS, Azure ML, Model Context Protocol (MCP)
3w
Save
Mark Applied
Hide
Sr Data Scientist
Stamford or Irving
$113k-$147k/yr HybridFull Time
6+ YOERequires 6–8 years of advanced ML engineering and enterprise product development, 2+ years deploying LLMs, 1+ year building agent systems, and a bachelor's degree; Python, AI frameworks, databases, and cloud experience required.
Python, PyTorch, TensorFlow, Hugging Face, LangChain, LangGraph, LlamaIndex, SQL, Oracle, MongoDB, Pinecone, Weaviate, Spark, AWS, Azure ML, Model Context Protocol (MCP)
3w
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Berwyn or Princeton or Clifton
$90k-$158k/yr OnsiteFull Time
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, APIs, MLOps, LLMOps, RAG
1mo
Save
Mark Applied
Hide
Data & AI Strategy - Senior Advisor
New York or Pittsburgh or Dallas or Toronto
$175k-$220k/yr HybridFull Time
8+ YOE2+ Mgmt8+ years in data engineering/architecture/analytics with 2+ years leadership; advanced Python, SQL, Spark, Databricks; experience with cloud platforms (Azure, AWS, GCP, Snowflake); consulting and executive stakeholder experience.
Azure, AWS, GCP, Snowflake, Databricks, Python, SQL, Spark, Airflow
Explore Jobs