56 spark engineer jobs at 31 companies in Cornwall, NY
3w
Save
Mark Applied
Hide
Staff Software Engineer
Livingston or New York City or Sunnyvale or San Francisco or Bellevue
$207k-$275k/yr OnsiteFull Time
10+ YOE10+ years in platform or infrastructure engineering with Kubernetes, CI/CD, IaC, observability, multi-region systems, and production ownership for high-availability services.
Spark, Airflow, Kafka, Flink, Kubernetes, Argo CD, GitHub Actions, Prometheus, Grafana, OpenTelemetry, Helm, Terraform, Pulumi
1mo
Save
Mark Applied
Hide
Senior Security Engineer (Product)
New York City or San Francisco or Seattle
$223k-$279k/yr HybridFull Time
5+ YOE5+ years security or software engineering experience, strong application and product security skills, experience with cloud and modern stacks, security reviews, incident response, and AI-native tooling.
Lacework, Python 3, TypeScript, FastAPI, SQLAlchemy, React, Postgres, Redis, AWS, Spark, Kafka, Datadog, PagerDuty, Github, Snyk, Semgrep
3w
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Berwyn or Princeton or Clifton
$90k-$158k/yr OnsiteFull Time
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, APIs, MLOps, LLMOps, RAG
4w
Save
Mark Applied
Hide
Senior Data Engineer
North Hollywood or New York
$140k-$160k/yr HybridFull Time
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
2mo
Save
Mark Applied
Hide
Senior Software Engineer - MDM / RDM & API Development
Newark, New Jersey, United States
$104k-$172k/yr HybridFull Time
Senior software engineer with experience in MDM/RDM, API development, Python/Spark/Node.js, and Agile practices.
Python, Spark, Node.js, NoSQL, Relational Databases, SQS, Kinesis, REST, JSON, SOAP, XML, JDBC, MySQL, Git, Jenkins, AWS, CloudWatch, CodeDeploy
2w
Save
Mark Applied
Hide
Data Engineer
Manhattan or United States
$140k-$180k/yr RemoteFull Time
Hands-on experience with Kubernetes and AWS, distributed computing (Spark, Ray), workflow orchestration (Airflow), Python and SQL; experience building multi-terabyte and streaming data pipelines for audio/video is preferred.
Kubernetes, AWS, Spark, Ray, Airflow, Dagster, Prefect, Luigi, Python, SQL, Golang
1w
Save
Mark Applied
Hide
Data Engineer
Whippany or New Jersey
$100k-$135k/yr HybridFull Time
6+ YOE6+ years experience, strong SQL, Python and Spark; Python expertise mandatory; hands-on AWS and/or Databricks; experience with cloud data platforms (AWS/Azure); knowledge of data modeling, governance, and metadata.
SQL, Python, Spark, AWS, Databricks, Azure
1d
Save
Mark Applied
Hide
Software Engineer [Multiple Positions Available]
Jersey City, New Jersey, United States
$152k-$185k/yr OnsiteFull Time
2+ YOEMaster's degree in information systems, computer engineering, computer science, or related field plus 2 years' experience, or bachelor's degree plus 4 years' experience. Requires Python, SQL, AWS, Spark, Terraform, Tableau, and software architecture expertise.
SQL, Python, PySpark, Spark, Amazon Web Services (AWS), Amazon EC2, Amazon S3, AWS Lambda, Amazon RDS, Amazon EKS, Amazon ECS, Amazon SQS, Amazon SNS, AWS Step Functions, Amazon API Gateway, JSON, XML, Tableau, OAuth, Terraform, ODBC, CI/CD, REST
2mo
Save
Mark Applied
Hide
Data Engineer
Jersey City or Irving or New York or Tampa
$142k-$213k/yr HybridFull Time
5+ YOE5-8 years of data engineering experience; strong ETL, data warehousing, Python, Spark; AWS Glue, Snowflake; SQL databases; project experience.
AWS Glue, AWS Athena, Airflow, Snowflake, MongoDB, Oracle, PostgreSQL, Unix Shell, Python, PySpark, Ab Initio
1w
Save
Mark Applied
Hide
DataOps Engineer
Englewood Cliffs or Plano
$10k/mo OnsiteContract, Full Time
5+ YOEBachelor's in CS/IT/data field, ~5 years building and operating large-scale data platforms, production Apache Iceberg and Docker experience, Spark/Flink/Presto, Python/Ansible automation, CI/CD and observability, on-call participation, willingness to relocate from NJ to TX.
Apache Iceberg, Docker, Docker-Compose, Spark, Flink, Presto, Trino, Trivy, Snyk, Kafka, Pulsar, Kinesis, GitHub Actions, GitLab CI, Microsoft Azure DevOps, Ansible, Python, OpenTelemetry, Prometheus, Grafana, Loki, Hive Metastore, AWS Glue, Nessie, EMR, Dataproc, Synapse
1d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
1mo
Save
Mark Applied
Hide
Data Engineer - AVP
Whippany, New Jersey, United States
$190k-$195k/yr OnsiteFull Time
Experience building Java-based data pipelines, data warehouses and lakes; strong skills in Java, Spark, Kafka, Kubernetes, OAuth2/JWT, JUnit, Mockito, GitLab/Bitbucket; experience leading technical teams and ensuring data governance and observability.
Java, Spark, Kafka, Kubernetes, OAuth2, JWT, JUnit, Mockito, GitLab, Bitbucket
2mo
Save
Mark Applied
Hide
Senior Data Engineer - PGIM Technology (Hybrid - Newark, NJ)
Newark, New Jersey, United States
$115k-$155k/yr HybridFull Time
3+ YOE3–6 years data/AI engineering experience; strong Python, SQL, Spark/PySpark; experience with data pipelines (ETL/ELT) and tools like Microsoft Fabric or Azure Data Factory; ML deployment and basic MLOps; knowledge of generative AI (embeddings, RAG).
Microsoft Fabric, Azure Data Factory, PySpark, Spark, SQL, Python, AWS Glue, REST APIs, GitHub Actions, Azure DevOps, Git
1w
Save
Mark Applied
Hide
Senior Data Engineer (Azure & Databricks)
New York, New York, United States
$149k-$190k/yr HybridFull Time
7+ YOE7-10 years data engineering experience with Databricks, Spark, Delta Lake, strong SQL and Python skills, enterprise ETL/ELT, experience with MDM, cloud data platforms, and data architecture.
Databricks, Apache Spark, Delta Lake, Python, SQL, AWS, Azure, GCP, Deltek, SAP, Oracle
1w
Save
Mark Applied
Hide
Test Developer
Charlotte or Atlanta or Newark or Plano or Dallas or Fort Worth or Jersey City or Jacksonville
$103k-$115k/yr OnsiteFull Time
2+ YOE2+ years software engineering experience; strong Python and programming skills; knowledge of test development, process design, databases, automation, and financial regulations; bachelor's degree preferred.
Spark, R, C, JAVA, YAML, Python
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Poughkeepsie, New York, United States
$100k-$126k/yr OnsiteFull Time
5+ YOEFive+ years data engineering experience; Databricks and Azure data stack expertise; Python; strong data warehousing/lakehouse skills.
Databricks, Spark, Delta Lake, Azure Data Lake Storage Gen2, Databricks Workflows, CI/CD, MLOps, Python
2w
Save
Mark Applied
Hide
Sr. Engineer, Data & Analytics
Stamford or United States
RemoteFull Time
5+ YOEBachelor's in CS/Data/Engineering,5+ years in data engineering and analytics,expertise in Microsoft Power BI and Microsoft Fabric,SQL,Python/PySpark,DAX,Data modeling,CI/CD and stakeholder partnership.
Microsoft Power BI, Microsoft Fabric, OneLake, Microsoft Data Factory, Dataflows Gen2, Spark, SQL, Python, PySpark, Direct Lake, Git, Microsoft Purview, Databricks, Snowflake, Redshift, BigQuery, DAX, Delta Lake, Parquet
2w
Save
Mark Applied
Hide
Director Data Engineering
New York or Chicago
$168k-$252k/yr OnsiteFull Time
Deep data engineering expertise, hands-on cloud and distributed processing experience, ability to lead teams and drive client outcomes, proficiency with SQL, Python, DBT, Spark, and cloud data platforms.
SQL, DBT, Python, Spark, PySpark, Java, JavaScript, Scala, Terraform, CloudFormation, Azure Resource Manager, Helm, Google Cloud Deployment Manager, Amazon Web Services, Microsoft Azure, Google Cloud Platform, Snowflake, Databricks, Delta Lake, OpenMetadata, DataHub, Alation, AWS Glue Catalog, Google Data Catalog, Vertex AI, Azure AI services, AWS AI services, Pi, Hermes Agent
2w
Save
Mark Applied
Hide
Senior Data Engineer
Newark or New York
$85k-$95k/yr OnsiteFull Time
Bachelor's in CS or equivalent; experience building AWS data lakes/warehouses and ingestion pipelines; Python, Shell, SQL; AWS services knowledge; CI/CD and streaming experience; AWS certs preferred.
Python, Shell, SQL, CloudFormation, Amazon S3, Amazon Athena, AWS Glue, Amazon EMR, Spark, Amazon RDS, Amazon Redshift, Amazon Aurora, Amazon DynamoDB, AWS Lambda, AWS Step Functions, AWS IAM, AWS KMS, AWS Secrets Manager (SM), Amazon API Gateway, Amazon SQS, Elasticsearch, Amazon Kinesis, Kafka
1mo
Save
Mark Applied
Hide
Data Engineering Lead
New York, New York, United States
$200k-$280k/yr OnsiteFull Time
15+ YOE5+ Mgmt15+ years in data engineering with 5+ years in senior leadership; deep hands-on expertise in Python, SQL, Spark/PySpark, cloud data platforms (Azure/AWS/GCP), orchestration tooling (Prefect, Airflow, dbt), enterprise security, and large-scale legacy-to-cloud migrations.
Python, SQL, Spark, PySpark, Prefect, Airflow, dbt, Azure, AWS, GCP, Azure API Management, Kong, Collibra, Atlan, Alation, Terraform, CI/CD
Explore Jobs