18 spark data engineer jobs at 14 companies in Newburgh, NY

1w
Save
Mark Applied
Hide
Snowflake Data Engineer
Teaneck, New Jersey, United States
OnsiteFull Time
Cognizant
CognizantNasdaq: CTSH: Provides global information technology and business process outsourcing services.
5+ YOE5+ years data engineering experience; strong Python, SQL, Spark; experience with Snowflake, DBT and AWS/Azure; exposure to real-time streaming (Kafka/Kinesis); collaborate with data science and analytics teams.
Python, SQL, Spark, AWS, Azure, Snowflake, DBT, Kafka, Kinesis
1w
Save
Mark Applied
Hide
Data Engineer
Manhattan or United States
$140k-$180k/yr RemoteFull Time
Reality Defender
Reality Defender: Detects deepfakes and AI-generated media to identify fraud.
Hands-on experience with Kubernetes and AWS, distributed computing (Spark, Ray), workflow orchestration (Airflow), Python and SQL; experience building multi-terabyte and streaming data pipelines for audio/video is preferred.
Kubernetes, AWS, Spark, Ray, Airflow, Dagster, Prefect, Luigi, Python, SQL, Golang
2mo
Save
Mark Applied
Hide
Data Engineer
Parsippany, New Jersey, United States
$151k/yr HybridFull Time
Zoetis
ZoetisNYSE: ZTS: Produces medicines and vaccines for livestock and pets.
3+ YOEMasters in CS/IT/EE; 3+ yrs data engineer; strong SQL, ETL, big data; Databricks & cloud experience; collaborate with data scientists; English fluency.
SQL, Python, Java, Scala, Databricks, Azure Data Factory, Airflow, DBT, Prefect, Hadoop, Spark, Git, Pandas, PySpark, R, Redshift, S3, Azure Storage
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Poughkeepsie, New York, United States
$100k-$126k/yr OnsiteFull Time
Hudson Valley Credit Union
Hudson Valley Credit Union: Provides consumer and commercial banking and lending services.
5+ YOEBachelor’s degree in CS or related; Master’s preferred. 5+ years of Data Engineer experience; Databricks Certifications preferred; Azure Data Engineer certification preferred; strong Python, Databricks, and data warehousing experience.
Databricks, Spark, PySpark, Scala, Delta Lake, Azure Data Lake Storage Gen2, CI/CD, ITSM, SDLC, MLOps
1w
Save
Mark Applied
Hide
Sr. Engineer, Data & Analytics
Stamford or United States
RemoteFull Time
Lovesac
LovesacNASDAQ: LOVE: Designs and sells modular furniture including sectionals and beanbags.
5+ YOEBachelor's in CS/Data/Engineering,5+ years in data engineering and analytics,expertise in Microsoft Power BI and Microsoft Fabric,SQL,Python/PySpark,DAX,Data modeling,CI/CD and stakeholder partnership.
Microsoft Power BI, Microsoft Fabric, OneLake, Microsoft Data Factory, Dataflows Gen2, Spark, SQL, Python, PySpark, Direct Lake, Git, Microsoft Purview, Databricks, Snowflake, Redshift, BigQuery, DAX, Delta Lake, Parquet
2w
Save
Mark Applied
Hide
Head of Data Engineering
Fort Lee, New Jersey, United States
$200k/yr OnsiteFull Time
TRANZACT
TRANZACT: Distributes health and life insurance policies directly to consumers.
10+ YOE4+ Mgmt10+ years data engineering, 4+ years leading teams, hands-on Databricks/PostgreSQL, Python and SQL expertise, experience with data governance/security and AI-assisted engineering; BS in CS required.
Databricks, PostgreSQL, Python, SQL, Unity Catalog, Delta Lake, Spark, Apache Airflow, SQL Server, Azure, AWS, Terraform, Bicep, CloudFormation
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Poughkeepsie, New York, United States
$100k-$126k/yr OnsiteFull Time
Hudson Valley Credit Union
Hudson Valley Credit Union: Provides personal and business banking services to members.
5+ YOEFive+ years data engineering experience; Databricks and Azure data stack expertise; Python; strong data warehousing/lakehouse skills.
Databricks, Spark, Delta Lake, Azure Data Lake Storage Gen2, Databricks Workflows, CI/CD, MLOps, Python
1w
Save
Mark Applied
Hide
Staff Data Scientist
Erlanger or Miami or White Plains
$174k-$235k/yr OnsiteFull Time
Atlas Air
Atlas Air: Global provider of outsourced aviation and logistics services.
5+ YOEMaster's or PhD in a quantitative field, 5+ years data science experience, expertise in Python/R, SQL, machine learning, optimization, and production-grade software engineering practices.
Python, R, SQL, Pandas, Spark, scikit-learn, PyTorch, TensorFlow, git, Databricks, AWS, GCP, Azure, OR-Tools, Gurobi, CPLEX
3w
Save
Mark Applied
Hide
Data Engineer I-Pathology Molecular and Cell Based Medicine
New York, New York, United States
$85k-$109k/yr OnsiteFull Time
Mount Sinai Health System
Mount Sinai Health System: Integrated academic medical system providing patient care and research.
2+ YOEBachelor's in computer science or related,2+ years development experience (Linux preferred),strong SQL/NoSQL and big‑data stack knowledge,proficiency with 2+ languages and RESTful services.
LINUX, Oracle, PostgreSQL, MYSQL, Mongo DB, Scala, Python, Java, Node JS, Django, PHP, Hadoop, Spark, Kafka, Azure, AWS, JIRA, Microsoft Office Suite
3w
Save
Mark Applied
Hide
Data Engineer I-Pathology Molecular and Cell Based Medicine
New York, New York, United States
$85k-$109k/yr OnsiteFull Time
Mount Sinai Health System
Mount Sinai Health System: Provides comprehensive hospital, clinical, and medical research services.
2+ YOEBachelor's in Computer Science or related; 2+ years development experience (Linux preferred); strong SQL/NoSQL knowledge; proficiency in 2+ languages (Scala, Python, Java); experience with REST, microservices, big-data stacks, cloud (Azure/AWS).
LINUX, Oracle, PostgreSQL, MySQL, Mongo DB, Scala, Python, Java, Node JS, Django, PHP, Hadoop, Spark, Kafka, JIRA, Azure, AWS
1mo
Save
Mark Applied
Hide
Sr Data Scientist
Stamford or Irving
$113k-$147k/yr HybridFull Time
Gartner
GartnerNYSE: IT: Provides research and advisory services for business leaders.
6+ YOE6+ years in ML engineering and product development, 2+ years deploying LLMs, experience designing agents, proficiency in Python and deep learning frameworks, strong communication and leadership skills.
Python, PyTorch, TensorFlow, Hugging Face, LangChain, LangGraph, LlamaIndex, SQL, Oracle, MongoDB, Pinecone, Weaviate, Spark, AWS, Azure ML, Model Context Protocol (MCP)
2w
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Berwyn or Princeton or Clifton
$90k-$158k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, APIs, MLOps, LLMOps, RAG
2w
Save
Mark Applied
Hide
Director, Data Architecture and Engineering
Parsippany, New Jersey, United States
$160k-$220k/yr OnsiteFull Time
GAF
GAF: Manufactures residential and commercial roofing and waterproofing products.
10+ YOEBachelor's degree,10+ years designing cloud data/analytics solutions,5+ years data architecture,3+ years GCP ingestion/ETL experience,expertise in data modeling,SQL and Python skills,leadership and stakeholder collaboration.
Google Cloud Platform, Pub/Sub, Dataflow, Cloud Data Fusion, Cloud Composer, Cloud Functions, BigQuery, GCS, LangChain, AutoGen, Vertex AI Search, AlloyDB, Tableau, SQL, Python, T-SQL, PL-SQL, Unix, C, C#, Spark, Scala
5d
Save
Mark Applied
Hide
DataOps Engineer  
Englewood Cliffs or Plano
$10k/mo OnsiteContract, Full Time
SBT Global
SBT Global: Provides integrated IT consulting and global logistics management services.
5+ YOEBachelor's in CS/IT/data field, ~5 years building and operating large-scale data platforms, production Apache Iceberg and Docker experience, Spark/Flink/Presto, Python/Ansible automation, CI/CD and observability, on-call participation, willingness to relocate from NJ to TX.
Apache Iceberg, Docker, Docker-Compose, Spark, Flink, Presto, Trino, Trivy, Snyk, Kafka, Pulsar, Kinesis, GitHub Actions, GitLab CI, Microsoft Azure DevOps, Ansible, Python, OpenTelemetry, Prometheus, Grafana, Loki, Hive Metastore, AWS Glue, Nessie, EMR, Dataproc, Synapse
2w
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Toronto or Berwyn or Princeton or Clifton
$120k-$203k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOE3+ years in data/AI engineering or related field, bachelor's degree or equivalent, experience with large-scale data pipelines, Python and SQL, AI orchestration, RAG, MLOps/LLMOps, and governance.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow
1mo
Save
Mark Applied
Hide
AVP, Credit Model Development
Chicago or Orlando or Costa Mesa or Alpharetta or Draper or Dallas or New York City or Charlotte or Stamford or Canton or West Chester
$100k-$170k/yr HybridFull Time
Synchrony
SynchronyNYSE: SYF: Provides consumer credit products and private label retail cards.
3+ YOEBachelor's in a quantitative field, 3+ years model development/validation experience (financial services preferred), 2+ years with Python, Spark, AWS SageMaker, H2O, or SAS; strong communication and model risk understanding.
Python, Spark, AWS SageMaker, H2O, SAS, Tableau, AWS
2w
Save
Mark Applied
Hide
Lead AI Security Automation Engineer
Quincy or Toronto or Boston or Princeton or Clifton or Austin
$120k-$218k/yr HybridFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
10+ YOELead and deliver enterprise-scale AI, security automation, and data platforms; 10+ years software engineering, 4+ years AI/ML/Generative AI experience, strong cloud, CI/CD, RAG and security background; Master's preferred.
Jenkins, Harness, Spinnaker, Argo CD, Python, JavaScript/TypeScript, Rust, Go (Golang), Bash, PowerShell, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, vector databases, MLOps, LLMOps
2mo
Save
Mark Applied
Hide
Feature Team Lead (Woodcliff Lake, US)
Woodcliff Lake, New Jersey, United States
$196k/yr HybridFull Time
BMW Group
BMW GroupFrankfurt Stock Exchange: BMW: Manufactures luxury automobiles, premium motorcycles, and provides financial services.
7+ YOEBachelor/Master in engineering with multiple years leading data-driven IT/projects; agile/scrum experience; strong ETL, data, cloud, and AI/ML skills.
AWS, Azure, GCP, Snowflake, Redshift, BigQuery, Spark, Hadoop, Python, Java, Scala, Tableau, Power BI, SQL, NoSQL, ETL, Data Modeling, BI Tools