15 spark engineer jobs at 9 companies in Fishkill, NY

3w
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Berwyn or Princeton or Clifton
$90k-$158k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, APIs, MLOps, LLMOps, RAG
3w
Save
Mark Applied
Hide
Senior AI Security Automation Engineer
Quincy or Toronto or Princeton or Boston or Clifton or Austin
$120k-$203k/yr HybridFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
7+ YOE7+ years software engineering, 3+ years building AI/ML/LLM solutions; expertise in cloud-native architectures, RAG, AI evaluation/observability, CI/CD, security, and mentoring engineers.
AWS, Azure, GCP, Jenkins, Harness, Spinnaker, Argo CD, Python, JavaScript/TypeScript, Rust, Go (Golang), Bash, PowerShell, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, vector databases
1w
Save
Mark Applied
Hide
DataOps Engineer  
Englewood Cliffs or Plano
$10k/mo OnsiteContract, Full Time
SBT Global
SBT Global: Provides integrated IT consulting and global logistics management services.
5+ YOEBachelor's in CS/IT/data field, ~5 years building and operating large-scale data platforms, production Apache Iceberg and Docker experience, Spark/Flink/Presto, Python/Ansible automation, CI/CD and observability, on-call participation, willingness to relocate from NJ to TX.
Apache Iceberg, Docker, Docker-Compose, Spark, Flink, Presto, Trino, Trivy, Snyk, Kafka, Pulsar, Kinesis, GitHub Actions, GitLab CI, Microsoft Azure DevOps, Ansible, Python, OpenTelemetry, Prometheus, Grafana, Loki, Hive Metastore, AWS Glue, Nessie, EMR, Dataproc, Synapse
1d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
Marsh McLennan
Marsh McLennanNYSE: MRSH: Global professional services firm providing risk, strategy, and people solutions.
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Poughkeepsie, New York, United States
$100k-$126k/yr OnsiteFull Time
Hudson Valley Credit Union
Hudson Valley Credit Union: Provides consumer and commercial banking and lending services.
5+ YOEBachelor’s degree in CS or related; Master’s preferred. 5+ years of Data Engineer experience; Databricks Certifications preferred; Azure Data Engineer certification preferred; strong Python, Databricks, and data warehousing experience.
Databricks, Spark, PySpark, Scala, Delta Lake, Azure Data Lake Storage Gen2, CI/CD, ITSM, SDLC, MLOps
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Poughkeepsie, New York, United States
$100k-$126k/yr OnsiteFull Time
Hudson Valley Credit Union
Hudson Valley Credit Union: Provides personal and business banking services to members.
5+ YOEFive+ years data engineering experience; Databricks and Azure data stack expertise; Python; strong data warehousing/lakehouse skills.
Databricks, Spark, Delta Lake, Azure Data Lake Storage Gen2, Databricks Workflows, CI/CD, MLOps, Python
2w
Save
Mark Applied
Hide
Sr. Engineer, Data & Analytics
Stamford or United States
RemoteFull Time
Lovesac
LovesacNASDAQ: LOVE: Designs and sells modular furniture including sectionals and beanbags.
5+ YOEBachelor's in CS/Data/Engineering,5+ years in data engineering and analytics,expertise in Microsoft Power BI and Microsoft Fabric,SQL,Python/PySpark,DAX,Data modeling,CI/CD and stakeholder partnership.
Microsoft Power BI, Microsoft Fabric, OneLake, Microsoft Data Factory, Dataflows Gen2, Spark, SQL, Python, PySpark, Direct Lake, Git, Microsoft Purview, Databricks, Snowflake, Redshift, BigQuery, DAX, Delta Lake, Parquet
3w
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Toronto or Berwyn or Princeton or Clifton
$120k-$203k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOE3+ years in data/AI engineering or related field, bachelor's degree or equivalent, experience with large-scale data pipelines, Python and SQL, AI orchestration, RAG, MLOps/LLMOps, and governance.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow
3w
Save
Mark Applied
Hide
Lead AI Security Automation Engineer
Quincy or Toronto or Boston or Princeton or Clifton or Austin
$120k-$218k/yr HybridFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
10+ YOELead and deliver enterprise-scale AI, security automation, and data platforms; 10+ years software engineering, 4+ years AI/ML/Generative AI experience, strong cloud, CI/CD, RAG and security background; Master's preferred.
Jenkins, Harness, Spinnaker, Argo CD, Python, JavaScript/TypeScript, Rust, Go (Golang), Bash, PowerShell, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, vector databases, MLOps, LLMOps
3w
Save
Mark Applied
Hide
Head of Data Engineering
Fort Lee, New Jersey, United States
$200k/yr OnsiteFull Time
TRANZACT
TRANZACT: Distributes health and life insurance policies directly to consumers.
10+ YOE4+ Mgmt10+ years data engineering, 4+ years leading teams, hands-on Databricks/PostgreSQL, Python and SQL expertise, experience with data governance/security and AI-assisted engineering; BS in CS required.
Databricks, PostgreSQL, Python, SQL, Unity Catalog, Delta Lake, Spark, Apache Airflow, SQL Server, Azure, AWS, Terraform, Bicep, CloudFormation
2mo
Save
Mark Applied
Hide
Feature Team Lead
Woodcliff Lake, New Jersey, United States
$196k-$201k/yr HybridFull Time
BMW Group
BMW GroupFrankfurt Stock Exchange: BMW: Manufactures luxury automobiles, premium motorcycles, and provides financial services.
5+ YOEBachelor's/Master's in engineering plus 5–7+ years leading data-driven IT/software projects; experience with cloud data platforms, ETL, Snowflake/Redshift/BigQuery, Spark/Hadoop, AWS/Azure/GCP, AI/ML, Python/Java/Scala, and BI tools.
Snowflake, Redshift, BigQuery, Spark, Hadoop, AWS, Azure, GCP, AWS SageMaker, Azure Machine Learning, Google AI Platform, Python, Java, Scala, SQL, NoSQL, Tableau, Power BI
2mo
Save
Mark Applied
Hide
Feature Team Lead (Woodcliff Lake, US)
Woodcliff Lake, New Jersey, United States
$196k/yr HybridFull Time
BMW Group
BMW GroupFrankfurt Stock Exchange: BMW: Manufactures luxury automobiles, premium motorcycles, and provides financial services.
7+ YOEBachelor/Master in engineering with multiple years leading data-driven IT/projects; agile/scrum experience; strong ETL, data, cloud, and AI/ML skills.
AWS, Azure, GCP, Snowflake, Redshift, BigQuery, Spark, Hadoop, Python, Java, Scala, Tableau, Power BI, SQL, NoSQL, ETL, Data Modeling, BI Tools
2w
Save
Mark Applied
Hide
Staff Data Scientist
Erlanger or Miami or White Plains
$174k-$235k/yr OnsiteFull Time
Atlas Air
Atlas Air: Global provider of outsourced aviation and logistics services.
5+ YOEMaster's or PhD in a quantitative field, 5+ years data science experience, expertise in Python/R, SQL, machine learning, optimization, and production-grade software engineering practices.
Python, R, SQL, Pandas, Spark, scikit-learn, PyTorch, TensorFlow, git, Databricks, AWS, GCP, Azure, OR-Tools, Gurobi, CPLEX
1mo
Save
Mark Applied
Hide
Sr Data Scientist
Stamford or Irving
$113k-$147k/yr HybridFull Time
Gartner
GartnerNYSE: IT: Provides research and advisory services for business leaders.
6+ YOE6+ years in ML engineering and product development, 2+ years deploying LLMs, experience designing agents, proficiency in Python and deep learning frameworks, strong communication and leadership skills.
Python, PyTorch, TensorFlow, Hugging Face, LangChain, LangGraph, LlamaIndex, SQL, Oracle, MongoDB, Pinecone, Weaviate, Spark, AWS, Azure ML, Model Context Protocol (MCP)
3w
Save
Mark Applied
Hide
Sr Data Scientist
Stamford or Irving
$113k-$147k/yr HybridFull Time
Gartner
GartnerNYSE: IT: Provides business research and advisory services to organizations.
6+ YOERequires 6–8 years of advanced ML engineering and enterprise product development, 2+ years deploying LLMs, 1+ year building agent systems, and a bachelor's degree; Python, AI frameworks, databases, and cloud experience required.
Python, PyTorch, TensorFlow, Hugging Face, LangChain, LangGraph, LlamaIndex, SQL, Oracle, MongoDB, Pinecone, Weaviate, Spark, AWS, Azure ML, Model Context Protocol (MCP)