11 spark data engineer jobs at 8 companies in Fishkill, NY
2w
Save
Mark Applied
Hide
Sr. Engineer, Data & Analytics
Stamford or United States
RemoteFull Time
5+ YOEBachelor's in CS/Data/Engineering,5+ years in data engineering and analytics,expertise in Microsoft Power BI and Microsoft Fabric,SQL,Python/PySpark,DAX,Data modeling,CI/CD and stakeholder partnership.
Microsoft Power BI, Microsoft Fabric, OneLake, Microsoft Data Factory, Dataflows Gen2, Spark, SQL, Python, PySpark, Direct Lake, Git, Microsoft Purview, Databricks, Snowflake, Redshift, BigQuery, DAX, Delta Lake, Parquet
3w
Save
Mark Applied
Hide
Head of Data Engineering
Fort Lee, New Jersey, United States
$200k/yr OnsiteFull Time
10+ YOE4+ Mgmt10+ years data engineering, 4+ years leading teams, hands-on Databricks/PostgreSQL, Python and SQL expertise, experience with data governance/security and AI-assisted engineering; BS in CS required.
Databricks, PostgreSQL, Python, SQL, Unity Catalog, Delta Lake, Spark, Apache Airflow, SQL Server, Azure, AWS, Terraform, Bicep, CloudFormation
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Poughkeepsie, New York, United States
$100k-$126k/yr OnsiteFull Time
5+ YOEFive+ years data engineering experience; Databricks and Azure data stack expertise; Python; strong data warehousing/lakehouse skills.
Databricks, Spark, Delta Lake, Azure Data Lake Storage Gen2, Databricks Workflows, CI/CD, MLOps, Python
2w
Save
Mark Applied
Hide
Staff Data Scientist
Erlanger or Miami or White Plains
$174k-$235k/yr OnsiteFull Time
5+ YOEMaster's or PhD in a quantitative field, 5+ years data science experience, expertise in Python/R, SQL, machine learning, optimization, and production-grade software engineering practices.
Python, R, SQL, Pandas, Spark, scikit-learn, PyTorch, TensorFlow, git, Databricks, AWS, GCP, Azure, OR-Tools, Gurobi, CPLEX
1mo
Save
Mark Applied
Hide
Sr Data Scientist
Stamford or Irving
$113k-$147k/yr HybridFull Time
6+ YOE6+ years in ML engineering and product development, 2+ years deploying LLMs, experience designing agents, proficiency in Python and deep learning frameworks, strong communication and leadership skills.
Python, PyTorch, TensorFlow, Hugging Face, LangChain, LangGraph, LlamaIndex, SQL, Oracle, MongoDB, Pinecone, Weaviate, Spark, AWS, Azure ML, Model Context Protocol (MCP)
3w
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Berwyn or Princeton or Clifton
$90k-$158k/yr OnsiteFull Time
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, APIs, MLOps, LLMOps, RAG
1w
Save
Mark Applied
Hide
DataOps Engineer
Englewood Cliffs or Plano
$10k/mo OnsiteContract, Full Time
5+ YOEBachelor's in CS/IT/data field, ~5 years building and operating large-scale data platforms, production Apache Iceberg and Docker experience, Spark/Flink/Presto, Python/Ansible automation, CI/CD and observability, on-call participation, willingness to relocate from NJ to TX.
Apache Iceberg, Docker, Docker-Compose, Spark, Flink, Presto, Trino, Trivy, Snyk, Kafka, Pulsar, Kinesis, GitHub Actions, GitLab CI, Microsoft Azure DevOps, Ansible, Python, OpenTelemetry, Prometheus, Grafana, Loki, Hive Metastore, AWS Glue, Nessie, EMR, Dataproc, Synapse
3w
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Toronto or Berwyn or Princeton or Clifton
$120k-$203k/yr OnsiteFull Time
3+ YOE3+ years in data/AI engineering or related field, bachelor's degree or equivalent, experience with large-scale data pipelines, Python and SQL, AI orchestration, RAG, MLOps/LLMOps, and governance.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow
2w
Save
Mark Applied
Hide
Lead AI Security Automation Engineer
Quincy or Toronto or Boston or Princeton or Clifton or Austin
$120k-$218k/yr HybridFull Time
10+ YOELead and deliver enterprise-scale AI, security automation, and data platforms; 10+ years software engineering, 4+ years AI/ML/Generative AI experience, strong cloud, CI/CD, RAG and security background; Master's preferred.
Jenkins, Harness, Spinnaker, Argo CD, Python, JavaScript/TypeScript, Rust, Go (Golang), Bash, PowerShell, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, vector databases, MLOps, LLMOps
2mo
Save
Mark Applied
Hide
Feature Team Lead
Woodcliff Lake, New Jersey, United States
$196k-$201k/yr HybridFull Time
5+ YOEBachelor's/Master's in engineering plus 5–7+ years leading data-driven IT/software projects; experience with cloud data platforms, ETL, Snowflake/Redshift/BigQuery, Spark/Hadoop, AWS/Azure/GCP, AI/ML, Python/Java/Scala, and BI tools.
Snowflake, Redshift, BigQuery, Spark, Hadoop, AWS, Azure, GCP, AWS SageMaker, Azure Machine Learning, Google AI Platform, Python, Java, Scala, SQL, NoSQL, Tableau, Power BI
2mo
Save
Mark Applied
Hide
Feature Team Lead (Woodcliff Lake, US)
Woodcliff Lake, New Jersey, United States
$196k/yr HybridFull Time
7+ YOEBachelor/Master in engineering with multiple years leading data-driven IT/projects; agile/scrum experience; strong ETL, data, cloud, and AI/ML skills.
AWS, Azure, GCP, Snowflake, Redshift, BigQuery, Spark, Hadoop, Python, Java, Scala, Tableau, Power BI, SQL, NoSQL, ETL, Data Modeling, BI Tools