118 spark engineer jobs at 54 companies in Needham, MA
3w
Save
Mark Applied
Hide
3w
Principal Data Engineer - Neo4J
Johnston or Phoenix or United States
OnsiteFull Time
Citizens Financial GroupNYSE: CFG: Provides retail, commercial, and private banking services to customers.
8+ YOE8+ years data engineering experience with Neo4j expertise, graph modeling and ontology design, Python proficiency, experience with big-data ecosystems (Spark, Kafka), graph performance tuning, data ingestion pipelines, and team leadership.
ManulifeTSX: MFC: Provides insurance, wealth management, and investment services globally.
5+ YOEMaster's/PhD in a quantitative field, 5+ years delivering production ML solutions, strong Python skills (Java/SQL a plus), NLP/vision/OCR experience, distributed computing (Spark/Hadoop), cloud (AWS/GCP/Azure), Docker/Kubernetes, CI/CD and MLOps.
ZoomInfoNASDAQ: GTM: Provides B2B contact data and sales intelligence software.
5+ YOE5+ years in software engineering; strong background in big data pipelines, Hadoop/Spark, JVM (Java/Scala); distributed systems; NLP experience a plus.
San Francisco or Atlanta or Austin or Boston or Chicago or Dallas or Denver or Houston or Jacksonville or Los Angeles or Miami or New York City or Phoenix or Portland or Sacramento or Salt Lake City or San Diego or Seattle or Washington, D.C. or Ottawa or Toronto or Vancouver or Mexico City
HybridFull Time
Scribd: Subscription-based digital library for e-books, audiobooks, and documents.
4+ YOE4+ years in software engineering; Python/Scala/Ruby; distributed systems; AWS; Terraform; Spark/Databricks; CS degree.
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
HumanaNYSE: HUM: Provides health insurance plans and clinical healthcare services.
10+ YOE1+ Mgmt10+ years data engineering, Bachelor’s in CS or related, strong Databricks/Delta Lake, SQL, Python, Spark, medallion lakehouse experience, 1–2 years tech lead experience; sponsorship not available.
Databricks, Delta Lake, SQL, Python, Spark, Databricks Delta Live Tables, Unity Catalog, Feature Store, Kafka, Claude, Copilot, Hire Vue, Workday
America's Test Kitchen: Provides tested recipes and reviews for home cooks.
7+ YOE7+ years software engineering with strong data engineering focus; 3+ years designing data solutions on AWS; proficiency in Python/Java/Scala; experience with Spark, Kafka, Airflow, dbt, Snowflake/Redshift/BigQuery; data modeling and streaming experience.
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
7+ YOE5+ MgmtBachelor's degree, 7+ years software engineering experience, 5+ years people management, proficiency with Python/SQL/Big Data tools, cloud-native and data engineering experience.
Arrowstreet Capital: Manages global equity portfolios using systematic quantitative models.
7+ YOE7+ years software engineering experience; 5+ years cloud (AWS preferred); strong SQL, Iceberg, Spark, Pandas/Polars; experience building mission-critical production systems; strong debugging, testing, and communication skills.
Foundation Medicine: Molecular profiling for personalized cancer treatment and research.
5+ YOEBachelor's degree and 5+ years software engineering experience; proficiency with Java/Scala/Python/Go, data pipeline tools (Airflow, Glue), Spark/Hadoop, AWS, Kafka, Docker/Kubernetes; mentoring and Agile experience.
Ashville or Atlanta or Boston or Costa Mesa or Seattle or Washington or United States
$129k-$220k/yrHybridFull Time
Anduril Industries: Defense technology building autonomous military hardware and software.
Design and implement log aggregation, ETL, and security data lake pipelines; strong programming (Go, Rust, Java, Scala); infra-as-code (Terraform, AWS CDK, Pulumi); cloud and CI/CD deployment; eligible for U.S. Top Secret clearance.
International Game Technology: Global provider of gaming, digital entertainment, and fintech solutions.
3+ YOEBachelor's or equivalent, 3+ years data engineering, strong SQL and Python, Databricks/Spark experience, cloud (AWS) familiarity, data modeling and ETL/ELT experience.
KlaviyoNYSE: KVYO: Software platform for automated e-commerce marketing and customer data.
10+ YOE10+ years building and operating distributed data systems; expertise in ingestion/CDC, stream processing, batch orchestration, lakehouse patterns, governance, SLOs, and applying AI/ML to data platforms.
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
8+ YOE8+ years software engineering experience building scalable REST APIs, microservices, Kubernetes, cloud-native data platforms, and distributed data processing using Python/Java and Spark.
REST APIs, microservices, Kubernetes, Data Warehousing, Data Lakes, Delta Lake, Python, Java, Angular, PySpark, Apache Spark, TypeScript, JavaScript, AWS S3, Lambda, API Gateway, EventBridge, Kafka, SNS, SQS, PostgreSQL, SQL Server, Aurora, DynamoDB, MongoDB, Redis, Terraform, Ansible, Jenkins, GitHub, GitLab, Bitbucket, GoCD, Databricks, Azure, Google Cloud Platform (GCP), LLMs, RAG architectures, Agentic AI
Atlanta or Austin or Boston or Charlotte or Chicago or Dallas or Denver or Detroit or Hartford or Houston or Los Angeles or Miami or Nashville or New Brunswick or New York or Raleigh or Seattle or Tampa or Washington
$90k-$147k/yrOnsiteFull Time
Slalom: Provides business and technology consulting and software engineering services.
5+ YOE5+ years data engineering experience, 2+ years building Databricks pipelines and platform features; proficiency with Spark, SQL, Python/Java, EMR/Redshift/Snowflake/BigQuery, orchestration (Airflow/dbt), and data quality tools.
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
5+ YOE5-8 years software engineering, strong data engineering and distributed systems experience; AWS, Databricks, Python, PySpark; Databricks, Spark, Kafka/RabbitMQ; SQL/NoSQL databases; CI/CD and DevOps; mentoring.
C the Signs: AI-powered clinical decision support platform for early cancer detection.
Bachelor's in CS/engineering; data engineer with big data experience; Python/Scala/Java; data warehousing/ETL/data modeling; cloud services (AWS/GCP/Azure); Spark; strong problem solving and communication.