HiringCafe
Join our community

38 pyspark developer jobs at 29 companies in Lawrence, MA

2mo
Save
Mark Applied
Hide
Senior Software Engineer
Wakefield or Boston
$102k-$190k/yr OnsiteFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
5+ YOE5-8 years software engineering, strong data engineering and distributed systems experience; AWS, Databricks, Python, PySpark; Databricks, Spark, Kafka/RabbitMQ; SQL/NoSQL databases; CI/CD and DevOps; mentoring.
AWS, Databricks, Python, PySpark, Apache Spark, Kafka, RabbitMQ, SQL Server, MongoDB, Jenkins, GitHub, GitLab, Bitbucket, CI/CD, DevOps
Job PostingView all
2w
Save
Mark Applied
Hide
Software Test Automation Engineer
Quincy, Massachusetts, United States
HybridFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
5+ YOEBachelor's in Computer Science or related plus 5+ years in software test automation using cloud/big data technologies; experience with Databricks, Spark/Scala, Python/PySpark, ETL, SQL, and test automation frameworks.
Databricks, AWS, Python, PySpark, Airflow, Scala, Spark, JIRA, X-Ray, Confluence, SQL, SQL Developer, TOAD, Hive, Impala, Hadoop, HP ALM, RTC, Selenium WebDriver, Spark SQL, ETL
Job PostingView all
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
3d
Save
Mark Applied
Hide
Data Engineer
Durham or Boston or Princeton or Emeryville or Evanston or Evanston or New York City or Rockville
$85k-$105k/yr HybridFull Time
Beghou Consulting
Beghou Consulting: Strategic consulting and data analytics for life sciences companies.
3+ YOEBachelor's degree,3+ years data engineering experience,proficient with Python/PySpark,Databricks,AWS/Azure,relational databases,Git,CI/CD,and cloud security/IAM.
Databricks, Python, PySpark, AWS, Azure, PostgreSQL, Oracle, MySQL, Amazon Redshift, Snowflake, Git, Azure AD, Okta, OAuth, SAML, Azure Data Factory, Informatica, SnapLogic, Boomi, Docker, Kubernetes, AWS ECS, Flask, Django, JavaScript, HTML, CSS, Ajax
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Analytics Engineer
Andover, Massachusetts, United States
$130k-$165k/yr OnsiteFull Time
Rockstar Games
Rockstar Games: Creates and publishes world-class open-world video games.
5+ YOE5+ years in analytics/data engineering; strong SQL, Python, PySpark; Databricks/Azure; CI/CD; data pipelines.
Python, PySpark, SQL, Databricks, Azure, Airflow, Astronomer, TeamCity, Terraform, Github, Octopus
Job PostingView all
2w
Save
Mark Applied
Hide
Principal Data Engineer
Boston, Massachusetts, United States
$175k-$200k/yr HybridFull Time
CodaMetrix
CodaMetrix: AI platform for autonomous medical coding and revenue management.
8+ YOEDegree in CS or related,8+ years data engineering,5+ years Databricks,expert PySpark/Python,Terraform,AWS,Kafka,CI/CD,HIPAA experience and disaster recovery expertise.
Databricks, PySpark, Unity Catalog, Delta Lake, Structured Streaming, Terraform, Apache Kafka, AWS MSK, Jenkins, GitHub Actions, Python, SQL, CloudZero, AWS Cost Explorer, Tableau, S3, IAM, Secrets Manager, VPC/Private Link, HL7, FHIR, EHR, Claude, Gemini, Codex
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Development Engineer
Burlington, Massachusetts, United States
$155k-$173k/yr HybridFull Time
Signify
SignifyEuronext Amsterdam: LIGHT: Manufactures lighting products and connected IoT lighting systems.
3+ YOEMaster's in CS/CE/IS (required) plus 3+ years experience; 2+ years building microservices, distributed systems, cloud (AWS/Azure/Google Cloud), Kubernetes, CI/CD, Java, Python, Spark, Kafka/Kinesis, Maven, Jenkins.
Kubernetes, AWS, Microsoft Azure, Google Cloud, CI/CD, Java, Python, Apache Spark, Apache Kafka, AWS Kinesis, Maven, Jenkins
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Nashua, New Hampshire, United States
OnsiteFull Time
Amphenol
AmphenolNYSE: APH: Manufactures electronic and fiber optic connectors and interconnect systems.
3+ YOEBS in a relevant field, 3+ years data engineering experience, strong SQL, Python/PySpark, ETL/ELT, cloud data platform experience (Microsoft Fabric/Azure/Databricks/Snowflake), data modeling, data quality, orchestration, and ability to work with stakeholders; travel as required.
SQL, Python, PySpark, notebooks, Microsoft Fabric, Azure Data Lake, Azure Data Factory, Azure SQL, Synapse, Databricks, Snowflake, Power BI, DAX, Git, SharePoint, MES, PLM, QMS
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Nashua, New Hampshire, United States
OnsiteFull Time
Amphenol
AmphenolNYSE: APH: Designs and manufactures electrical connectors and interconnect systems.
3+ YOEBS in a computing field required, 3+ years data engineering experience; strong SQL, Python/PySpark, ETL/ELT, cloud data platform experience (Microsoft Fabric, Azure, Databricks, Snowflake); data modeling, data quality, orchestration, and collaboration skills; travel as required.
SQL, Python, PySpark, notebooks, Microsoft Fabric, Azure Data Lake, Azure Data Factory, Synapse, Databricks, Snowflake, Azure SQL, Power BI, DAX, Git, SharePoint, ERP, MES, PLM, QMS
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. Business Applications Developer
Burlington, Massachusetts, United States
$120k-$140k/yr OnsiteFull Time
LeMaitre Vascular
LeMaitre VascularNASDAQ: LMAT: Designs and manufactures medical devices for vascular surgery.
7+ YOEBachelor's/Master's in computer science or related; 7+ years Power BI and Microsoft cloud data experience; 3+ years Copilot configuration; SQL, DAX, PySpark, Power Query (M) proficiency; strong communication and documentation skills.
Microsoft Power BI, Git, Microsoft Azure DevOps, SQL, DAX, PySpark, Microsoft Power Query (M), Microsoft Dataverse, Microsoft Azure, Microsoft Fabric, RESTful API, Copilot Studio, Microsoft Copilot, On-Premises Data Gateway, Data Lake Storage, Fabric Notebooks
Job PostingView all
1w
Save
Mark Applied
Hide
Software Engineer
Boston or San Francisco or New York City or Paris or London
$90k-$120k/yr RemoteFull Time
Traackr
Traackr: SaaS platform for managing and scaling influencer marketing programs.
2+ YOE2+ years backend engineering experience, strong programming and debugging skills, SQL and data modeling, Git and CI/CD experience, familiarity with AI coding assistants, and strong communication.
Claude Code, SQL, Git, CI/CD, Databricks, Apache Spark, Docker, Kubernetes, MLflow, Airflow, Kubeflow, Argo, Dagster, Terraform, Ansible, Grafana, Elasticsearch, Lucene, GraphQL, scikit-learn, TensorFlow, PyTorch
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Business Intelligence Engineer
Boston, Massachusetts, United States
$150k-$185k/yr HybridFull Time
WilmerHale
WilmerHale: Global law firm providing comprehensive legal representation services.
3+ YOE3+ years in data analysis/warehousing, hands-on Microsoft Fabric, Power BI, T-SQL, DAX, Azure Data Factory and notebook transformations (Python/PySpark); CI/CD and DevOps experience; strong analytical and communication skills.
Microsoft Fabric, Power BI, DAX, SQL, T-SQL, Python, PySpark, Azure Data Factory, MSSQL, Microsoft SharePoint, Microsoft Excel, Microsoft Dev Ops, SSIS, SSAS, SSRS, Azure Keyvault, Azure Logic Apps, Azure Storage Accounts, SQL Server, CI/CD, ITIL
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Software Engineer
Boston, Massachusetts, United States
HybridFull Time
Verisk
VeriskNasdaq: VRSK: Provides data analytics and risk assessment for global insurance.
5+ YOEBS in CS/Math/Stats; MS/PhD preferred; 5+ years software eng; senior/lead on AWS cloud; strong Python; ML frameworks; production ML systems; AWS AI services; data pipelines; SQL; CI/CD; REST/microservices; Agile.
Python, C#/.NET, AWS, SageMaker, S3, Glue, Athena, Lambda, EC2, CloudWatch, Docker, Kubernetes, Apache Spark, Airflow, dbt, SQL, PostgreSQL, MSSQL, REST API
Job PostingView all
1mo
Save
Mark Applied
Hide
Machine Learning Engineer
Manchester, New Hampshire, United States
OnsiteFull Time
DEKA Research & Development
DEKA Research & Development: Designs and develops advanced medical and robotic technologies.
6+ YOEM.S. in CS/AI, 6+ years backend/distributed systems experience, strong Java (Spring Boot, Spring MVC, Hibernate) and Python skills, production ML (PyTorch), Apache Kafka/Spark/ZooKeeper, databases (Oracle, IBM Db2, MSSQL, MongoDB), cloud (AWS).
Java, Spring Boot, Spring MVC, Hibernate, Python, PyTorch, Apache Kafka, Apache Spark, ZooKeeper, REST, SOAP, Oracle, IBM Db2, MSSQL, MongoDB, AWS
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Software Engineer, Agent Platform
Boston, Massachusetts, United States
$148k-$222k/yr HybridFull Time
Klaviyo
KlaviyoNYSE: KVYO: Software platform for automated e-commerce marketing and customer data.
5+ YOE5+ years backend software engineering, distributed systems, production ML/AI, Python, collaboration, learning mindset.
Python, Apache Spark, Ray, AWS, Terraform, Kubernetes, Huggingface, PyTorch, TensorFlow, Keras, LangChain, OpenAI, Bedrock, vLLM
Job PostingView all
1d
Save
Mark Applied
Hide
Data Engineering Quality Engineer
Dallas or Merrimack or Jersey City
$69k-$153k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
6+ YOE6+ years quality engineering experience; strong SQL, Python, and API testing; ETL/ELT and BI validation; automation and CI/CD experience; Bachelor's degree in computer science or related field.
Playwright, RestAssured, Karate, Cucumber, TestNG, Oracle, PostgreSQL, DB2, SQL, PL/SQL, Python, GitHub, Jenkins, Maven, Docker, SonarQube, AWS, Azure, Google Cloud, Snowflake, Databricks, Apache Spark, Hadoop, Jira
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead AI/ML Engineer-Remote Nationwide or Hybrid in MN/DC
Boston or Minneapolis or Washington or United States
$146k-$250k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
3+ YOEBachelor's+6 yrs or Master's+4 yrs or PhD+3 yrs in AI/ML engineering; 3+ yrs hands-on ML/Generative AI and production Python; 2+ yrs RAG/vector DB experience; MLOps on Azure/AWS; GitHub and CI/CD experience.
Python, FastAPI, REST, RAG, LangChain, LangGraph, vector databases, Databricks, PySpark, Spark, Azure, AWS, GitHub, CI/CD, MLOps, LLMs
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
Job PostingView all
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products and services.
0+ YOEDegree in data-related field, experience with data engineering/ETL, proficiency in SQL and Python, experience with Azure and Databricks, strong problem-solving and communication; must be eligible to work in the US without sponsorship.
Azure Synapse, Data Factory, ADLS, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Power BI, GitHub, Azure DevOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products to individuals and businesses.
0+ YOEDegree in Data Science/Computer Science or related, experience in data engineering/ETL/data modeling (levels 0–5+ years), proficiency in SQL and Python, experience with Azure cloud platforms preferred, strong problem-solving and communication, US work authorization required.
Azure Synapse, Data Factory, ADLS, Data Lake, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Microsoft Power BI, GitHub, Azure DevOps, Azure
Job PostingView all

Explore Jobs

Expand Your Job Search