46 pyspark developer jobs at 32 companies in Pawtucket, RI

2mo
Save
Mark Applied
Hide
Senior Software Engineer
Wakefield or Boston
$102k-$190k/yr OnsiteFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
5+ YOE5-8 years software engineering, strong data engineering and distributed systems experience; AWS, Databricks, Python, PySpark; Databricks, Spark, Kafka/RabbitMQ; SQL/NoSQL databases; CI/CD and DevOps; mentoring.
AWS, Databricks, Python, PySpark, Apache Spark, Kafka, RabbitMQ, SQL Server, MongoDB, Jenkins, GitHub, GitLab, Bitbucket, CI/CD, DevOps
4w
Save
Mark Applied
Hide
Software Test Automation Engineer
Quincy, Massachusetts, United States
HybridFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
5+ YOEBachelor's in Computer Science or related plus 5+ years in software test automation using cloud/big data technologies; experience with Databricks, Spark/Scala, Python/PySpark, ETL, SQL, and test automation frameworks.
Databricks, AWS, Python, PySpark, Airflow, Scala, Spark, JIRA, X-Ray, Confluence, SQL, SQL Developer, TOAD, Hive, Impala, Hadoop, HP ALM, RTC, Selenium WebDriver, Spark SQL, ETL
2mo
Save
Mark Applied
Hide
Senior Software Engineer
Wakefield or Boston
$102k-$190k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
5+ YOE5-8 years of software engineering experience; strong data engineering expertise; Databricks, Python, PySpark, Spark; AWS (S3/Glue/Athena/Lambda); Kafka/RabbitMQ; SQL Server/MongoDB; CI/CD; Azure/GCP; Generative AI exposure; experience in large-scale data platforms.
Databricks, Python, PySpark, Apache Spark, AWS, S3, Glue, Athena, Lambda, Kafka, RabbitMQ, SQL Server, MongoDB, Jenkins, GitHub, GitLab, Bitbucket, CI/CD, DevOps, Delta Lake, Azure, GCP, LLM, Generative AI
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
1mo
Save
Mark Applied
Hide
Lead Development Engineer
Burlington, Massachusetts, United States
$155k-$173k/yr HybridFull Time
Signify
SignifyEuronext Amsterdam: LIGHT: Manufactures lighting products and connected IoT lighting systems.
3+ YOEMaster's in CS/CE/IS (required) plus 3+ years experience; 2+ years building microservices, distributed systems, cloud (AWS/Azure/Google Cloud), Kubernetes, CI/CD, Java, Python, Spark, Kafka/Kinesis, Maven, Jenkins.
Kubernetes, AWS, Microsoft Azure, Google Cloud, CI/CD, Java, Python, Apache Spark, Apache Kafka, AWS Kinesis, Maven, Jenkins
3w
Save
Mark Applied
Hide
Principal Data Engineer
Boston, Massachusetts, United States
$175k-$200k/yr HybridFull Time
CodaMetrix
CodaMetrix: AI platform for autonomous medical coding and revenue management.
8+ YOEDegree in CS or related,8+ years data engineering,5+ years Databricks,expert PySpark/Python,Terraform,AWS,Kafka,CI/CD,HIPAA experience and disaster recovery expertise.
Databricks, PySpark, Unity Catalog, Delta Lake, Structured Streaming, Terraform, Apache Kafka, AWS MSK, Jenkins, GitHub Actions, Python, SQL, CloudZero, AWS Cost Explorer, Tableau, S3, IAM, Secrets Manager, VPC/Private Link, HL7, FHIR, EHR, Claude, Gemini, Codex
1mo
Save
Mark Applied
Hide
Sr. Business Applications Developer
Burlington, Massachusetts, United States
$120k-$140k/yr OnsiteFull Time
LeMaitre Vascular
LeMaitre VascularNASDAQ: LMAT: Develops and manufactures devices for peripheral vascular surgery.
7+ YOE7+ years Power BI and cloud data platform experience; strong SQL, DAX, PySpark, Power Query (M); Bachelor’s in CS or related; excellent communication; CI/CD and Git/Azure DevOps experience.
Power BI, DAX, Power Query (M), Git, Azure DevOps, SQL, Microsoft Dataverse, Azure, Data Lake Storage, Fabric, PySpark, RESTful API, Microsoft Copilot, Copilot Studio, Fabric Notebooks, On-Premises Data Gateway
23h
Save
Mark Applied
Hide
Senior Data Science Engineer
Boston or United States
$121k-$151k/yr RemoteFull Time
DraftKings
DraftKingsNASDAQ: DKNG: Provide online sports betting, fantasy sports, and casino gaming.
3+ YOEBachelor’s degree in a quantitative field, 3+ years building production machine learning or analytics solutions, and strong Python, pandas, NumPy, and PySpark proficiency.
Python, pandas, NumPy, PySpark
3w
Save
Mark Applied
Hide
Software Engineer
Boston or San Francisco or New York City or Paris or London
$90k-$120k/yr RemoteFull Time
Traackr
Traackr: SaaS platform for managing and scaling influencer marketing programs.
2+ YOE2+ years backend engineering experience, strong programming and debugging skills, SQL and data modeling, Git and CI/CD experience, familiarity with AI coding assistants, and strong communication.
Claude Code, SQL, Git, CI/CD, Databricks, Apache Spark, Docker, Kubernetes, MLflow, Airflow, Kubeflow, Argo, Dagster, Terraform, Ansible, Grafana, Elasticsearch, Lucene, GraphQL, scikit-learn, TensorFlow, PyTorch
1mo
Save
Mark Applied
Hide
Senior Business Intelligence Engineer
Boston, Massachusetts, United States
$150k-$185k/yr HybridFull Time
WilmerHale
WilmerHale: Global law firm providing comprehensive legal representation services.
3+ YOE3+ years in data analysis/warehousing, hands-on Microsoft Fabric, Power BI, T-SQL, DAX, Azure Data Factory and notebook transformations (Python/PySpark); CI/CD and DevOps experience; strong analytical and communication skills.
Microsoft Fabric, Power BI, DAX, SQL, T-SQL, Python, PySpark, Azure Data Factory, MSSQL, Microsoft SharePoint, Microsoft Excel, Microsoft Dev Ops, SSIS, SSAS, SSRS, Azure Keyvault, Azure Logic Apps, Azure Storage Accounts, SQL Server, CI/CD, ITIL
3mo
Save
Mark Applied
Hide
Senior Software Engineer
Boston, Massachusetts, United States
HybridFull Time
Verisk
VeriskNasdaq: VRSK: Provides data analytics and risk assessment for global insurance.
5+ YOEBS in CS/Math/Stats; MS/PhD preferred; 5+ years software eng; senior/lead on AWS cloud; strong Python; ML frameworks; production ML systems; AWS AI services; data pipelines; SQL; CI/CD; REST/microservices; Agile.
Python, C#/.NET, AWS, SageMaker, S3, Glue, Athena, Lambda, EC2, CloudWatch, Docker, Kubernetes, Apache Spark, Airflow, dbt, SQL, PostgreSQL, MSSQL, REST API
6d
Save
Mark Applied
Hide
Principal Software Engineer, Configuration Platform
United States or Boston
$180k-$368k/yr RemoteFull Time
Toast
ToastNYSE: TOST: Cloud-based technology platform for the restaurant and hospitality industry.
Requires experience delivering mission-critical production services at scale, owning high-throughput distributed systems, defining technical strategy, and mentoring senior engineering talent.
Kotlin, Java, Dropwizard, Amazon Web Services (AWS), Amazon DynamoDB, Amazon RDS, AWS Lambda, PostgreSQL, Apache Spark, React, ES6, Apache Pulsar, RabbitMQ, Android
2d
Save
Mark Applied
Hide
Machine Learning Engineer II
Richardson or Boston or Plantation or Bellevue
$120k-$190k/yr OnsiteFull Time
Chewy
ChewyNYSE: CHWY: Online retailer of pet food, supplies, and veterinary services.
3+ YOEMaster's degree in computer science, machine learning, or related field; 3+ years' machine learning engineering experience; Python, SQL, machine learning frameworks, relational databases, and cloud technologies.
Python, TensorFlow, PyTorch, scikit-learn, SQL, AWS, AWS Glue, Amazon SageMaker, Amazon Athena, Amazon Redshift, Azure, Google Cloud Platform, Apache Spark, Apache Iceberg, dbt, Tableau, Streamlit, Plotly
1d
Save
Mark Applied
Hide
Machine Learning Engineer II
New York City or Cambridge
$140k-$180k/yr OnsiteFull Time
Kensho
Kensho: Developing AI and machine learning for financial data analysis.
3+ YOEBachelor's degree or higher in computer science, engineering, or related field; 3+ years of hands-on machine learning, NLP, and information retrieval experience; strong Python proficiency and production ML lifecycle experience.
Python, LangGraph, pydanticAI, Transformers, HuggingFace, LightGBM, PyTorch, SKLearn, XGBoost, Jupyter, Matplotlib, Pandas, Weights & Biases, Langfuse, Apache Spark, AWS Athena, DVC, LabelBox, OpenSearch, Postgres/Pgvector, S3, SQLite, Arize, Airflow, AWS, DeepSpeed, Docker, Grafana, Jenkins, LangFuse, LiteLLM, Ray, vLLM, Claude Code, FastAPI, Streamlit, Gradio
1d
Save
Mark Applied
Hide
Machine Learning Engineer II
New York City or Cambridge
$140k-$180k/yr OnsiteFull Time
S&P Global
S&P GlobalNYSE: SPGI: Provides financial data, analytics, and credit ratings worldwide.
3+ YOEBachelor's degree or higher in computer science, engineering, or related field; 3+ years of hands-on machine learning, NLP, and information retrieval experience; strong Python and production ML lifecycle experience.
Python, LangGraph, pydanticAI, Transformers, HuggingFace, LightGBM, PyTorch, SKLearn, XGBoost, Jupyter, Matplotlib, Pandas, Weights & Biases, Langfuse, Apache Spark, AWS Athena, DVC, LabelBox, OpenSearch, Postgres, Pgvector, S3, SQLite, Arize, Airflow, AWS, DeepSpeed, Docker, Grafana, Jenkins, LangFuse, LiteLLM, Ray, vLLM, Claude Code, FastAPI, Streamlit, Gradio
1d
Save
Mark Applied
Hide
Machine Learning Engineer II
New York City or Cambridge
$140k-$180k/yr OnsiteFull Time
S&P Global
S&P GlobalNYSE: SPGI: Provides independent credit ratings, market benchmarks, and financial analytics.
3+ YOEBachelor's degree in computer science, engineering, or related field; 3+ years of hands-on machine learning, NLP, and information retrieval experience; strong Python and production ML lifecycle experience.
Python, LangGraph, pydanticAI, Transformers, HuggingFace, LightGBM, PyTorch, SKLearn, XGBoost, Jupyter, Matplotlib, Pandas, Weights & Biases, Langfuse, Apache Spark, AWS Athena, DVC, LabelBox, OpenSearch, Postgres/Pgvector, S3, SQLite, Arize, Airflow, AWS, DeepSpeed, Docker, Grafana, Jenkins, LiteLLM, Ray, vLLM, Claude Code, FastAPI, Streamlit, Gradio
23h
Save
Mark Applied
Hide
Principal Data Engineer / Solution Architect Fabric
New York City or Boston
FieldFull Time, Contract
Fusemachines
FusemachinesNASDAQ: FUSE: Provides enterprise AI products, consulting, and talent development services.
8+ YOE8+ years in data engineering or architecture; advanced Microsoft Fabric, Azure, SQL, Python/PySpark, ADLS Gen2, and Databricks Unity Catalog expertise; regulated life sciences experience required.
Microsoft Fabric, Microsoft Fabric Data Factory, Azure Data Factory (ADF), Microsoft SQL, Python, PySpark, Databricks Unity Catalog, Azure Data Lake Storage Gen2 (ADLS Gen2)
2mo
Save
Mark Applied
Hide
Senior Software Engineer, Agent Platform
Boston, Massachusetts, United States
$148k-$222k/yr HybridFull Time
Klaviyo
KlaviyoNYSE: KVYO: Software platform for automated e-commerce marketing and customer data.
5+ YOE5+ years backend software engineering, distributed systems, production ML/AI, Python, collaboration, learning mindset.
Python, Apache Spark, Ray, AWS, Terraform, Kubernetes, Huggingface, PyTorch, TensorFlow, Keras, LangChain, OpenAI, Bedrock, vLLM
1mo
Save
Mark Applied
Hide
Lead AI/ML Engineer-Remote Nationwide or Hybrid in MN/DC
Boston or Minneapolis or Washington or United States
$146k-$250k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
3+ YOEBachelor's+6 yrs or Master's+4 yrs or PhD+3 yrs in AI/ML engineering; 3+ yrs hands-on ML/Generative AI and production Python; 2+ yrs RAG/vector DB experience; MLOps on Azure/AWS; GitHub and CI/CD experience.
Python, FastAPI, REST, RAG, LangChain, LangGraph, vector databases, Databricks, PySpark, Spark, Azure, AWS, GitHub, CI/CD, MLOps, LLMs
1mo
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java