6 pyspark developer jobs at 3 companies in New Bedford, MA
1mo
Save
Mark Applied
Hide
Software Test Automation Engineer
Quincy, Massachusetts, United States
HybridFull Time
5+ YOEBachelor's in Computer Science or related plus 5+ years in software test automation using cloud/big data technologies; experience with Databricks, Spark/Scala, Python/PySpark, ETL, SQL, and test automation frameworks.
Databricks, AWS, Python, PySpark, Airflow, Scala, Spark, JIRA, X-Ray, Confluence, SQL, SQL Developer, TOAD, Hive, Impala, Hadoop, HP ALM, RTC, Selenium WebDriver, Spark SQL, ETL
3w
Save
Mark Applied
Hide
Data Engineer Senior Developer, AVP
Quincy or Boston
$90k-$158k/yr OnsiteFull Time
5+ YOEExperience designing and building cloud data lake solutions using AWS/Databricks, ETL/ELT with Spark/Scala/PySpark, data modeling, and CI/CD; 5+ years software/data engineering experience.
Apache Spark, Scala, Hadoop, Hive, AWS, Databricks, Terraform, CloudFormation, Amazon S3, Glue, Lambda, EMR, Redshift, Athena, Kinesis, PL/SQL, Python, PERL, Delta Lake, Unity Catalog, Databricks Workflows, Git, CI/CD, DevOps
2w
Save
Mark Applied
Hide
Senior SIEM Data Engineer
Quincy, Massachusetts, United States
$680k-$1445k/yr HybridFull Time
8+ YOE8+ years in SIEM/security telemetry or cyber data engineering; hands-on Splunk, Cribl Stream, Databricks; experience onboarding diverse enterprise logs, data validation, troubleshooting, and mentoring; proficiency with SPL, SQL, Python/PySpark, Shell/PowerShell.
Splunk, Databricks, Cribl Stream, Fluent Bit, Fluentd, Vector, Kafka, Syslog, HEC, REST APIs, SPL, SQL, Spark SQL, Python, PySpark, Shell, PowerShell
3d
Save
Mark Applied
Hide
Software Engineering & Development
Quincy, Massachusetts, United States
$178k-$196k/yr HybridFull Time
5+ YOEBachelor's degree in computer science or related field and 5 years of software development experience. Requires Azure, Databricks, Java, ReactJS, Python, Kafka, Big Data, DevOps, and CI/CD expertise.
Microsoft Azure, Databricks, Azure Kubernetes Service (AKS), Java, Spring Boot, React JS, ReactJS, Python, PySpark, Kafka, Redis, Scala, Hadoop, J2EE, SQL, PL/SQL, HTML5, CSS3, Spark, Hive, Impala, Jenkins, Harness, Azure DevOps, TypeScript, JavaScript, Oracle, Autosys, CRON, SOAP, RESTful APIs, MQ
1mo
Save
Mark Applied
Hide
Data Engineer II
Providence, Rhode Island, United States
$104k/yr OnsiteFull Time
3+ YOEBachelor's or equivalent, 3+ years data engineering, strong SQL and Python, Databricks/Spark experience, cloud (AWS) familiarity, data modeling and ETL/ELT experience.
Databricks, Apache Spark, Delta Lake, Python, SQL, Amazon S3, Git, REST APIs, Apache Airflow, Databricks Workflows, CI/CD pipelines
1mo
Save
Mark Applied
Hide
Manager Advanced Analytics
Quincy, Massachusetts, United States
$125k-$188k/yr HybridFull Time
7+ YOE7+ years in supply chain analytics or predictive modeling; strong statistics, machine learning, optimization, simulation, and algorithm development; experience with SAS, SQL, R, Scala, Python and big data platforms; bachelor\u0002s required, advanced degree preferred.
SAS, SQL, R, Scala, Python, Microsoft Azure, Hadoop, Hive, Apache Spark, Databricks