5 pyspark developer jobs at 3 companies in Bloomington, IL

3w
Save
Mark Applied
Hide
Senior System Software Engineer
Santa Clara or Champaign or Redmond
$184k-$357k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
9+ YOE9+ years software development experience, 5+ years data platform development, proficiency in C++, Java, Scala, CUDA; BS/MS/PhD in computer science or equivalent; experience with Apache Spark and supporting enterprise customers.
C++, CUDA, Java, Scala, Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion, RAPIDS, CCCL, UCX
2w
Save
Mark Applied
Hide
Principal Systems Software Engineer
Santa Clara or Champaign
$272k-$431k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
15+ YOE15+ years software development experience; strong C++, Java, or Scala skills; experience designing distributed systems; familiarity with Apache Spark and OSS data platform ecosystem; BS/MS/PhD in CS or related (or equivalent experience).
Java, Scala, CUDA/C++, C++, cuDF, CCCL, UCX, RAPIDS Spark, Apache Spark, Parquet, ORC, JSON, Apache Iceberg, Delta Lake, Unity Catalog, AWS EMR, Databricks, Google Dataproc, Oracle Cloud Data Flow, Bytedance Volcengine, Tencent Cloud, Cloudera, Velox, Presto, Apache Arrow, Apache DataFusion
2mo
Save
Mark Applied
Hide
MID-LEVEL DATA ENGINEER-Python, AWS, Spark (Hybrid)
Bloomington or Richardson or Tempe or Dunwoody
HybridFull Time
State Farm
State Farm: Provider of auto, home, life, and health insurance.
2+ YOE2-4 years as a Data Engineer; proficiency in Python, Spark SQL/PySpark, R, Java, Bash; hands-on AWS (ETL tools, Lambda, Step Functions, S3, DynamoDB, Kinesis, Redshift, SageMaker); Spark/Databricks; IaC (OpenTofu); CI/CD with Airflow.
Python, Apache Spark, PySpark, R, Java, Bash, AWS, Glue, EMR Serverless, Lambda, Step Functions, EventBridge, S3, DynamoDB, Kinesis Firehose, Redshift, Iceberg, SageMaker, Databricks, OpenTofu, Terraform, Airflow, SQL, Athena
2d
Save
Mark Applied
Hide
Machine Learning Engineer
Houston or Midland or Champaign or Illinois
OnsiteFull Time
Dow
DowNYSE: DOW: Manufacturer of advanced chemicals, plastics, and specialty materials.
3+ YOE3+ years ML experience, Bachelor’s degree (or 8 years relevant experience), proficiency with Databricks and Azure, Python and ML frameworks, strong ML/MLOps skills, and legal ability to work in the U.S. without sponsorship.
Azure Databricks, Databricks MLflow, Delta Lake, SQL Analytics, Databricks Model Registry, Databricks Jobs, Databricks Workspace, Python, TensorFlow, PyTorch, Scikit-learn, Spark MLlib, Ray, Databricks, SQL, Apache Spark, Hive, Azure Machine Learning, Azure Kubernetes Service, Azure Data Factory, Azure Data Lake Storage Gen2, Event Hubs, Kafka, Cosmos DB, Neo4j, SQL Server, Azure DevOps
1w
Save
Mark Applied
Hide
Lead Eventing AWS Engineer (Kafka/Kinesis)
Bloomington or Dunwoody or Richardson or Tempe
$81k-$142k/yr HybridFull Time
State Farm
State Farm: Provider of auto, home, life, and health insurance.
Design and build event-driven data pipelines, canonical data models, CDC pipelines, materialized read models, and lead lakehouse migrations using AWS and Databricks technologies.
Kafka, Kinesis, Confluent Kafka, Kinesis, SQS, SNS, EventBridge, Lambda, AWS Glue, Step Functions, DynamoDB, Neptune, RDS, OpenSearch, Aurora, Databricks Lakehouse Platform, Delta Lake, Unity Catalog, Databricks SQL, dbt, PySpark, SQL, Iceberg, Redshift, Snowflake, GitLab, Terraform, GitHub Copilot, Neo4j