152 spark engineer jobs at 75 companies in Berkeley, IL
3w
Save
Mark Applied
Hide
3w
Lead Software Engineer (Python, Scala, Spark, AWS)
Richmond or McLean or Chicago
$179k-$225k/yrOnsiteFull Time
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years professional software engineering, 1+ year cloud experience (AWS/Azure/GCP). Experience with Java/Scala/Python/Spark, containerization, distributed microservices, and mentoring/leading teams.
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
5+ YOE5+ years data engineering experience with ETL/ELT, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and experience with terabyte-to-petabyte datasets.
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
5+ YOE5–8 years data engineering experience with ETL/ELT design, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and Git, experience with PostgreSQL/SparkSQL/Hive/AWS Glue, and ability to mentor engineers.
AbbVieNYSE: ABBV: Develops and sells innovative pharmaceutical and biopharmaceutical medicines.
4+ YOEBSc in a quantitative field and 4 years data engineering experience; expertise with AWS data services, Spark, Python, CI/CD, data modeling, BI tools, and generative AI frameworks.
EMR Hadoop, Spark, Python, GitHub, Azure DevOps, Airflow, Autosys, S3, Glue, Athena, Lake Formation, API Gateway, Lambda, RDS, IAM, Redshift, Snowflake, Qlik, Tableau, Power BI, Langchain, Llama Index, GraphRAG
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yrRemoteFull Time
SentiLink: Provides identity verification and fraud prevention for financial institutions.
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
84.51°NYSE: KR: Provides retail data analytics and targeted advertising services.
5+ YOEBachelor's degree, 5+ years professional data development experience, Databricks/Spark and Python experience, ETL and data warehousing knowledge, Kubernetes and REST API development experience, Agile/Scrum familiarity.
Databricks: A unified platform for data analytics and artificial intelligence.
6+ YOE6+ years in data engineering or software engineering, proficiency in Python/Scala/JavaScript/TypeScript, Spark, cloud platforms, CI/CD and MLOps experience, strong customer-facing and architecture skills.
HAVI: Optimizing global supply chains for leading foodservice and retail brands.
3+ YOE3+ years data engineering with Spark on cloud, hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake), Azure Data Factory, strong SQL, data quality tooling (Great Expectations/Deequ), IaC (Terraform/Bicep), CI/CD and DevOps for data.
McDonald'sNYSE: MCD: Operate and franchise a global chain of quick-service restaurants.
5+ YOEBachelor's or Master's in CS or related,5+ years data engineering,proficient in Python and SQL,experience with data orchestration,cloud platforms,and clean room/privacy-safe data collaboration.
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
2+ YOE2+ years relevant experience; Bachelor’s in CS/Engineering/IT/MIS required; experience with R/Python/SQL, Hadoop/Spark, ETL, Linux, Git; familiarity with automation tools and AWS services; strong communication skills.
Old National BankNASDAQ: ONB: Regional financial services provider offering banking and wealth solutions.
7+ YOE7+ years data engineering experience, strong AWS/cloud and data warehouse background, expertise in SQL, Python, Spark/Databricks, leadership experience, BS in related field preferred.
fairlifeNYSE: KO: Produces nutrient-dense and ultra-filtered dairy products and shakes.
5+ YOEBachelor's degree and 5+ years data engineering experience, expert SQL and strong Python, Spark/PySpark, Azure data services, Azure DevOps, dimensional modeling, and manufacturing data experience preferred.
SQL, Python, Spark, PySpark, Azure SQL databases, Event Hubs, Functions, Data Factory, Key Vault, Microsoft Entra, Azure DevOps, Git, YAML, Delta Lake, Fabric, Databricks, KQL, Eventhouse, Application Insights, MCP, IIoT, MES
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOEReactJS frontend engineer with Azure deployment expertise plus Python, Apache Airflow, Spark on Kubernetes, Docker/Helm, CI/CD; ~6+ years experience; ReactJS 3+ years.
ReactJS, JavaScript, TypeScript, Redux, Zustand, Recoil, Material-UI, Ant Design, TailwindCSS, GraphQL, Jest, React Testing Library, Cypress, Microsoft Azure App Services, Microsoft Azure Static Web Apps, Microsoft Azure Kubernetes Service (AKS), Microsoft Azure Container Registry (ACR), Microsoft Azure Key Vault, Microsoft Azure DevOps Pipelines, Microsoft Azure Storage, Apache Airflow, Python, Spark, PySpark, Helm, Docker, kubectl, GitHub Actions
Chicago or Sydney or Shanghai or London or Singapore
$145k/yrOnsiteFull Time
Akuna Capital: Proprietary trading firm providing liquidity in global options markets.
3+ YOE3+ years in platform/cloud/SRE/DevOps roles, strong AWS and Kubernetes (EKS) experience, Terraform/IaC, Python/Bash scripting, Linux administration, CI/CD and observability expertise; Bachelor’s degree preferred.
Stripe: Provides online payment processing and financial infrastructure for businesses.
6+ YOEBachelor's degree and 6+ years software development experience; proficiency across stack with 2+ of Java, Ruby, Scala, Python, SQL; experience with Spark, IDEs, AWS, distributed systems, cloud services (gRPC, GraphQL, Docker, Kubernetes); strong engineering and collaboration skills.
Databricks Platform & Data Engineer (Plano, TX, US)
Plano or Minneapolis or Chicago or Atlanta
$135k-$247k/yrOnsiteFull Time
NTT DATA: Global provider of IT and business consulting services.
12+ YOE12+ years experience with 5+ years on Databricks; deep expertise in Apache Spark, Delta Lake, Databricks platform setup, cloud (AWS/Azure/GCP), data governance, and client-facing delivery.
DomainTools: Provides DNS-based threat intelligence and domain investigation solutions.
5+ YOE5+ years professional development with Python/Rust/Go, 3+ years with AWS/Docker/Kubernetes, Kafka, OpenSearch/Postgres/CockroachDB/Spark, Linux/Unix; strong communication and cross-team coordination.