36 pyspark data engineer jobs at 17 companies in Fallbrook, CA
3w
Save
Mark Applied
Hide
3w
Principal, Data Engineer
Irvine or Dallas
$155k-$195k/yrOnsiteFull Time
Cotality: Provides property data, analytics, and workflow intelligence solutions.
7+ YOE7+ years IT experience, bachelor's in CS/Engineering or equivalent, expertise in cloud data platforms, Python/PySpark, data modeling, big data technologies, graph DBs, orchestration tools, and enterprise data architecture.
AWS, Google Cloud Platform (GCP), Python, PySpark, Neo4j, Google Spanner, Hadoop, Spark, Elasticsearch, Google Cloud Dataflow, Apache Beam, Apache Airflow, BMAD, Spec Kit, SQL, NoSQL
Anduril Industries: Defense technology building autonomous military hardware and software.
3+ YOE3+ years in data engineering, strong Python and SQL skills, experience with Spark/PySpark, dbt, SQLMesh, Palantir Foundry, cloud platforms (AWS/Azure/GCP), data orchestration (Flyte), and data formats (Apache Iceberg).
Cotality: Provider of property intelligence, data, and analytics solutions.
7+ YOE7+ years IT experience in data architecture; hands-on GCP, Dataflow, BigQuery, Python/PySpark, Airflow; experience with graph and SQL/NoSQL databases; strong communication and leadership skills.
Thermo Fisher ScientificNYSE: TMO: Sells equipment and chemicals for scientific research and healthcare.
4+ YOEMaster's in CS/IS (or Bachelor's +6 yrs); minimum 4 years as a Database Administrator or Data Engineer; experience with Databricks, Data lake/Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elasticsearch, Lambda, S3, RDS, MongoDB, DynamoDB, PySpark, Python, SQL, Git, Jenkins, Informatica, TCL/Unix shell, and Sybase.
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOEHands-on experience with Databricks, dbt, Python, PySpark, Spark, and SQL; 6+ years experience; proven track record in data platform migration to Databricks Lakehouse; leadership and mentoring experience.
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
2+ YOE2+ years data engineering or pipeline development; ETL and cloud/on-prem experience; Git/Atlassian, Python, SQL/GraphQL, Linux/Windows; ability to obtain Secret clearance; Bachelor's degree.
Innovatus Technology Consulting: Delivers IT infrastructure and cybersecurity services to federal defense agencies.
4+ YOEActive Secret clearance and U.S. citizenship required; Bachelor's degree or 4+ years' related experience; experience with data engineering, ETL/ELT, Apache Spark, SQL, AWS, Python, ML, and data visualization.
IntuitNASDAQ: INTU: Provides financial software for accounting, tax, and personal finance.
7+ YOE7+ years experience in data analytics/engineering, bachelor's in a quantitative field, proficiency in Java or Python, ETL/data modeling, big data frameworks, and visualization tools; strong communication skills.
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
3+ YOE3+ years data engineering/ETL experience; Databricks; programming in Python, SQL, R, JavaScript, or C++; GitHub/Atlassian; relational and non-relational databases; Linux/Windows scripting; bachelor\u0002s degree; ability to obtain Secret clearance.
CoStar GroupNASDAQ: CSGP: Global provider of commercial and residential real estate data.
5+ YOEBachelor's degree required, 5+ years data engineering experience, strong ETL/pipeline and AWS experience, Databricks/Spark, C#/.NET, SQL, CI/CD/DevOps, and experience designing scalable data platforms.
SteerBridge: Provides technology and digital transformation services for government agencies.
3+ YOE3–5 years data engineering; US citizenship; active security clearance or ability to obtain one; Bachelor’s in Computer Science; cloud or AWS data engineering experience; Python and SQL proficiency.
Edwards LifesciencesNYSE: EW: Designs and manufactures medical devices for structural heart disease.
6+ YOEBachelor's in engineering/science plus 6+ years data engineering experience; experience with Databricks and Snowflake; data governance and validation experience in regulated environments.
Databricks, Snowflake, GCP, AWS, Apache Spark, Kafka, Flink, Delta Lake, Iceberg, Airflow, dbt, HL7, FHIR, IHE
InsuletNasdaq: PODD: Manufactures wearable tubeless insulin pumps for diabetes care.
10+ YOE5+ Mgmt10+ years in data operations/platform engineering/data architecture with 5+ years as a lead administrator/architect for enterprise Databricks; expertise in Databricks, Unity Catalog, governance, security (RBAC/ABAC), Terraform, CI/CD, Python, PySpark, and SQL; Databricks admin certification preferred.
San Diego or Irvine or Los Angeles or Centennial or Las Vegas or Kansas City or Edison or Omaha
$145k-$180k/yrOnsiteFull Time
Axos FinancialNYSE: AX: Provides digital-first banking and diverse financial services to customers.
10+ YOE7+ Mgmt10+ years in data engineering leadership; SQL Server; cloud data ecosystems (GCP/AWS/Azure); Databricks and Spark; PySpark; Python; SQL; ETL/ELT tools (Fivetran, dbt); leadership and collaboration skills.
Mutual of Omaha Mortgage: Provides residential mortgage lending and refinancing services to homeowners.
3+ YOE3+ years data engineering experience with Databricks, Spark/PySpark, Python, SQL, Unity Catalog, Airflow, and MSSQL; experience operating production ETL pipelines, cost control, monitoring, and documentation in regulated environments.
Databricks, Databricks Notebooks, Databricks SQL, Delta Lake, Auto Loader, Structured Streaming, Python, PySpark, SQL, Unity Catalog, Apache Airflow, Microsoft SQL Server (MSSQL), Salesforce
Avantiico: Provider of Microsoft Dynamics implementation and business automation software.
4+ YOE4+ years with Microsoft Fabric or Azure Synapse, strong Power BI/DAX, advanced SQL and Python/PySpark, Azure Data Factory/Synapse pipelines, Git/Azure DevOps, Dynamics 365/Dataverse integration, and client-facing consulting experience.
Microsoft Fabric, Azure Synapse, Power BI, DAX, SQL, Python, PySpark, Azure Data Factory, Synapse Pipelines, Git, Azure DevOps, Microsoft Dynamics 365 Finance & Supply Chain Management, Dataverse
Richardson or San Diego or California or Texas or United States
$79k-$110k/yrOnsiteFull Time
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Databricks, PySpark, Python, Git, DevSecOps and Medallion Architecture; build and operate data platforms; Bachelor's degree or equivalent experience; US work authorization required; relocation/travel may be needed.
Databricks, PySpark, Python, Git, DevSecOps, Medallion Architecture, AI accelerators, AWS, IAM
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yrHybridFull Time
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
RivianNASDAQ: RIVN: Designs and manufactures electric vehicles and charging networks.
4+ YOEBachelor’s degree in Mechanical or Aerospace Engineering; 4+ years in automotive powertrain/energy systems; strong Python, SQL, Matlab; experience with vehicle powertrain modeling and time-series data; analytical writing and presentations.
ASMLNASDAQ: ASML: Manufactures lithography systems used to print patterns on wafers.
3+ YOEPhD (3+ yrs) or Master's (6+ yrs) in math/physics/engineering; extensive experience in physics-informed ML, model integration, data pipelines, optimization and deep learning; strong Python and software skills.
Python, PyTorch, JAX, C/C++, MATLAB, MLflow, Apache Spark, Microsoft Azure Kubernetes Service (AKS), Google Distributed Cloud Edge (GDCE), Microsoft Azure Databricks