40 spark data engineer jobs at 11 companies in Surry, VA
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
CarMaxNYSE: KMX: Operates a national network of used vehicle retail stores.
2+ YOE2+ years as Data or Software Engineer; strong Python; cloud (Azure/AWS/GCP); distributed processing (Spark); streaming/messaging (Kafka, Kinesis, Event Hubs); CI/CD; data modeling; strong ownership.
CareScout: A subsidiary of Genworth focused on simplifying the aging experience.
7+ YOE7+ years data engineering; Python, SQL, Spark; Databricks, Delta Lake; ETL/ELT design; data modeling; production pipelines; collaboration with analytics/ML teams.
McKessonNew York Stock Exchange: MCK: Distributes pharmaceuticals and provides healthcare information technology solutions.
4+ YOE4+ years data engineering; experience with data warehouses, cloud platforms, ETL/ELT; Python/Java/C#; GCP preferred; CI/CD; SOX/compliance awareness; strong collaboration with Finance stakeholders.
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
6+ YOEBachelor's degree, 6+ years application development, 2+ years big data, 1+ year cloud (AWS/Azure/GCP). Experience with Java/Scala/Python, SQL, Redshift/Snowflake, distributed tools (Hadoop, Spark, Kafka) and UNIX/Linux.
CapTech: Provides technology and management consulting services to large enterprises.
Experience delivering data solutions on AWS, Microsoft Azure, or GCP; strong SQL and scripting (Python/Java/etc.); production data pipeline and data architecture experience; ability to consult with clients and apply engineering best practices.
Des Moines or Portland or Las Vegas or Reno or Salt Lake City or Omaha or Richmond
$135k-$169k/yrOnsiteFull Time
Berkshire Hathaway Energy: Provides regulated electric and natural gas utility services.
10+ YOEBachelor's in information systems or related field; 10 years in data architecture with Azure; ETL/ELT and data modeling expertise; Databricks/Azure Pro; strong communication and problem-solving; utility industry experience.
Azure Data Factory, Azure Databricks, Delta Lake, Unity Catalog, PySpark, SQL, Spark
Phoenix Group of Virginia: Provides logistics and engineering services to the U.S. Navy.
4+ YOEExpertise in LLM/RAG engineering, production MLOps, Python data stack, cloud ML (AWS/Databricks), and DoD-compliant AI operations; U.S. citizenship and ability to obtain/hold Secret clearance.
ADVANA, Databricks, AWS SageMaker, LangChain, LangGraph, cURL, Hugging Face Transformers, Pandas, Polars, SQL, Spark, Databricks Delta Lake, Gemini, Azure ML, Google Vertex AI
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
5+ YOE5+ years in software development with Python/TypeScript, Foundry Foundry AIP, SQL/Spark, and CI/CD; experience leading a cross-functional team; ability to obtain Secret clearance; Bachelor’s in Data Science/CS/Engineering or 7+ years Palantir/engineering in lieu of degree.
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOEExperience building ETL/ELT pipelines and data platforms using SQL Server, Azure SQL, T-SQL, Python, Databricks/Spark; data modeling, performance tuning, and Azure cloud services.
Manager III, Software Development - Content Data Platform
Austin or Bozeman or Denver or Minneapolis or Missoula or Portland or Salt Lake City or Seattle or Charlotte or Kalispell or Boise or Charleston or Dallas or Fort Worth or Phoenix or Richmond or Spokane or Vermont
$150k-$188k/yrRemoteFull Time
onXmaps: Digital mapping and navigation apps for outdoor recreation.
5+ Mgmt5+ years managing software engineers; experience building data platform/infrastructure and migration off legacy systems; hiring and team development skills; experience with data quality, SLOs, and operational reliability; US work authorization required; ability to travel.
AltriaNYSE: MO: Manufacturer and marketer of tobac and nicotine products.
5+ YOEBachelor's in CS/IS or related;5+ years in data engineering/platform engineering with architecture ownership;3+ years architecting on Azure Databricks;expertise in Spark/PySpark, Delta Lake, Unity Catalog;strong communication.
Azure, Databricks, Apache Spark, PySpark, Delta Lake, Unity Catalog, Azure DevOps, GitHub Actions, Terraform, Databricks Asset Bundles, Microsoft Fabric