34 spark data engineer jobs at 6 companies in Crewe, VA

3d
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
McLean or New York City or Richmond
$179k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, 1+ year cloud (AWS/Azure/GCP); experience with Python, SQL, Spark, data modeling, and cloud data platforms.
Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, MapReduce, Hadoop, Hive, EMR, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, AWS Glue, Claude Code, GitHub Copilot
3mo
Save
Mark Applied
Hide
Data Engineer, Finance Data & BI
Richmond, Virginia, United States
$107k-$178k/yr HybridFull Time
McKesson
McKessonNew York Stock Exchange: MCK: Distributes pharmaceuticals and provides healthcare information technology solutions.
4+ YOE4+ years data engineering; experience with data warehouses, cloud platforms, ETL/ELT; Python/Java/C#; GCP preferred; CI/CD; SOX/compliance awareness; strong collaboration with Finance stakeholders.
Python, SQL, Spark, GitHub, GCP, PySpark, Matillion
1mo
Save
Mark Applied
Hide
Data Engineer (AWS, Azure, GCP)
Richmond, Virginia, United States
$90k-$200k/yr OnsiteFull Time
CapTech
CapTech: Provides technology and management consulting services to large enterprises.
Experience delivering data solutions on AWS, Microsoft Azure, or GCP; strong SQL and scripting (Python/Java/etc.); production data pipeline and data architecture experience; ability to consult with clients and apply engineering best practices.
Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), SQL, Python, Java, R, C#, C++, SQL Server, PostgreSQL, Snowflake, Redshift, Aurora, Presto, BigQuery, Oracle, git, docker, subversion, Kubernetes, Jenkins, Spark, Databricks, Kafka, Kinesis, Hadoop, Lambda, EMR
2w
Save
Mark Applied
Hide
Principal Data Scientist
Glen Allen, Virginia, United States
$200k-$300k/yr OnsiteFull Time
W.R. Berkley Corporation
W.R. Berkley CorporationNYSE: WRB: Specialized commercial lines property and casualty insurance provider.
10+ YOE10+ years hands-on applied ML/AI engineering; bachelor\u0002s required (masters/PhD preferred); expert Python and ML frameworks; production ML, MLOps, and cloud experience; strong statistical and analytical skills.
Python, NumPy, Pandas, Scikit-learn, PyTorch, TensorFlow, Hugging Face, LangChain/LlamaIndex, MLflow, Docker, Kubernetes, SQL, dbt, Spark, Databricks, Azure ML, AWS SageMaker, GCP Vertex AI, SHAP, LIME, Git
1mo
Save
Mark Applied
Hide
Manager III, Software Development - Content Data Platform
Austin or Bozeman or Denver or Minneapolis or Missoula or Portland or Salt Lake City or Seattle or Charlotte or Kalispell or Boise or Charleston or Dallas or Fort Worth or Phoenix or Richmond or Spokane or Vermont
$150k-$188k/yr RemoteFull Time
onXmaps
onXmaps: Digital mapping and navigation apps for outdoor recreation.
5+ Mgmt5+ years managing software engineers; experience building data platform/infrastructure and migration off legacy systems; hiring and team development skills; experience with data quality, SLOs, and operational reliability; US work authorization required; ability to travel.
GCP, Managed Spark, BigQuery, BigLake, Pub/Sub, Managed Airflow, Apache Iceberg, Spark, PySpark, DuckDB, dbt, Airflow, GDAL, PostGIS, Apache Sedona, DuckDB spatial extensions, Knowledge Graph, AI-assisted tools
2w
Save
Mark Applied
Hide
Manager, Platform Architecture
Richmond, Virginia, United States
$138k-$199k/yr HybridFull Time
Altria
AltriaNYSE: MO: Manufacturer and marketer of tobac and nicotine products.
5+ YOEBachelor's in CS/IS or related;5+ years in data engineering/platform engineering with architecture ownership;3+ years architecting on Azure Databricks;expertise in Spark/PySpark, Delta Lake, Unity Catalog;strong communication.
Azure, Databricks, Apache Spark, PySpark, Delta Lake, Unity Catalog, Azure DevOps, GitHub Actions, Terraform, Databricks Asset Bundles, Microsoft Fabric