14 pyspark data engineer jobs at 3 companies in Richmond, VA
3w
Save
Mark Applied
Hide
Lead Data Engineer (Python, PySpark, AWS)
McLean or Richmond
$179k-$225k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience; preferred Python, SQL, Scala, Java, AWS, and distributed data tools.
Python, PySpark, AWS, Java, Scala, RDBMS, NoSQL, Redshift, Snowflake, machine learning, distributed microservices, SQL, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, shell scripting, Agile
3w
Save
Mark Applied
Hide
Lead Data Engineer (Python, PySpark, AWS)
McLean or Richmond
$179k-$225k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years application development experience, 2+ years big data experience, 1+ year cloud experience (AWS/Azure/GCP); preferred: extensive Python, SQL, Scala/Java, distributed data and cloud tooling.
Python, PySpark, Java, Scala, SQL, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, AWS, Microsoft Azure, Google Cloud
3w
Save
Mark Applied
Hide
Lead Data Engineer (Python, PySpark, AWS)
McLean or Richmond
$179k-$225k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data technologies, and 1+ year of cloud computing experience. Preferred experience includes Python, distributed systems, streaming, NoSQL, and data warehousing.
Java, Scala, Python, SQL, AWS, Microsoft Azure, Google Cloud, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, Agile
3mo
Save
Mark Applied
Hide
Data Engineer, Finance Data & BI
Richmond, Virginia, United States
$107k-$178k/yr HybridFull Time
4+ YOE4+ years data engineering; experience with data warehouses, cloud platforms, ETL/ELT; Python/Java/C#; GCP preferred; CI/CD; SOX/compliance awareness; strong collaboration with Finance stakeholders.
Python, SQL, Spark, GitHub, GCP, PySpark, Matillion
2mo
Save
Mark Applied
Hide
Lead Data Engineer (Python, Scala, Spark)
McLean or Richmond
$179k-$225k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years in application development, 2+ years with big data technologies, and 1+ year with cloud computing required; preferred experience includes Python, Scala, Java, SQL, distributed systems, streaming, and data warehousing.
Python, Scala, Apache Spark, Java, SQL, Redshift, Snowflake, AWS, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, Agile
2w
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
New York City or McLean or Richmond or New York or Virginia
$179k-$246k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years in application development, 2+ years in big data, and 1+ year in cloud computing; Python, SQL, data modeling, and data engineering experience required.
Python, AWS, Apache Spark, Apache Kafka, SQL, Snowflake, Databricks, Microsoft Azure, Google Cloud, RDBMS, NoSQL, MapReduce, Hadoop, Hive, EMR, MySQL, MongoDB, Cassandra, Amazon Redshift, UNIX, Linux, Claude Code, GitHub Copilot, ETL
2w
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
New York City or McLean or Richmond or Canada or United Kingdom or Philippines
$179k-$246k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience; Python, SQL, data pipelines, and data modeling required.
Python, AWS, Apache Spark, Apache Kafka, SQL, Snowflake, Databricks, Open Source RDBMS, NoSQL, MapReduce, Hadoop, Hive, EMR, MySQL, Mongo, Cassandra, UNIX, Linux, Claude Code, GitHub Copilot, ETL, AWS Glue, Redshift
2w
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
Richmond or McLean or New York City
$179k-$246k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience. Python, SQL, data pipelines, and distributed systems expertise required.
Python, Amazon Web Services (AWS), Apache Spark, Apache Kafka, SQL, Snowflake, Databricks, Open Source RDBMS, NoSQL, MapReduce, Hadoop, Hive, Amazon EMR, MySQL, MongoDB, Apache Cassandra, Amazon Redshift, UNIX, Linux, shell scripting, AWS Glue, Claude Code, GitHub Copilot, ETL
2w
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
Richmond or McLean or New York City
$179k-$246k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years of application development, 2+ years with big data technologies, and 1+ year with cloud computing. Preferred experience includes Python, SQL, Spark, AWS, streaming, data warehousing, and AI tools.
Python, AWS, Apache Spark, Apache Kafka, SQL, Snowflake, Databricks, MapReduce, Hadoop, Apache Hive, Amazon EMR, MySQL, MongoDB, Apache Cassandra, Amazon Redshift, UNIX, Linux, Claude Code, GitHub Copilot, Microsoft Azure, Google Cloud
2w
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
McLean or New York City or Richmond or San Francisco or Philadelphia or Canada or United Kingdom or Philippines
$179k-$246k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, and 1+ year cloud computing; Python, SQL, data pipelines, and cloud technologies required.
Python, Amazon Web Services (AWS), Apache Spark, Apache Kafka, SQL, Snowflake, Databricks, Generative AI (GenAI), Open Source RDBMS, NoSQL, MapReduce, Hadoop, Hive, Amazon EMR, MySQL, Mongo, Cassandra, Redshift, UNIX, Linux, Claude Code, GitHub Copilot, AWS Glue, ETL
2w
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
McLean or New York City or Richmond
$179k-$246k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience. Preferred expertise includes Python, SQL, Spark, AWS, data warehousing, streaming, and NoSQL.
Python, AWS, Apache Spark, Apache Kafka, SQL, Snowflake, Databricks, RDBMS, NoSQL, MapReduce, Hadoop, Apache Hive, EMR, MySQL, MongoDB, Cassandra, Amazon Redshift, UNIX, Linux, Claude Code, GitHub Copilot, ETL
1mo
Save
Mark Applied
Hide
Senior Manager, Premium Support Engineer (Databolt) - Capital One Software (Remote)
Richmond or San Francisco or McLean or New York City
$209k-$286k/yr RemoteFull Time
7+ YOEBachelor's degree, 7+ years in technical account management, enterprise support, or customer-facing engineering; AWS, security, networking, IaC, programming, and enterprise data platform experience required.
Prometheus, Kubernetes, EKS, Docker, Terraform, AWS CloudFormation, Java, Python, Go, PySpark, Snowflake, Databricks, Helm, CI/CD, AWS, KMS, Secrets Manager, mTLS, JWT, OAuth, Data Loss Prevention (DLP), SPCS, Native Apps, Unity Catalog, AES-256, FPE, RBAC
1mo
Save
Mark Applied
Hide
Senior Manager, Premium Support Engineer (Databolt) - Capital One Software (Remote)
Richmond or San Francisco or McLean or New York City
$209k-$286k/yr RemoteFull Time
7+ YOEBachelor's degree; 7+ years in technical account management, enterprise support, or customer-facing engineering; 5+ years AWS and security/networking; 3+ years IaC, programming, and enterprise data platforms.
Prometheus, Kubernetes, EKS, Terraform, AWS CloudFormation, Java, Python, Go, PySpark, Snowflake, Databricks, Helm, Docker, CI/CD, AWS, KMS, Secrets Manager, mTLS, JWT, OAuth, AES-256, FPE, SPCS, Native Apps, Unity Catalog, RBAC
2mo
Save
Mark Applied
Hide
Manager III, Software Development - Content Data Platform
Austin or Bozeman or Denver or Minneapolis or Missoula or Portland or Salt Lake City or Seattle or Charlotte or Kalispell or Boise or Charleston or Dallas or Fort Worth or Phoenix or Richmond or Spokane or Vermont
$150k-$188k/yr RemoteFull Time
5+ Mgmt5+ years managing software engineers; experience building data platform/infrastructure and migration off legacy systems; hiring and team development skills; experience with data quality, SLOs, and operational reliability; US work authorization required; ability to travel.
GCP, Managed Spark, BigQuery, BigLake, Pub/Sub, Managed Airflow, Apache Iceberg, Spark, PySpark, DuckDB, dbt, Airflow, GDAL, PostGIS, Apache Sedona, DuckDB spatial extensions, Knowledge Graph, AI-assisted tools