16 pyspark developer jobs at 5 companies in Glen Allen, VA

3w
Save
Mark Applied
Hide
Lead Software Engineer - Python + PySpark
Richmond or McLean or Cambridge
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
4+ YOE1+ MgmtBachelor’s degree, 4+ years of software engineering experience, and 1+ year of cloud computing experience. Preferred: 7+ years in listed languages, people management, Agile, and open-source frameworks.
JavaScript, Java, HTML/CSS, TypeScript, SQL, Python, Go, RDBMS, NoSQL, Docker, Kubernetes, AWS, Microsoft Azure, Google Cloud, GCP, PySpark
1mo
Save
Mark Applied
Hide
Lead Data Engineer (Python, PySpark, AWS)
McLean or Richmond
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience; preferred Python, SQL, Scala, Java, AWS, and distributed data tools.
Python, PySpark, AWS, Java, Scala, RDBMS, NoSQL, Redshift, Snowflake, machine learning, distributed microservices, SQL, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, shell scripting, Agile
1mo
Save
Mark Applied
Hide
Lead Data Engineer (Python, PySpark, AWS)
McLean or Richmond
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years application development experience, 2+ years big data experience, 1+ year cloud experience (AWS/Azure/GCP); preferred: extensive Python, SQL, Scala/Java, distributed data and cloud tooling.
Python, PySpark, Java, Scala, SQL, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, AWS, Microsoft Azure, Google Cloud
1d
Save
Mark Applied
Hide
Python Developer
Richmond, Virginia, United States
$90k-$190k/yr HybridFull Time
CapTech
CapTech: Provides technology and management consulting services to large enterprises.
5+ YOERequires 5+ years of software development, strong Python, Java/C#/.NET, REST APIs, microservices, AI/ML, databases, cloud environments, Git, SDLC, and client-facing communication skills.
Python, Java, C#, .NET, Git, Databricks, Apache Spark, OpenAI, Azure OpenAI, Anthropic, Google Gemini, LangChain, LangGraph, Semantic Kernel, LlamaIndex, Pinecone, Azure AI Search, Weaviate, Milvus, pgvector, Azure, AWS, GCP, Docker, Kubernetes, SQL, PostgreSQL, SQL Server, MongoDB, Kafka, Snowflake
3w
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
McLean or New York City or Richmond
$179k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience. Preferred expertise includes Python, SQL, Spark, AWS, data warehousing, streaming, and NoSQL.
Python, AWS, Apache Spark, Apache Kafka, SQL, Snowflake, Databricks, RDBMS, NoSQL, MapReduce, Hadoop, Apache Hive, EMR, MySQL, MongoDB, Cassandra, Amazon Redshift, UNIX, Linux, Claude Code, GitHub Copilot, ETL
1w
Save
Mark Applied
Hide
Lead Software Engineer, DevOps
New York City or Richmond
$179k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
4+ YOEBachelor's degree, 4+ years of DevOps engineering, 3+ years of cloud-native technologies, and 4+ years of Unix or Linux administration experience. Coding, scripting, and cloud expertise required.
Java, Python, SQL, Ruby, Go, Docker, Kubernetes, Ansible, Terraform, Amazon Web Services, Microsoft Azure, Google Cloud Platform, Unix, Linux, JavaScript, Golang, Bash, Perl, Apache Mesos, Marathon, Apache Spark, Jenkins, Cassandra, ElasticSearch
1w
Save
Mark Applied
Hide
Lead Software Engineer, DevOps
New York City or Richmond
$215k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years of DevOps engineering, 3+ years of cloud-native technologies, and 4+ years of Unix or Linux system administration experience.
Java, Python, SQL, Ruby, Go, Docker, Kubernetes, Ansible, Terraform, Amazon Web Services, Microsoft Azure, Google Cloud Platform, Unix, Linux, JavaScript, Golang, Bash, Perl, Apache Mesos, Marathon, Apache Spark, Jenkins, Cassandra, ElasticSearch
1w
Save
Mark Applied
Hide
Lead Software Engineer, DevOps
Richmond, Virginia, United States
$179k-$205k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree and 4+ years of DevOps engineering, 3+ years of cloud-native technology, and 4+ years of Unix or Linux administration experience required.
Java, Python, SQL, Ruby, Go, Docker, Kubernetes, Ansible, Terraform, Amazon Web Services, Microsoft Azure, Google Cloud Platform, Unix, Linux, JavaScript, Golang, Bash, Perl, Apache Mesos, Marathon, Apache Spark, Jenkins, Cassandra, ElasticSearch
1w
Save
Mark Applied
Hide
Lead Software Engineer, DevOps
Richmond, Virginia, United States
$179k-$205k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
4+ YOEBachelor’s degree, 4+ years of DevOps engineering, 3+ years with cloud-native technologies, and 4+ years of Unix or Linux system administration experience.
Java, Python, SQL, Ruby, Go, Docker, Kubernetes, Ansible, Terraform, Amazon Web Services, Microsoft Azure, Google Cloud Platform, Unix, Linux, JavaScript, Golang, Bash, Perl, Apache Mesos, Marathon, Apache Spark, Jenkins, Cassandra, ElasticSearch
1mo
Save
Mark Applied
Hide
Senior Manager, Premium Support Engineer (Databolt) - Capital One Software (Remote)
Richmond or San Francisco or United States or McLean or New York
$209k-$239k/yr RemoteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
7+ YOEBachelor's degree, 7+ years technical account/customer-facing engineering experience, 5+ years with AWS (EKS, KMS, Secrets Manager), 5+ years security/networking, 3+ years IaC (Terraform, CloudFormation), 3+ years Java/Python/Go/PySpark and Snowflake/Databricks experience.
AWS, EKS, KMS, Secrets Manager, Terraform, AWS CloudFormation, Kubernetes, Prometheus, Docker, Helm, Java, Python, Go, PySpark, Snowflake, Databricks
3w
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
New York City or McLean or Richmond or New York or Virginia
$179k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
4+ YOEBachelor's degree, 4+ years in application development, 2+ years in big data, and 1+ year in cloud computing; Python, SQL, data modeling, and data engineering experience required.
Python, AWS, Apache Spark, Apache Kafka, SQL, Snowflake, Databricks, Microsoft Azure, Google Cloud, RDBMS, NoSQL, MapReduce, Hadoop, Hive, EMR, MySQL, MongoDB, Cassandra, Amazon Redshift, UNIX, Linux, Claude Code, GitHub Copilot, ETL
3w
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
Richmond or McLean or New York City
$179k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
4+ YOEBachelor's degree, 4+ years of application development, 2+ years with big data technologies, and 1+ year with cloud computing. Preferred experience includes Python, SQL, Spark, AWS, streaming, data warehousing, and AI tools.
Python, AWS, Apache Spark, Apache Kafka, SQL, Snowflake, Databricks, MapReduce, Hadoop, Apache Hive, Amazon EMR, MySQL, MongoDB, Apache Cassandra, Amazon Redshift, UNIX, Linux, Claude Code, GitHub Copilot, Microsoft Azure, Google Cloud
3mo
Save
Mark Applied
Hide
Data Engineer, Finance Data & BI
Richmond, Virginia, United States
$107k-$178k/yr HybridFull Time
McKesson
McKessonNew York Stock Exchange: MCK: Distributes pharmaceuticals and provides healthcare information technology solutions.
4+ YOE4+ years data engineering; experience with data warehouses, cloud platforms, ETL/ELT; Python/Java/C#; GCP preferred; CI/CD; SOX/compliance awareness; strong collaboration with Finance stakeholders.
Python, SQL, Spark, GitHub, GCP, PySpark, Matillion
1mo
Save
Mark Applied
Hide
Senior Manager, Premium Support Engineer (Databolt) - Capital One Software (Remote)
Richmond or San Francisco or McLean or New York City
$209k-$286k/yr RemoteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
7+ YOEBachelor's degree, 7+ years in technical account management, enterprise support, or customer-facing engineering; AWS, security, networking, IaC, programming, and enterprise data platform experience required.
Prometheus, Kubernetes, EKS, Docker, Terraform, AWS CloudFormation, Java, Python, Go, PySpark, Snowflake, Databricks, Helm, CI/CD, AWS, KMS, Secrets Manager, mTLS, JWT, OAuth, Data Loss Prevention (DLP), SPCS, Native Apps, Unity Catalog, AES-256, FPE, RBAC
2mo
Save
Mark Applied
Hide
Manager III, Software Development - Content Data Platform
Austin or Bozeman or Denver or Minneapolis or Missoula or Portland or Salt Lake City or Seattle or Charlotte or Kalispell or Boise or Charleston or Dallas or Fort Worth or Phoenix or Richmond or Spokane or Vermont
$150k-$188k/yr RemoteFull Time
onXmaps
onXmaps: Digital mapping and navigation apps for outdoor recreation.
5+ Mgmt5+ years managing software engineers; experience building data platform/infrastructure and migration off legacy systems; hiring and team development skills; experience with data quality, SLOs, and operational reliability; US work authorization required; ability to travel.
GCP, Managed Spark, BigQuery, BigLake, Pub/Sub, Managed Airflow, Apache Iceberg, Spark, PySpark, DuckDB, dbt, Airflow, GDAL, PostGIS, Apache Sedona, DuckDB spatial extensions, Knowledge Graph, AI-assisted tools
1w
Save
Mark Applied
Hide
DIRECTOR OF DATA AND ANALYTICS
Richmond, Virginia, United States
$160k-$200k/yr OnsiteFull Time
Carter Machinery
Carter Machinery: Sales and service of Caterpillar heavy equipment and machinery.
7+ YOE7+ MgmtBachelor's or master's degree or equivalent experience; 7+ years of data leadership; expertise in Microsoft Fabric, SQL Server, Snowflake, migrations, ETL/ELT, APIs, AI modeling, FinOps, and team development; driver's license required.
Microsoft Fabric, OneLake, Lakehouse, Warehouse, Delta Parquet, SQL Server, Snowflake, Microsoft Azure Synapse, Databricks, REST, GraphQL, Fabric Data Factory, Dataflows Gen2, PySpark, Direct Lake, Microsoft Copilot, Anthropic Claude, Dynamics 365