HiringCafe
Join our community

20 inference engineer jobs at 8 companies in Virginia

1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (FM Hosting, LLM Inference)
New York or McLean or Cambridge or San Jose
$251k-$286k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
6+ YOEBachelor's in CS/AI/EE/CE or related with 6+ years (or Master's with 4+ years); 6+ years programming with Python, Go, Scala, or Java; experience deploying scalable AI systems, LLM inference, similarity search, and optimization of training/inference.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure
Job PostingView all
4w
Save
Mark Applied
Hide
Staff AI Infrastructure Engineer
Austin or Reston
HybridFull Time
Seekr
Seekr: Transparent AI platform for enterprise and government decision-making.
8+ YOE8+ years building distributed systems and cloud-native AI infrastructure; strong Python and systems programming skills; Kubernetes, GPU inference, and platform engineering experience; leadership and architecture experience.
Python, Go, Rust, C++, vLLM, SGLang, TensorRT-LLM, Triton Inference Server, Ray Serve, Kubernetes, Helm, Argo CD, Docker, Prometheus, Grafana, OpenTelemetry, Infrastructure-as-Code, GitOps, CI/CD, AWS, Azure, Oracle Cloud Infrastructure, Google Cloud Platform
Job PostingView all
1w
Save
Mark Applied
Hide
Model Operations Engineer
Ashburn, Virginia, United States
$108k-$179k/yr HybridFull Time
ManTech
ManTech: Provides technology solutions for defense and intelligence agencies.
Deep ML/Ops experience deploying and monitoring ML models, building training/inference pipelines, working with cloud and container platforms, and collaborating with data science and engineering teams.
MLflow, Kubeflow, Airflow, Alibi, Grafana, AWS SageMaker, Databricks, DataRobot, Docker, AWS, Azure, GCP, Python, Scala, Java, Elastic Stack, Hadoop, Spark, Impala, MySQL, Elasticsearch, Solr, Oracle, Postgres, MongoDB, Lambda, GraphQL, PyTorch, TensorFlow, Keras, OpenCV, SimpleITK, ITK, VTK
Job PostingView all
1d
Save
Mark Applied
Hide
ML Ops Engineer
Chantilly, Virginia, United States
HybridFull Time
Bana Solutions
Bana Solutions: Provides software engineering, cybersecurity, and data solutions for government agencies.
6+ YOEOwnership of full production ML lifecycle, model serving for low-latency inference, monitoring/drift detection, automated retraining pipelines, Kubernetes/Docker deployment, strong Python and software engineering skills.
MLflow, SageMaker, Weights & Biases, Vertex, PyTorch, TensorFlow, ONNX, Feast, Kubernetes, Docker, Helm, Prometheus, Grafana, Evidently, TorchServe, Triton, KServe, Seldon, BentoML, Apache Airflow, Kafka, Bytewax, Flink, Spark Streaming, Kafka Streams, CUDA, NVIDIA, S3, MinIO, Redshift, EKS, OpenShift, Python
Job PostingView all
3w
Save
Mark Applied
Hide
AI Integration Engineer
Annapolis Junction or McLean
$113k-$257k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
3+ YOE3+ years building production software in Python, integrating services/APIs and LLMs, implementing inference flows, writing integration tests, and knowledge of HTTP auth patterns and container/CI/CD tooling.
Python, OAuth2, JWT, Kafka, SQS, SNS, AWS Bedrock AgentCore, Google Gemini Enterprise Agent Platform, Microsoft Foundry Agent Service, Docker, Kubernetes, Redis, Postgres, LangGraph, CrewAI, AutoGen
Job PostingView all
3w
Save
Mark Applied
Hide
Sr. GenAI Specialist PSA , Solutions Architecture
Herndon, Virginia, United States
$154k-$208k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
7+ YOE7+ years designing and operating distributed applications; 5+ years customer-facing experience building production GenAI/ML systems; hands-on LLM, RAG, agentic workflows, prompt engineering, inference optimization; experience with AWS AI/ML services.
Amazon Bedrock, SageMaker, AgentCore, Bedrock Agents, Strands Agents SDK, LangChain, OpenSearch Serverless, pgvector, Pinecone
Job PostingView all
1mo
Save
Mark Applied
Hide
Research Statistician - Tracking and Estimation Theory
Charlottesville, Virginia, United States
$98k-$171k/yr OnsiteFull Time
General Atomics Aeronautical Systems
General Atomics Aeronautical Systems: Designs and manufactures unmanned aircraft and radar systems.
3+ YOEPhD preferred in statistics or related field; strong Bayesian inference, state-space modeling, sequential Monte Carlo, and time-series skills; proficiency in Python/MATLAB/R; ability to obtain and maintain DoD Top Secret/SCI clearance.
Python, MATLAB, R, C++, Java, Git
Job PostingView all
1w
Save
Mark Applied
Hide
Principal Data Scientist
Glen Allen, Virginia, United States
$200k-$300k/yr OnsiteFull Time
W. R. Berkley
W. R. BerkleyNYSE: WRB: Provides commercial property, casualty, and specialty insurance and reinsurance.
10+ YOE10+ years building and shipping production ML/AI systems; expert Python and ML engineering; experience with LLMs, MLOps, causal inference, and statistical methods; Bachelor's in quantitative field required; advanced degree preferred.
Python, NumPy, Pandas, Scikit-learn, PyTorch, TensorFlow, Hugging Face, LangChain, LlamaIndex, MLflow, Docker, Kubernetes, SQL, dbt, Spark, Databricks, Azure ML, AWS SageMaker, GCP Vertex AI, SHAP, LIME, Git
Job PostingView all

Explore Jobs

Expand Your Job Search