5 inference engineer jobs at 4 companies in Winchester, VA
4w
Save
Mark Applied
Hide
Staff AI Infrastructure Engineer
Austin or Reston
HybridFull Time
8+ YOE8+ years building distributed systems and cloud-native AI infrastructure; strong Python and systems programming skills; Kubernetes, GPU inference, and platform engineering experience; leadership and architecture experience.
Python, Go, Rust, C++, vLLM, SGLang, TensorRT-LLM, Triton Inference Server, Ray Serve, Kubernetes, Helm, Argo CD, Docker, Prometheus, Grafana, OpenTelemetry, Infrastructure-as-Code, GitOps, CI/CD, AWS, Azure, Oracle Cloud Infrastructure, Google Cloud Platform
4w
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer
Austin or Reston or United States
HybridFull Time
5+ YOE5–8 years building distributed systems or cloud/platform services; production Kubernetes and ML infra experience; strong software engineering in Python and Go/Rust/C++; familiarity with GPU inference, model serving frameworks, and cloud platforms.
Kubernetes, Helm, Argo CD, Docker, Prometheus, Grafana, OpenTelemetry, Python, Go, Rust, C++, vLLM, SGLang, TensorRT-LLM, Triton Inference Server, Ray Serve, AWS, Azure, Oracle Cloud Infrastructure, Google Cloud Platform
1w
Save
Mark Applied
Hide
Model Operations Engineer
Ashburn, Virginia, United States
$108k-$179k/yr HybridFull Time
Deep ML/Ops experience deploying and monitoring ML models, building training/inference pipelines, working with cloud and container platforms, and collaborating with data science and engineering teams.
MLflow, Kubeflow, Airflow, Alibi, Grafana, AWS SageMaker, Databricks, DataRobot, Docker, AWS, Azure, GCP, Python, Scala, Java, Elastic Stack, Hadoop, Spark, Impala, MySQL, Elasticsearch, Solr, Oracle, Postgres, MongoDB, Lambda, GraphQL, PyTorch, TensorFlow, Keras, OpenCV, SimpleITK, ITK, VTK
1d
Save
Mark Applied
Hide
ML Ops Engineer
Chantilly, Virginia, United States
HybridFull Time
6+ YOEOwnership of full production ML lifecycle, model serving for low-latency inference, monitoring/drift detection, automated retraining pipelines, Kubernetes/Docker deployment, strong Python and software engineering skills.
MLflow, SageMaker, Weights & Biases, Vertex, PyTorch, TensorFlow, ONNX, Feast, Kubernetes, Docker, Helm, Prometheus, Grafana, Evidently, TorchServe, Triton, KServe, Seldon, BentoML, Apache Airflow, Kafka, Bytewax, Flink, Spark Streaming, Kafka Streams, CUDA, NVIDIA, S3, MinIO, Redshift, EKS, OpenShift, Python
4w
Save
Mark Applied
Hide
Sr. GenAI Specialist PSA , Solutions Architecture
Herndon, Virginia, United States
$154k-$208k/yr OnsiteFull Time
7+ YOE7+ years designing and operating distributed applications; 5+ years customer-facing experience building production GenAI/ML systems; hands-on LLM, RAG, agentic workflows, prompt engineering, inference optimization; experience with AWS AI/ML services.
Amazon Bedrock, SageMaker, AgentCore, Bedrock Agents, Strands Agents SDK, LangChain, OpenSearch Serverless, pgvector, Pinecone