Octave
Posted 1mo ago

Principal Software Developer

Octave
Houston or Madison
RemoteFull Time
Responsibilities
  • building features
  • designing systems
  • operating pipelines
Requirements
  • 5+ years in data science/ML engineering
  • 3+ years building NLP/generative AI and MLOps
  • Production experience with Python ML stack, LLMs
  • Cloud (AWS), MLOps
  • Evaluation frameworks, and strong communication skills
Technical tools mentioned
PythonPandasNumPyscikit-learnXGBoostTensorFlowPyTorchHugging Face TransformersFastAPIFlaskMLflowpytestSQLGPTClaudeLlamaPineconeWeaviateChromaDockerSageMakerBedrockS3LambdaEC2CloudWatchTableauPower BISparkDatabricksSnowflakeAirflowKubeflowDatadogPrometheusJiraLangGraphLangChainAutoGenCrewAIRAGASDeepEval

Job description

Job Description




Apply now

Principal Software Developer
Job Location (Short): 
Houston, Texas-USA | Madison, Alabama-USA
Workplace Type: 
Remote
Req Id: 
2909


Responsibilities

Position Overview

We are seeking a motivated AI/ML Engineer to build reliable, scalable systems and Generative AI and Agentic AI features, and build and deploy data-driven solutions for our document-based compliance management platform. This role requires a technical expert who can develop, deploy, and maintain ML systems in production environments.

 Key Responsibilities

 • Build and deploy Generative AI features using foundation models (AWS Bedrock, OpenAI, Anthropic Claude) and inference pipelines with optimization of latency and cost

• Design agentic AI systems that autonomously handle compliance workflows, document review, regulatory mapping, and multi-step reasoning tasks

 • Integrate comprehensive LLM evaluation frameworks with development and production systems

• Build and operate end-to-end MLOps pipelines, deployment systems, monitoring, and rollbacks workflows

 • Implement explainability frameworks (SHAP/LIME) and monitoring dashboards ensuring transparency and regulatory adherence

• Collaborate with cross-functional teams to translate business needs into ML solutions and communicate insights to stakeholders

 

#LI-PB1 LI-Remote

Education / Qualifications

Technical Skills

• Python (5+ years): Production-level experience with Pandas, NumPy, scikit-learn, XGBoost, TensorFlow/PyTorch, Hugging Face Transformers, FastAPI/Flask, MLflow, and pytest

• SQL: Advanced proficiency with complex queries, window functions, and optimization

• Machine Learning & NLP: Strong foundation in supervised/unsupervised learning, deep learning, document understanding, text classification, and semantic analysis

• Generative AI & LLMs: Hands-on experience with foundation models (GPT, Claude, Llama), prompt engineering, RAG architectures, and vector databases (Pinecone, Weaviate, Chroma)

• MLOps & ModelOps: End-to-end experience with ML pipelines, model versioning, feature stores, drift detection, CI/CD for ML, and Docker containerization

• LLM Evaluation: Experience with evaluation frameworks (RAGAS, DeepEval), custom metrics, benchmark datasets, and human-in-the-loop validation

• Cloud & AWS: Experience with AWS services including SageMaker, Bedrock, S3, Lambda, EC2, and CloudWatch

 • Statistics & Experimentation: Strong foundation in statistics, A/B testing, causal inference, and experimental design

• Visualization: Proficiency with Tableau, Power BI, or Python visualization libraries 

Experience & Education

• 5+ years in data science, ML engineering, or related roles

• 3+ years building NLP/generative AI applications and implementing MLOps in production

• Bachelor's or Master's degree in Data Science, Computer Science, Statistics, or related field

• Track record of deploying ML systems processing large-scale datasets with proper monitoring and governance 

Preferred Qualifications

• Experience with agentic AI frameworks (LangGraph, LangChain, AutoGen, CrewAI) ?

• Knowledge of Life Sciences/regulated industries (FDA, EMA, ISO, GxP) and compliance management systems

• Familiarity with big data tools (Spark, Databricks, Snowflake), orchestration (Airflow, Kubeflow), and monitoring tools (Datadog, Prometheus)

• Experience with LLM fine-tuning, document processing libraries, multi-modal AI, or distributed training

• Understanding of ML governance, bias detection, model risk management, and data privacy regulations (GDPR, CCPA, HIPAA)

• Experience working in agile environments with Jira

• AWS ML certifications or similar credentials 

Key Competencies

• Strong communication skills explaining complex models to technical and nontechnical audiences

• Ability to work independently and collaboratively in fast-paced environments

 • Proven ability to convert POCs into production-grade solutions

• Understanding of ethical AI and building trustworthy, explainable systems for regulated environments 

What You'll Build

• LLM evaluation frameworks ensuring 95%+ accuracy for compliance-critical features

• Prompts for LLMs to achieve specific, high-quality outcomes

• Agentic AI systems autonomously handling document review and compliance workflows

• GenAI document understanding features processing millions of regulatory documents

• Predictive models identifying compliance risks before they occur

• Real-time semantic search and explainable ML systems meeting regulatory requirements

• Production MLOps pipelines supporting dozens of models with automated monitoring and retraining 

Growth Opportunities

• Drive adoption of emerging AI technologies and establish best practices

• Mentor ML engineers

• Shape AI/ML roadmap and establish center of excellence for compliance AI

• Collaborate with product leadership on long-term vision for AI-powered compliance 

 

 

About Octave

Octave provides mission-critical software that empowers organizations to make informed decisions across every stage of the asset lifecycle - Design, Build, Operate and Protect - where performance, safety, and reliability are non-negotiable and failure is not an option.

Turning complex operational data into actionable intelligence, Octave connects expertise, real-world conditions and enterprise-scale insight to improve performance, resilience and incident response where it matters most.

Octave has more than 7,000 employees in 45 countries. Learn more at octave.com and follow us on LinkedIn.

Why work for Octave?

All in. Always forward. That's the way we do things around here. We put trust in our people because we believe it's the best way to unleash potential, bring ideas to life, and keep moving ahead. And it's why we're committed to creating an environment that's truly supportive, providing you with the resources you need to support your ambitions, no matter who you are or where you are in the world.

Everyone is welcome

At Octave, we believe that diverse and inclusive teams are critical to the success of our people and our business. Here, everyone is welcome. As an inclusive workplace, we don't discriminate. In fact, we embrace differences and are fully committed to creating equal opportunities, an inclusive environment, and fairness for all. 

Respect is the cornerstone of how we operate, so speak up and be yourself. You're valued here.





Recruitment Fraud Alert

Octave posts all official job opportunities on either https://careers.octave.com/ or https://www.octave.com/about/careers and communicates only from email addresses ending in @octave.com. We never request payment or personal banking information during recruitment. No offers will ever be extended without a proper interview via Teams or in person, never done over email alone. If you suspect fraud, it probably is, and contact us at [email protected]






Apply now

About Octave

Mission-critical software for industrial assets and public safety.

Year founded
2026
Employees
7200
Organization type
Private
Latest investment
Corporate Round (2026) — led by Hexagon AB
Headquarters
US

Similar jobs

Software Developer roles near Houston, Texas
6h
Save
Mark Applied
Hide
Senior Software Engineer
Houston or Houston
$70k-$103k/yr OnsiteFull Time
LTIMindtree
LTIMindtreeNational Stock Exchange of India: LTIM: Global technology consulting and digital solutions.
3+ YOERequires 3–7 years of experience, Python skills, problem-solving ability, basic programming knowledge, and capability to support requirements, development, testing, deployment, and production support.
Python
1d
Save
Mark Applied
Hide
Java Backend Software Engineer II - Databricks / PySpark / AWS
Houston, Texas, United States
OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
2+ YOE2+ years of software engineering experience with Java or Python, PySpark, Databricks, AWS, databases, REST APIs, microservices, distributed systems, and AI or machine learning integration.
Java, Python, PySpark, Databricks, AWS, AWS Lambda, Amazon S3, Amazon EC2, Amazon RDS, React, SQL, Oracle, LangChain, OpenAI APIs, GitHub Copilot, Docker, Kubernetes
1d
Save
Mark Applied
Hide
Software Developer, Software Development
Houston, Texas, United States
HybridFull Time
Ryan
Ryan: Provides business tax consulting services and specialized tax software.
2+ YOEBachelor’s degree in computer science, engineering, mathematics, or equivalent experience; 2+ years of application development experience; expertise with listed programming languages, frameworks, databases, and development tools.
C#, .NET, Java, SQL, JavaScript, HTML, CSS, T-SQL, ASP.NET Web Forms, Entity Framework, Web.API, jQuery, AngularJS, Microsoft SQL Server, IIS, Visual Studio, Java IDE, Visual Studio Code
2d
Save
Mark Applied
Hide
Staff Software Engineer, Core Infrastructure
San Francisco or Ottawa or Charlotte or Phoenix or Toronto or Los Angeles or Denver or Salt Lake City or Atlanta or Raleigh or Chicago or Houston or Portland or New York City or Vancouver or San Diego or Sacramento or Jacksonville or Seattle or Mexico City or Austin or Miami or Boston or Dallas
$145k-$275k/yr RemoteFull Time
Scribd
Scribd: Subscription-based digital library for e-books, audiobooks, and documents.
10+ YOE10+ years building backend, distributed, or data-intensive systems; production Rust and strong Python; storage and database expertise; AWS, infrastructure as code, operational excellence, technical leadership, and mentoring.
Rust, Python, Apache Arrow, Parquet, DataFusion, Amazon S3, PostgreSQL, MySQL, AWS, AWS Lambda, Amazon ECS, Amazon Aurora, Terraform, delta-rs, Claude Code
2d
Save
Mark Applied
Hide
Engineer, Software
Houston, Texas, United States
HybridFull Time
Waste Management
Waste ManagementNYSE: WM: Provides waste collection, recycling, and environmental services in North America.
3+ YOEBachelor's degree in Computer Science, MIS, or similar plus 3 years' experience, or high school diploma/GED plus 4 years' relevant experience and 3 additional years. Requires cloud, programming, containerization, database, and REST API skills.
Node.js, Python, Java, AWS Lambda, Amazon S3, Amazon SQS, Amazon SNS, Application Load Balancer (ALB), Amazon EC2, Amazon CloudWatch, API gateways, Docker, Kubernetes, Angular, Oracle, DynamoDB, REST APIs, GitHub, Artificial Intelligence, Machine Learning
2d
Save
Mark Applied
Hide
DEVELOPER L3
Houston, Texas, United States
$45k-$110k/yr OnsiteFull Time
Wipro
WiproNYSE: WIT: Global technology services and consulting for digital transformation.
4+ YOERequires 4+ years of professional software engineering experience, AI or agentic systems experience, and knowledge of distributed systems, API design, cloud infrastructure, code quality, and system design.
Java, Spring Boot, AWS, LLMs
2d
Save
Mark Applied
Hide
Senior Software Engineer - Full Stack .NET Azure Developer
Houston or Findlay or San Antonio
$107k-$184k/yr OnsiteFull Time
Marathon Petroleum
Marathon PetroleumNYSE: MPC: Refines and markets petroleum products and renewable fuels.
5+ YOEBachelor's degree in information technology or equivalent experience and 5+ years of IT experience. Requires Power Platform, Azure, integration, programming, security, ALM, CI/CD, and DevSecOps expertise.
Microsoft Power Platform, Microsoft Power Apps, Microsoft Power Automate, Microsoft Dataverse, Azure, REST APIs, JavaScript, TypeScript, C#, .NET, JSON, PCF controls, custom APIs, Dataverse plug-ins, DevSecOps, CI/CD pipelines, source control, application lifecycle management (ALM), Version Control System
2d
Save
Mark Applied
Hide
Software Engineer
Houston or Wichita
OnsiteFull Time
Koch Inc.
Koch Inc.: Operates global manufacturing, refining, and industrial technology businesses.
6+ YOERequires 6+ years of web and cloud application development, advanced React, AWS Lambda, TypeScript, Node.js, and U.S. work authorization; DynamoDB, S3, and AI tools experience required or preferred.
React, AWS Lambda, DynamoDB, Amazon S3, TypeScript, Node.js, Copilot, Claude, SQL, CDK, Serverless