Johns Hopkins University
Posted 4mo ago

Assistant Research Engineer - Computer Vision The VectorCam Project

Johns Hopkins University
Baltimore, Maryland, United States
$65k-$85k/yrOnsiteFull Time
Responsibilities
  • designing models
  • optimizing models
  • managing datasets
Requirements
  • Master's in CS/ML/CV or related
  • Strong computer vision and deep learning experience
  • PyTorch/TensorFlow and Python proficiency
  • Edge deployment experience
  • Dataset and experiment management
  • Strong statistical and evaluation skills
Technical tools mentioned
EfficientNetYOLOVision TransformersTensorFlow LitePyTorch MobileONNXPyTorchTensorFlowPythonWeights & BiasesOpenCVHuggingFaceGoogle's ML KitAndroid

Job description

General Description

The Johns Hopkins Center for Bioengineering Innovation & Design (CBID) in the Department of Biomedical Engineering is seeking an Assistant Research Engineer to lead computer vision and AI development for the VectorCam platform. VectorCam is an AI-enabled mobile imaging system designed to allow community health workers to identify mosquito species in real time, enabling faster vector surveillance and improved malaria control strategies. This role will serve as the technical lead for computer vision and image analysis within the project, responsible for designing and iterating on machine learning architectures, managing training pipelines and datasets, and optimizing models for deployment across edge and cloud environments. The successful candidate will work at the intersection of computer vision, edge AI deployment, mobile imaging systems, and global health field implementation. The role requires someone who is highly experimental and curious, constantly exploring new model architectures and approaches while pushing the performance and reliability of the AI system. The ideal candidate will also demonstrate strong attention to detail in data management and data science practices, and be able to clearly articulate the probability, statistics, and evaluation methods used when defending model design choices and performance claims.

Department: Johns Hopkins Center for Bioengineering Innovation & Design (CBID), Department of Biomedical Engineering, Whiting School of Engineering

 Location & Duration: Baltimore, MD, USA (in-person job)

 Reports to: Dr. Soumyadipta Acharya (Principal Investigator)

Key Responsibilities

Lead the design, training, and evaluation of computer vision models for mosquito identification and other relevant projects in vector-borne diseases. Develop and maintain a scalable training and evaluation pipeline for image classification and detection models. Continuously explore and evaluate new architectures, training approaches, and optimization strategies to improve model accuracy and robustness. Design and maintain systems for dataset management, ensuring training, validation, and test datasets remain clean, versioned, and traceable. Maintain high standards of data organization and reproducibility across experiments and training pipelines. Develop strategies for deploying models across mobile edge devices and cloud infrastructure. Optimize models for inference on smartphones and other resource-constrained platforms. Work closely with software engineers to integrate models into the Android application and imaging pipeline. Investigate and troubleshoot performance issues related to camera systems, imaging conditions, and device variability. Develop benchmarking and evaluation methods to continuously monitor model performance across deployments. Apply statistical reasoning when evaluating model performance and clearly communicate the statistical basis for model improvements and algorithmic decisions. Collaborate with entomologists and field teams to improve data collection, labeling, and training dataset quality. Contribute to publications and presentations describing algorithm development and system performance.

Technical Focus Areas
Computer Vision and Model Development: Design and train deep learning models for insect classification and morphological recognition. Experiment with architectures such as EfficientNet, YOLO, Vision Transformers, and other modern computer vision models to determine optimal approaches for the application. Develop strategies for handling limited datasets, noisy data, and challenging real-world image conditions.

Model Optimization for Edge Deployment: Optimize models for deployment on smartphones using frameworks such as TensorFlow Lite, PyTorch Mobile, or ONNX. Investigate quantization, pruning, and other model optimization techniques to ensure efficient inference on resource-constrained devices. Ensure models perform consistently across different smartphone cameras and hardware configurations.

AI Data Pipeline and Dataset Management: Develop systems for dataset versioning, experiment tracking, and model reproducibility. Ensure that training, validation, and testing datasets are well organized, auditable, and traceable. Maintain clear documentation of dataset lineage and experiment configurations. Build workflows that support continuous model retraining as new field data becomes available.

System Architecture for AI Deployment: Design the architecture for managing model updates, versioning, and deployment across edge devices and cloud platforms. Develop strategies for monitoring model performance and maintaining reliability across large-scale field deployments.

Project Impact
VectorCam aims to transform how mosquito surveillance is conducted in malaria-endemic regions by enabling rapid and accurate species identification directly in the field. By improving the speed and accessibility of entomological surveillance, this technology has the potential to strengthen malaria control programs and support more targeted vector control interventions. This role offers the opportunity to work on a globally impactful technology while solving challenging problems at the intersection of computer vision, edge AI, and public health innovation.

Qualifications

Qualifications
Master's degree in Computer Science, Machine Learning, Computer Vision, Software Engineering, or a related field. Strong background in computer vision and deep learning. Experience training and evaluating computer vision models using frameworks such as PyTorch or TensorFlow. Strong understanding of probability, statistics, and model evaluation methods, with the ability to clearly explain the reasoning behind model choices and performance metrics. Experience working with image datasets, data pipelines, and model evaluation methodologies. Experience deploying machine learning models to edge devices or mobile platforms. Strong programming skills in Python and experience with machine learning development environments. Strong attention to detail in data management, experiment tracking, and dataset organization. Ability to independently explore technical approaches and rapidly prototype solutions. Interest in applying AI systems to real-world global health challenges.

Preferred Experience
Experience with model deployment on Android devices or mobile platforms. Experience with experiment tracking tools such as Weights & Biases, OpenCV, HuggingFace, Google's ML Kit or similar systems. Experience working with image datasets collected in real-world environments. Experience with edge AI optimization techniques such as quantization or pruning. Experience contributing to applied machine learning research or technical publications.

Application Instructions

Click on the link and apply today!

Salary Range

The referenced salary range represents the minimum and maximum salaries for this position and is based on Johns Hopkins University's good faith belief at the time of posting. Not all candidates will be eligible for the upper end of the salary range. The actual compensation offered to the selected candidate may vary and will ultimately depend on multiple factors, which may include the successful candidate's geographic location, skills, work experience, internal equity, market conditions, education/training and other factors, as reasonably determined by the University.

Total Rewards

Johns Hopkins offers a total rewards package that supports our employees' health, life, career and retirement. More information can be found here: https://hr.jhu.edu/benefits-worklife/.

Equal Opportunity Employer

The Johns Hopkins University is committed to equal opportunity for its faculty, staff, and students. To that end, the university does not discriminate on the basis of sex, gender, marital status, pregnancy, race, color, ethnicity, national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status or other legally protected characteristics. The university is committed to providing qualified individuals access to all academic and employment programs, benefits and activities on the basis of demonstrated ability, performance and merit without regard to personal factors or demographic characteristics that are irrelevant to the program involved.

Pre-Employment Information

If you are interested in applying for employment with Johns Hopkins University and require special assistance or accommodation during any part of the pre-employment process, please contact the HR Business Services Office at [email protected]. For TTY users, call via Maryland Relay or dial 711. For more information about workplace accommodations at Johns Hopkins University for disabilities, medical conditions (including medical conditions related to pregnancy or childbirth), accessibility, or religious reasons, please visit accessibility.jhu.edu.

Background Checks

After receiving a conditional offer, the successful candidate(s) for this position will be subject to a pre-employment background check including education verification. When deciding whether a candidate's conviction history is job-disqualifying, the University considers the nature and gravity of the offense, the time that has passed since the conviction, and the nature of the job being sought.

EEO is the Law

https://www.eeoc.gov/employees-job-applicants

Vaccine Requirements

Johns Hopkins University strongly encourages, but no longer requires, at least one dose of the COVID-19 vaccine. This change does not apply to the School of Medicine (SOM). SOM hires must be fully vaccinated with an FDA COVID-19 vaccination and provide proof of vaccination status. We still require all faculty, staff, and students to receive the seasonal flu vaccine.

Exceptions to the seasonal flu vaccine or COVID-19 vaccine (for SOM) requirement(s) may be provided to individuals with sincerely held religious beliefs or medical conditions that preclude them from receiving the vaccine. Requests for an exception must be submitted to the JHU vaccination registry. For additional information, applicants for SOM positions should visit https://www.hopkinsmedicine.org/coronavirus/covid-19-vaccine/ and all other JHU applicants should visit https://covidinfo.jhu.edu/health-safety/covid-vaccination-information/.

The following additional vaccine requirements may apply, depending upon your campus. Please contact the hiring department for more information.

The pre-employment physical for positions in clinical areas, laboratories, working with research subjects, or involving community contact requires documentation of immune status against Rubella (German measles), Rubeola (Measles), Mumps, Varicella (chickenpox), Hepatitis B and documentation of having received the Tdap (Tetanus, diphtheria, pertussis) vaccination. This may include documentation of having two (2) MMR vaccines; two (2) Varicella vaccines; or antibody status to these diseases from laboratory testing. Blood tests for immunities to these diseases are ordinarily included in the pre-employment physical exam except for those candidates who provide results of blood tests or immunization documentation from their own health care providers. Any vaccinations required for these diseases will be given at no cost in our Occupational Health office.

About Johns Hopkins University

Private research university providing higher education and conducting research.

Year founded
1876
Employees
27300
Organization type
Non-Profit
Headquarters
US

Similar jobs

Research Engineer roles near Baltimore, Maryland
5d
Save
Mark Applied
Hide
Research Engineer - New Grad (2027)
Sunnyvale or Washington, D.C. or San Diego or Fort Walton Beach or Ann Arbor or London or Stuttgart or Munich or Stockholm or Bangalore or Seoul or Tokyo
$140k-$200k/yr OnsiteFull Time
Applied Intuition
Applied Intuition: Developing software and simulation infrastructure for autonomous vehicles.
Recent MSc or PhD graduate in machine learning, computer vision, autonomy, robotics, or related field; experience with Python, PyTorch, computer vision, robotics, and distributed model training.
Python, PyTorch
6d
Save
Mark Applied
Hide
Lead Research Engineer, Search & Retrieval
New York City or Frisco or Toronto or Ann Arbor or Eagan or San Francisco or Los Angeles or Irvine or McLean or Washington
$137k-$255k/yr HybridFull Time
Thomson Reuters
Thomson ReutersNASDAQ: TRI: Provides professional software, data, and news services globally.
7+ YOEBachelor's or master's in computer science, engineering, or related field; 7+ years building production software; search and retrieval expertise; Python, AWS, OpenSearch or Vespa, distributed systems, and technical leadership.
OpenSearch, Vespa, Elasticsearch, Solr, Lucene, Python, AWS, Kafka, RAG, A/B tests
2w
Save
Mark Applied
Hide
Research Engineer
Reston, Virginia, United States
$109k-$147k/yr HybridFull Time
Verisign
VerisignNASDAQ: VRSN: Provides internet domain name registry and DNS infrastructure services.
5+ YOEResearch software engineer with 5+ years software development (Bachelor's) or 3+ with Master's; experience in systems research, prototype development, publications, C/C++/Java/Python, SQL/NoSQL; research or network security experience preferred.
C, C++, Java, Python, SQL, NoSQL, *nix
1mo
Save
Mark Applied
Hide
Research Engineer
Aberdeen Proving Ground, Maryland, United States
$100k-$150k/yr OnsiteFull Time
Science and Technology Corporation
Science and Technology Corporation: Provides scientific, engineering, and technical services to government agencies.
5+ YOEU.S. citizen with ability to obtain DoD Secret, bachelor’s in engineering/materials science/physics, 5+ years vehicle testing experience, lab and field test planning, strong analysis and communication skills.
1mo
Save
Mark Applied
Hide
Research Engineer I/II/III/IV/V/VI - Washington D.C.
Washington, District of Columbia, United States
OnsiteFull Time
Auburn University
Auburn University: Public land-grant research university providing higher education and research.
Bachelor's in engineering required; experience levels vary by grade (0–10 years). Skills: NLP, LLMs, RAG, model training/deployment, APIs, SQL/NoSQL, cloud (AWS/Microsoft), React/Next.js.
Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), React, Next.js, SQL, NoSQL, AWS, Microsoft Azure, vector databases
1mo
Save
Mark Applied
Hide
Research Engineer I/II/III/IV/V/VI - Washington D.C.
Washington, District of Columbia, United States
$50k-$186k/yr OnsiteFull Time
Auburn University
Auburn University: Public university providing education and research in Alabama.
0+ YOEBachelor's in engineering, progressive engineering/research experience (0–10+ years depending on level), AI/ML and systems engineering skills, proficiency in scripting/programming, strong communication and problem-solving.
Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), React, Next.js, SQL, NoSQL, AWS, MS cloud, vector databases, Open-Source Intelligence (OSINT), MITRE ATT&CK
1mo
Save
Mark Applied
Hide
Senior Research Engineer, Threat Intelligence
Washington, District of Columbia, United States
$140k-$150k/yr RemoteFull Time
SecurityScorecard
SecurityScorecard: Provides continuous cybersecurity ratings and risk monitoring for organizations.
5+ YOE5+ years engineering experience in threat intelligence, detection, or security research; production engineering skills with Python/TypeScript/Node; experience with STIX/TAXII, YARA/Sigma, cloud (AWS), and building data/pipeline systems.
Python, TypeScript/Node, STIX 2.1, TAXII 2.1, MISP, MITRE ATT&CK, YARA, Sigma, STIX Patterning, AWS, Golang, Splunk, Kinesis, NetFlow, CEL, OPA, SQL, CI/CD
2mo
Save
Mark Applied
Hide
Senior Research Engineer - Experimental Engineering
Yonkers or Washington or Colchester or Arizona or California or Connecticut or Illinois or Maryland or Massachusetts or Michigan or New Hampshire or New Jersey or New York or Texas or Vermont or Virginia or District of Columbia
$115k-$160k/yr RemoteFull Time
Consumer Reports
Consumer Reports: Tests products and publishes ratings for consumer advocacy.
Senior research engineer with deep full-stack software engineering experience, strong applied AI/ML knowledge, prototyping and R&D experience, Python/FastAPI and frontend (React/React Native) familiarity, and ability to lead experiments and mentor engineers.
AI, Machine Learning, Python, FastAPI, React, React Native, RAG