Post-bacc

Project
PREP0003351
Overview

As a Research Associate, you will be responsible for designing, developing, and testing systems that capture data from edge devices and apply language and vision AI models for analysis in various environments and applications.

Analysis of Edge Devices Interacting with Language and Vision AI models

Qualifications
  • An Undergraduate degree in Computer Science.
  • 2 years of relevant experience. 
  • Experience with interactive semantic segmentation software (such as CVAT).
  • Experience with Segment Anything Model 2 (SAM2).
  • Experience with multi-modal large language models for image reasoning.
  • Familiarity with edge devices such as Raspberry Pi 5
  • Familiarity with multiple scripting languages. 
  • Ability to develop prototypes of tools needed to analyze data. 
  • Strong oral and written communication skills. 
Research Proposal

Key responsibilities will include but are not limited to:

  • System Development: Design and develop software to capture data from edge devices and integrate them with edge hardware.
  • AI Model Integration: Integrate language and vision AI models with edge devices (e.g., Segment Anything Model 2 (SAM2), Llama-4-Maverick) to analyze image content.
  • Performance Evaluation: Analyze the performance of AI models using qualitative and quantitative metrics to assess their effectiveness.
  • System Performance Measurement: Measure and optimize end-to-end throughput and latency of the system.
  • Case Study: Conduct a comprehensive case study to evaluate the system in various indoor and outdoor environments, with a focus on augmented reality applications for vision-impaired individuals.
  • Exploration of Edge Devices and Computing Strategies: Investigate and compare different edge devices and computing strategies to identify optimal configurations for the system.
NIST Sponsor
Timothy Blattner
Group
Information Systems Group
Schedule of Appointment
Full time
Start Date
Work Location
Onsite NIST
Salary / Hourly rate {Max}
$100,000.00
Total Hours per week
40
End Date