Post-bacc
This position involves providing software and web development support for various activities in the Information Access Division at the National Institute of Standards and Technology (NIST). Specifically, the work will support NIST GenAI evaluation series (https://ai-challenges.nist.gov/genai)
The candidate will be responsible for assisting in generating deepfake or forensic data, designing and developing a web platform, and implementing evaluation pipeline scoring software that supports different evaluation series in various modalities (such as text, voice, image, video, and code) under the NIST GenAI program. The candidate will actively participate in the NIST implementation of the evaluations and be involved in cutting-edge research and evaluation in the field of Generative AI technologies. The candidate will be expected to contribute significantly to various aspects, such as building evaluation infrastructure, data collection, implementing baseline algorithms, developing metrics, establishing scoring procedures, and generating reports that align with the program’s objectives.
Computer Scientist ZP-II/NIST GenAI program
This individual must have the following minimum knowledge, skills, and abilities:
- Proficiency in a programming language such as Python, Java, Java Script, C and C++
- Proficiency in shell scripts (Bash, etc.)
- Mastery of the principles, practices, methods in a specialty of a technical professional field (in science, computer science, software engineering, information technology, or mathematics, or related field).
Furthermore, the following knowledge skills, and abilities are preferred:
- Previous experience in various generative AI tools including deepfakes and Large Language Models
- Previous Experience in a full-stack web developer with tools potentially including using Ruby on Rails: Rails5, Postgres, HTML/CSS, Javascript
- Previous Experience in database management (e.g., PostgreSQL, MongoDB)
- Experience with jupyter notebooks, R, Shiny and interactive plots
- Experience in Cross platform software development (Linux, Mac OS X, Windows)
- Experience/interest in machine learning and AI test and evaluation
Key responsibilities will include but are not limited to:
- Building evaluation infrastructure
- Assisting in generating deepfake or forensic data
- Developing baseline algorithms in generative AI
- Upgrading, maintaining, and continuously developing existing NIST GenAI software
- Developing and deploying a framework for installing and executing AI systems with a large dataset on a GPU-accelerated cluster
- Assisting in the deployment of an evaluation scoring software package
- Assisting in developing and extending an automatic web scoring server and its pipeline
- Managing data, such as querying and translating data formats/specifications