USA Banner

Official US Government Icon

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure Site Icon

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Site Notification

Site Notification

U.S. Department of Transportation U.S. Department of Transportation Icon United States Department of Transportation United States Department of Transportation
OFFICE OF RESEARCH, DEVELOPMENT, AND TECHNOLOGY AT THE TURNER-FAIRBANK HIGHWAY RESEARCH CENTER

Video Analytics for Automatic Annotation of Driver Behavior and Driving Situations in Naturalistic Driving Data

Project Information

Project ID:
FHWA-PROJ-19-0016
Project Abstract:

The goal of the project is to develop a system that can analyze naturalistic driving videos and automatically produce annotations and descriptors for events, behavior, and driving scenarios that relate to transportation safety. Using large datasets obtained in naturalistic driving situations, the system will use innovative machine-learning techniques to recognize safety-related aspects of the driver, passengers, and outside environment. The project has four primary objectives that address 1) characterization of high-level driver behavior, such as eating or attending to a phone; 2) classification of extra-vehicular context, such as construction zones; 3) interactions and dependencies between drivers and the surrounding environment, such as looking at a passing vehicle or looking at a billboard; and 4) conclusions as to how the video analytics techniques developed under the other objectives enable human factors researchers to address key research questions in novel ways.

This project represents a collaborative university/industry effort by Virginia Tech and SmartDrive Systems, Inc. Both organizations will contribute technical expertise as well as extensive in-vehicle video datasets. In particular, the Virginia Tech Transportation Institute will provide access to the Second Strategic Highway Research Program (SHRP2) dataset, and SmartDrive Systems will provide annotations and video epochs of naturalistic driving video data obtained from more than 8 billion driving miles.

 

Project Status:
Active
Project Funding Amount (Contract Award Amount):
$799,738.00
Start Date:
End Date:
Public Access Plan:
No
FHWA Program Area:
  • Exploratory Advanced Research
FHWA AMRP Program:
  • Exploratory Advanced Research

Contact Information

First Name:
Charles
Last Name:
Fay
Phone Number:
(202) 493-3336
Email Address:
Team:
Safety Data and Analysis Team
Office:
Office of Safety and Operations Research and Development
Office Code:
HRSO-20

Management Organizations

Sponsor Organization

Organization Role:
Sponsor Organization
Organization:
Federal Highway Administration: Office of Research, Development and Technology - Office of Safety and Operations Research and Development