Accuracy, Repeatability, and Reproducibility of Firearm Comparisons Part 1: Accuracy

07/30/2021
by   L. Scott Chumbley, et al.
0

Researchers at the Ames Laboratory-USDOE and the Federal Bureau of Investigation (FBI) conducted a study to assess the performance of forensic examiners in firearm investigations. The study involved three different types of firearms and 173 volunteers who compared both bullets and cartridge cases. The total number of comparisons reported is 20,130, allocated to assess accuracy (8,640), repeatability (5,700), and reproducibility (5,790) of the evaluations made by participating examiners. The overall false positive error rate was estimated as 0.656 respectively, while the rate of false negatives was estimated as 2.87 1.87 of independence strongly suggest that error probabilities are not the same for each examiner, these are maximum likelihood estimates based on the beta-binomial probability model and do not depend on an assumption of equal examiner-specific error rates. Corresponding 95 (0.305 cases, respectively, and (1.89 for bullets and cartridge cases, respectively. These results are based on data representing all controlled conditions considered, including different firearm manufacturers, sequence of manufacture, and firing separation between unknown and known comparison specimens. The results are consistent with those of prior studies, despite its more robust design and challenging specimens.

READ FULL TEXT
research
10/21/2020

How to Control the Error Rates of Binary Classifiers

The traditional binary classification framework constructs classifiers w...
research
06/09/2018

Abstaining Classification When Error Costs are Unequal and Unknown

Abstaining classificaiton aims to reject to classify the easily misclass...
research
05/27/2021

Statistical Inference for Diagnostic Test Accuracy Studies with Multiple Comparisons

Diagnostic accuracy studies assess sensitivity and specificity of a new ...
research
01/09/2014

Enhancement performance of road recognition system of autonomous robots in shadow scenario

Road region recognition is a main feature that is gaining increasing att...
research
04/19/2022

A Re-analysis of Repeatability and Reproducibility in the Ames-USDOE-FBI Study

Forensic firearms identification, the determination by a trained firearm...

Please sign up or login with your details

Forgot password? Click here to reset