Jacob Kaplan's Concatenated Files: Uniform Crime Reporting Program Data: Offenses Known and Clearances by Arrest (Return A), 1960-2020

For a comprehensive guide to this data and other UCR data, please see my book at ucrbook.com Version 17 release notes:Adds data for 2020.Please note that the FBI has retired UCR data ending in 2020 data so this will be the last Offenses Known and Clearances by Arrest data they release. Changes .rda files to .rds. Please note that in 2020 the card_actual_pt variable always returns that the month was reported. This causes 2020 to report that all months are reported for all agencies because I use the card_actual_pt variable to measure how many months were reported. This variable is almost certainly incorrect since it is extremely unlikely that all agencies suddenly always report. However, I am keeping this incorrect value to maintain a consistent definition of how many months are missing (measuring missing months through card_actual_type, for example, gives different results for previous years so I don't want to change this). Version 16 release notes:Changes release notes description, does not change data.Version 15 release notes:Adds data for 2019.Please note that in 2019 the card_actual_pt variable always returns that the month was reported. This causes 2019 to report that all months are reported for all agencies because I use the card_actual_pt variable to measure how many months were reported. This variable is almost certainly incorrect since it is extremely unlikely that all agencies suddenly always report. However, I am keeping this incorrect value to maintain a consistent definition of how many months are missing (measuring missing months through card_actual_type, for example, gives different results for previous years so I don't want to change this). Version 14 release notes:Adds arson data from the UCR's Arson dataset. This adds just the arson variables about the number of arson incidents, not the complete set of variables in that dataset (which include damages from arson and whether structures were occupied or not during the arson.As arson is an index crime, both the total index and the index property columns now include arson offenses. The "all_crimes" variables also now include arson.Adds a arson_number_of_months_missing column indicating how many months were not reporting (i.e. missing from the annual data) in the arson data. In most cases, this is the same as the normal number_of_months_missing but not always so please check if you intend to use arson data.Please note that in 2018 the card_actual_pt variable always returns that the month was reported. This causes 2018 to report that all months are reported for all agencies because I use the card_actual_pt variable to measure how many months were reported. This variable is almost certainly incorrect since it is extremely unlikely that all agencies suddenly always report. However, I am keeping this incorrect value to maintain a consistent definition of how many months are missing (measuring missing months through card_actual_type, for example, gives different results for previous years so I don't want to change this).For some reason, a small number of agencies (primarily federal agencies) had the same ORI number in 2018 and I removed these duplicate agencies. Version 13 release notes: Adds 2018 dataNew Orleans (ORI = LANPD00) data had more unfounded crimes than actual crimes in 2018 so unfounded columns for 2018 are all NA. Version 12 release notes: Adds population 1-3 columns - if an agency is in multiple counties, these variables show the population in the county with the most people in that agency in it (population_1), second largest county (population_2), and third largest county (population_3). Also adds county 1-3 columns which identify which counties the agency is in. The population column is the sum of the three population columns. Thanks to Mike Maltz for the suggestion!Fixes bug in the crosswalk data that is merged to this file that had the incorrect FIPS code for Clinton, Tennessee (ORI = TN00101). Thanks for Brooke Watson for catching this bug!Adds a last_month_reported column which says which month was reported last. This is actually how the FBI defines number_of_months_reported so is a more accurate representation of that. Removes the number_of_months_reported variable as the name is misleading. You should use the last_month_reported or the number_of_months_missing (see below) variable instead. Adds a number_of_months_missing in the annual data which is the sum of the number of times that the agency reports "missing" data (i.e. did not report that month) that month in the card_actual_pt variable or reports NA in that variable. Please not that this variable is not perfect and sometimes an agency does not report data but this variable does not say it is missing. Therefore, this variable will not be perfectly accurate. Version 11 release notes: Adds data in the following formats: SPSS and Excel.Changes project name to avoid confusing this data for the ones done by NACJD. Version 10 release notes: Adds card column to the monthly data. The "pt" cards can be used to indicate if no return was submitted that month. Thank you to Tanaya Devi for the suggestion.Adds the mailing address columns to both monthly and yearly data. In 2017 the agency "New Orleans" in Louisiana (ORI = LANPD00) reported hundreds of times more unfounded attempted burglaries than actual attempted burglaries for every month. These were all changed to NA (unfounded total burglaries was also changed to NA. Version 9 release notes: Adds column for index crimes. Index Violent is the sum of murder, total robbery, total rape, and total aggravated assault. Index Property is the sum of burglary, total motor vehicle theft, and total theft (arson is an index crime but is not available in this data set). Index Total is the sum of Index Violent and Index Property. When looking at these columns please consider that some agencies don't always report all crimes (e.g. Chicago didn't report rape between 1986-2012) so these variables may be undercounts. All data now from FBI, not NACJD. Changes some column names so all columns are <=32 characters to be usable in Stata. Version 8 release notes: Adds 2017 data. Version 7 release notes: Removes SPSS (.sav) and Excel (.csv) files. Changes column names for clearances to "tot_clr_..." to make explicit that this is all clearances, not just adult clearances. The formatting of the monthly data has changed from wide to long. This means that each agency-month has a single row. The old data had each agency being a single row with each month-crime (e.g. jan_act_murder) being a column. Now there will just be a single column for each crime (e.g. act_murder) and the month can be identified in the month column. Adds a month column and a date column. This date column is always set to the first of the month. It is NOT the date that a crime occurred or was reported. It is only there to make it easier to create time-series graphs that require a date input. Removes all card columns. This was done to reduce file size. Reorders crime columns to the order of assaults/deaths of officers, actual crimes, total clearance, clearance under age 18, unfounded. Within each category the columns are alphabetized.Monthly data and yearly data are now in different zip folders to download. Version 6 release notes: Fix bug where Philadelphia Police Department had incorrect FIPS county code. Version 5 release notes: Changes the word "larceny" to "theft" in column names - eg. from "act_larceny" to "act_theft." Fixes bug where state abbrebation was NA for Washington D.C., Puerto Rico, Guam, and the Canal Zone.Fixes bug where officers_killed_by_accident was not appearing in yearly data. Note that 1979 does not have any officers killed (by felony or accident) or officers assaulted data.Adds aggravated assault columns to the monthly data. Aggravated assault is the sum of all assaults other than simple assault (assaults using gun, knife, hand/feet, and other weapon). Note that summing all crime columns to get a total crime count will double count aggravated assault as it is already the sum of existing columns. Reorder columns to put all month descriptors (e.g. "jan_month_included", "jan_card_1_type") before any crime data.Due to extremely irregular data in the unfounded columns for New Orleans (ORI = LANPD00) for years 2014-2016, I have change all unfounded column data for New Orleans for these years to NA. As an example, New Orleans reported about 45,000 unfounded total burglaries in 2016 (the 3rd highest they ever reported). This is 18 times largest than the number of actual total burglaries they reported that year (2,561) and nearly 8 times larger than the next largest reported unfounded total burglaries in any agency or year. Prior to 2014 there were no more than 10 unfounded total burglaries reported in New Orleans in any year. There were 10 obvious data entry errors in officers killed by felony/accident that I changed to NA.In 1974 the agency "Boston" (ORI = MA01301) reported 23 officers killed by accident during November.In 1978 the agency "Pittsburgh" (ORI = PAPPD00) reported 576 officers killed by accident during March.In 1978 the agency "Bronx Transit Authority" (ORI = NY06240) reported 56 officers killed by accident during April.In 1978 the agency "Bronx Transit Authority" (ORI = NY06240) reported 56 officers killed by accident during June.In 1978 the agency "Bronx Transit Authority" (ORI = NY06240) reported 56 officers killed by felony during April.In 1978 the agency "Bronx Transit Authority" (ORI = NY06240) reported 56 officers killed by felony during June.In 1978 the agency "Queens Transit Authority" (ORI = NY04040) reported 56 officers killed by accident during May.In 1978 the agency "Queens Transit Authority" (ORI = NY04040) reported 56 officers killed by felony during May.In 1996 the agency "Ruston" in Louisiana (ORI = LA03102) reported 30 officers killed by felony during September.In 1997 the agency "Washington University" in Missouri (ORI = MO0950E) reported 26 officers killed by felony during March.Version 4 release notes: Merges data with LEAIC data to add FIPS codes, census codes, agency type variables, and ORI9 variable. Makes all column names lowercase.Change some variable names Makes values in character columns lowercase. Adds months_reported variable to yearly data.Combines monthly and yearly files into a single zip file (per data type). Version 3 release notes: fixes a bug in Version 2 where 1993 data did not properly deal with missing values, leading to enormous counts of crime being reported. Summary: This is a collection of Offenses Known and Clearances By Arrest data from 1960 to 2017. Each zip file contains monthly and yearly data files. The monthly files contain one data file per year (58 total, 1960-2017) as well as a codebook for each year. The yearly file aggregated the monthly data by year and concatenates each year together into a single file containing data for all years. As a description of what UCR Offenses Known and Clearances By Arrest data contains, the following is copied from ICPSR's 2015 page for the data. The Uniform Crime Reporting Program Data: Offenses Known and Clearances By Arrest data set is a compilation of offenses reported to law enforcement agencies in the United States. Due to the vast number of categories of crime committed in the United States, the FBI has limited the type of crimes included in this compilation to those crimes which people are most likely to report to police and those crimes which occur frequently enough to be analyzed across time. Crimes included are criminal homicide, forcible rape, robbery, aggravated assault, burglary, larceny-theft, and motor vehicle theft. Much information about these crimes is provided in this data set. The number of times an offense has been reported, the number of reported offenses that have been cleared by arrests, and the number of cleared offenses which involved offenders under the age of 18 are the major items of information collected.如需了解本数据集及其他统一犯罪报告（Uniform Crime Reporting, UCR）数据集的完整指南，请访问ucrbook.com查阅我的著作。 **版本17更新说明**：新增2020年数据。请注意，美国联邦调查局（Federal Bureau of Investigation, FBI）已停止发布2020年及更早的UCR数据，因此本数据集将是FBI发布的最后一份《已知犯罪与逮捕破案数》（Offenses Known and Clearances by Arrest）数据。本版本将文件格式从.rda转换为.rds。 请注意，2020年的`card_actual_pt`变量始终返回“该月份已上报”的结果。由于我通过该变量统计已上报的月份数量，这会导致2020年的数据集显示所有执法机构均上报了全年所有月份的数据。但该变量的取值几乎可以肯定是错误的——所有执法机构突然全部持续上报数据的可能性极低。不过为了保持“缺失月份数”统计定义的一致性，我保留了这一错误取值（例如，若通过`card_actual_type`统计缺失月份，会与往年的统计结果存在差异，因此我未对其进行修改）。 **版本16更新说明**：仅修改更新说明文本，未改动数据集内容。 **版本15更新说明**：新增2019年数据。请注意，2019年的`card_actual_pt`变量始终返回“该月份已上报”的结果。由于我通过该变量统计已上报的月份数量，这会导致2019年的数据集显示所有执法机构均上报了全年所有月份的数据。但该变量的取值几乎可以肯定是错误的——所有执法机构突然全部持续上报数据的可能性极低。不过为了保持“缺失月份数”统计定义的一致性，我保留了这一错误取值（例如，若通过`card_actual_type`统计缺失月份，会与往年的统计结果存在差异，因此我未对其进行修改）。 **版本14更新说明**：新增UCR纵火数据集的纵火犯罪数据。本次仅新增纵火事件数量相关的变量，未包含该数据集中的全部变量（例如纵火造成的财产损失、纵火发生时建筑是否有人居住等）。由于纵火属于索引犯罪（index crime），因此“总索引犯罪”与“财产类索引犯罪”两列现已包含纵火犯罪数据，`all_crimes`系列变量也同步纳入纵火犯罪统计。新增`arson_number_of_months_missing`列，用于标识纵火数据中未上报（即年度数据缺失）的月份数量。多数情况下，该列取值与常规的`number_of_months_missing`一致，但并非全部场景如此，若您计划使用纵火相关数据，请务必核查该字段。 请注意，2018年的`card_actual_pt`变量始终返回“该月份已上报”的结果。由于我通过该变量统计已上报的月份数量，这会导致2018年的数据集显示所有执法机构均上报了全年所有月份的数据。但该变量的取值几乎可以肯定是错误的——所有执法机构突然全部持续上报数据的可能性极低。不过为了保持“缺失月份数”统计定义的一致性，我保留了这一错误取值（例如，若通过`card_actual_type`统计缺失月份，会与往年的统计结果存在差异，因此我未对其进行修改）。此外，2018年有少量执法机构（主要为联邦机构）出现了ORI（执法机构识别码，Originating Agency Identifier, ORI）重复的情况，我已移除这些重复的机构记录。 **版本13更新说明**：新增2018年数据。新奥尔良警察局（ORI=LANPD00）在2018年上报的“未证实犯罪”数量远超实际犯罪数，因此2018年所有未证实犯罪相关列的取值均设为NA（缺失值）。 **版本12更新说明**：新增`population_1`至`population_3`三列：若执法机构管辖多个县，`population_1`代表该机构辖区内人口最多的县的人口数，`population_2`、`population_3`分别代表第二、第三大县的人口数。同时新增`county_1`至`county_3`列，用于标识执法机构所管辖的县。`population`列的值为上述三个人口列的总和。感谢Mike Maltz提出该建议！ 修复了合并至本数据集的交叉参考数据中的一处错误：田纳西州克林顿市（ORI=TN00101）的FIPS（联邦信息处理标准，Federal Information Processing Standards, FIPS）代码存在错误。感谢Brooke Watson发现该问题！ 新增`last_month_reported`列，用于标识最后一次上报数据的月份。该字段实际上符合FBI对“已上报月份数”的定义，因此能更准确地反映实际情况。移除了原`number_of_months_reported`变量，因其名称易产生误导，建议使用`last_month_reported`或`number_of_months_missing`（详见下文）替代。 新增年度数据中的`number_of_months_missing`列，其取值为执法机构通过`card_actual_pt`变量标记为“缺失”（即未上报该月数据）或取值为NA的月份总数。请注意，该变量并非完美：有时执法机构未上报数据，但该变量并未识别为缺失，因此其准确性存在一定局限。 **版本11更新说明**：新增SPSS与Excel格式的数据文件。修改项目名称，避免用户将本数据集与美国国家刑事司法数据档案馆（National Archive of Criminal Justice Data, NACJD）发布的数据集混淆。 **版本10更新说明**：为月度数据新增`card`列。其中“pt”类型的卡片可用于标识该月未提交上报数据。感谢Tanaya Devi提出该建议！ 为月度与年度数据均新增邮寄地址列。2017年，路易斯安那州新奥尔良警察局（ORI=LANPD00）上报的“未证实未遂盗窃”数量是实际未遂盗窃数的数百倍，因此将该年度所有月份的相关数据均设为NA（未证实盗窃总数列也同步设为NA）。 **版本9更新说明**：新增索引犯罪相关列。其中“暴力类索引犯罪”为谋杀、抢劫总数、强奸总数与严重攻击总数的总和；“财产类索引犯罪”为盗窃、机动车盗窃总数与盗窃总数的总和（纵火属于索引犯罪，但本数据集未包含相关数据）；“总索引犯罪”为暴力类与财产类索引犯罪的总和。 使用这些列时请注意：部分执法机构并非始终上报所有犯罪类型（例如芝加哥警察局在1986-2012年间未上报强奸数据），因此相关变量可能存在统计低估。本数据集所有数据均来源于FBI，而非NACJD。修改部分列名，确保所有列名长度不超过32个字符，以适配Stata软件的使用要求。 **版本8更新说明**：新增2017年数据。 **版本7更新说明**：移除SPSS（.sav）与Excel（.csv）格式的数据文件。将破案相关列的名称修改为`tot_clr_...`格式，以明确该列代表所有类型的破案数，而非仅针对成年作案者的破案数。 调整月度数据的格式，从宽格式转换为长格式：原数据中每个执法机构为一行，以“月份_犯罪类型”（例如`jan_act_murder`）作为列名；转换后每个犯罪类型对应单独一列（例如`act_murder`），通过`month`列标识所属月份。新增`month`列与`date`列，其中`date`列始终设置为当月1日，该日期并非犯罪发生或上报的实际日期，仅用于简化需要日期输入的时间序列图表制作。 移除所有卡片列，以减小文件体积。调整犯罪相关列的排序顺序：按“执法人员受攻击/死亡数、实际犯罪数、总破案数、未成年作案者破案数、未证实犯罪”的顺序排列，每个类别内的列按字母顺序排序。将月度数据与年度数据分别打包为zip压缩包供下载。 **版本6更新说明**：修复了费城警察局的FIPS县代码错误问题。 **版本5更新说明**：将列名中的“larceny”替换为“theft”，例如将`act_larceny`修改为`act_theft`。修复了华盛顿特区、波多黎各、关岛与运河区的州缩写字段取值为NA的错误。 修复了年度数据中`officers_killed_by_accident`（事故致死执法人员数）列缺失的问题。请注意，1979年无任何执法人员因重罪或事故死亡、以及执法人员受攻击的相关数据。 为月度数据新增严重攻击相关列：严重攻击为除轻微攻击外的所有攻击类型的总和（包括使用枪支、刀具、拳脚及其他武器的攻击）。请注意，若直接对所有犯罪列求和以得到总犯罪数，会重复计算严重攻击的数值——因为严重攻击本身已是现有攻击类列的总和。 调整列的排序顺序，将所有月份描述列（例如`jan_month_included`、`jan_card_1_type`）置于所有犯罪数据列之前。 由于新奥尔良警察局（ORI=LANPD00）在2014-2016年间的未证实犯罪列数据存在严重异常，我将该机构此期间的所有未证实犯罪列数据均设为NA。例如，新奥尔良警察局在2016年上报了约45000起未证实总盗窃案，为该机构历史第三高的上报值——这一数值是当年实际总盗窃案数（2561起）的18倍，也比所有机构/年度中第二高的未证实总盗窃上报值高出近8倍。而在2014年之前，新奥尔良警察局每年上报的未证实总盗窃案数均不超过10起。 此外，我将10处明显的数据录入错误（重罪/事故致死执法人员数）修改为NA。具体异常记录如下： 1974年，波士顿警察局（ORI=MA01301）上报11月有23名执法人员因事故死亡； 1978年，匹兹堡警察局（ORI=PAPPD00）上报3月有576名执法人员因事故死亡； 1978年，布朗克斯交通管理局（ORI=NY06240）上报4月、6月各有56名执法人员因事故死亡，同期该机构上报4月、6月各有56名执法人员因重罪死亡； 1978年，皇后区交通管理局（ORI=NY04040）上报5月有56名执法人员因事故死亡、56名执法人员因重罪死亡； 1996年，路易斯安那州拉斯顿市警局（ORI=LA03102）上报9月有30名执法人员因重罪死亡； 1997年，密苏里州华盛顿大学警局（ORI=MO0950E）上报3月有26名执法人员因重罪死亡。 **版本4更新说明**：与LEAIC数据合并，新增FIPS代码、普查代码、执法机构类型变量以及`ORI9`列。将所有列名转换为小写格式，修改部分变量名，并将字符型列的取值统一转换为小写。为年度数据新增`months_reported`列。将月度与年度数据文件分别打包为单个zip压缩包（按数据类型区分）。 **版本3更新说明**：修复了版本2中的一处错误：1993年的数据未正确处理缺失值，导致上报的犯罪数出现异常偏高的情况。 **数据集概述**：本数据集收录了1960年至2017年的《已知犯罪与逮捕破案数》数据。每个zip压缩包均包含月度与年度数据文件：月度数据文件包含1960-2017年共58个年度的数据文件，以及每个年度的代码手册；年度数据文件按年度对月度数据进行聚合，并将所有年度的数据合并为单个文件。 以下内容引自美国政治与社会研究联盟（Inter-university Consortium for Political and Social Research, ICPSR）2015年的数据集页面，用于说明UCR《已知犯罪与逮捕破案数》数据集的内容： **统一犯罪报告项目数据：已知犯罪与逮捕破案数**数据集收录了美国各执法机构上报的犯罪数据。由于美国犯罪类型繁多，FBI将本数据集收录的犯罪类型限定为公众最可能向警方报案、且发生频率足够高以支持跨时间分析的犯罪类型，包括刑事杀人、暴力强奸、抢劫、严重攻击、盗窃、盗窃（larceny-theft，注：部分版本已替换为theft）与机动车盗窃。本数据集提供了上述犯罪的多项核心信息：包括各类犯罪的上报次数、通过逮捕破案的犯罪数、以及作案者为未成年人的破案数。