Search for answers or browse our knowledge base.
Insider Trading Database
We have successfully moved all of the parsed and extracted 2005-2021 insider trading and transactions reported on Forms 3/4/5 as well as the amended versions of those forms to the INSIDER_TRADING.db file accessible through the user instances. We expect to have the 2022 data available by the end of November and the 2023 data will be fully available by the middle of January 2024.
There are three caveats as of 11/13/2023. When the data was initially pulled we were responding to a client request and made a mistake in that we did not parse and include the ACCEPTANCE_DATETIME field. At the present time we are back-filling these values. Because of the importance of respecting the SEC limits on automated data collection from EDGAR we can only do this work during the evenings and weekends so it does not interfere with our primary collection of the filings we pull and parse each day. Each week we should be able to update approximately one million rows until the task is complete. When it is complete this caveat will disappear.
The second caveat is that this data is very dense and the main insider trading database has over 90 columns. It is going to challenge your patience to attempt to use the ExtractionEngine’s QueryTool to identify and extract data. We have made available a Python script that is written to pull the data by CIK, YEAR and save the results to csv files. You are not likely to be successful using Panda’s to access this data because of the impact of the size of the database and the way Pandas uses memory. The script can be found on the platform in the S:\PythonCode folder (“S:\PythonCode\read_insider_trading_db.py”). Please do not hesitate to ask for help modifying the script to match your particular needs.
The third caveat is that the Insider Trading Database is incomplete. Some filings have more than 30 footnotes associated with one data value (Example Link). To make this database more tractable this primary database only includes the first two footnotes associated with any particular field. If a row has more than two footnotes, there is value in the EXTENDED field. That value is a derived value of the ACCESSION_NUMBER and row number (RID) (ACCESSION_RID). If there is a value in EXTENDED then the entire row is repeated in the INSIDER_TRADING_EXTENDED.db file. We will be anxious to hear your comments after you have had some experience using this data.
There are two linked tables. The first one has the field names and an explanation as well as a mapping of the field to the forms. The second one contains a list of the transaction codes that are reported in the forms.
Path | "S:/directEDGAR_DATA/INSIDER_TRADING.db" | ||
Table Name | INSIDER_TRADING | ||
FIELDNAME | DESCRIPTION | The following fields are pulled from the header file or the top of the form that identify the reporting person, the issuer and the relationship of the reporting person to the issuer | |
ACCESSION_NUMBER | The ACCESSION number for the filing the data was pulled from. | Header |
|
DISSEMINATION_DATE | Based on the header, this represents the date the filing was made available through EDGAR. Ownership reports are accepted until 10:00 pm ET M-F and are generally made available on EDGAR almost immediately after they have been filed. | Header |
|
ACCEPTANCE_DATETIME | This is the value as reported in the header file as the date/time the filing was accepted by the EDGAR system. | Header - note as of 11/13/2023 this value is present in only | |
YEAR | Imputed from the ACCEPTANCE_DATETIME | Header |
|
CIK | The Central Index Key of the issuer whose securties the report relates to | Header |
|
documenttype | The specific filing type, expected values are 3, 3/A, 4, 4/A, 5, 5/A | Header and documenttype field in raw xml |
|
form3holdingsreported | 1/0 Expected only in Forms 5 & 5/A | Check Box above name box in Form 5 |
|
form4transactionsreported | 1/0 Expected only in Forms 5 & 5/A | Check Box above name box in Form 5 |
|
nosecuritiesowned | 1/0, expected only in 3 & 3/A filings. Value set by EDGAR 1 to indicate report has some ownership disclosure, 0 to indicate no ownership - value is often not consistent with data tables and should generally not be relied upon to filter. | Pulled directly from XML - EDGAR imputes this - it often wrong when a non-blank 3 or 3/A submitted when the holdings section reports 0 Securities Owned |
|
transactiontimeliness | E - Reported Early, L Reported Late, blank - reported On-time | Note - these codes are not visible on the form, instead for transactions/holdings relating to Nonderivative securities Column 3 V will have a V value, for Derivative securities Column 4 V will report a V value. |
|
dateoforiginalsubmission | If 3/A, 4/A, or 5/A - the date of the original filing that is being amended | Box 4 |
|
issuertradingsymbol | Issuer Trading Symbol - as reported on the date of the filing | Box 2 |
|
issuername | Issuer Name - as reported on the date of the filing | Box 2 |
|
rptownercik | Central Index Key of the reporting owner | Header |
|
rptownername | Name of the reporting owner | Box 1 |
|
rptownerstreet1 | Line 1 of the street address of the reporting owner | Box 1 |
|
rptownerstreet2 | Line 2 of the street address of the reporting owner | Box 1 |
|
rptownercity | City of the reporting address of the reporting owner | Box 1 |
|
rptownerstate | State of the reporting address of the reporting owner | Box 1 |
|
rptownerzipcode | Zip-code of the reporting address of the reporting owner | Box 1 |
|
rptownerstatedescription | Country of the reporting owner if not a US State Code | Not visible on form - imputed by EDGAR based on value of rptownerstate |
|
isdirector | 1/0 to indicate if the reporting person is a director of the issuer. | Box 5 |
|
isofficer | 1/0 to indicate if the reporting person is an officer of the issuer. | Box 5 |
|
officertitle | Title of officer | Box 5 |
|
isother | 1/0, if 1 then field othertext should be present and describe the relationship between the reporting person and the issuer such that they are filing the report | Box 5 |
|
othertext | If Other is checked in Box 5 - Relationship this is the explanation of the relationship between the reporting person(s) and the issuer. | Box 5 |
|
istenpercentowner | 1/0, if 1 then the reporting person owns 10% or more of the securities of the issuer | Box 5 |
|
aff10b5One | 1/0, if 1 indicates the reporting person is asserting that the transactions reported were carried out under a 10b5-1(c) plan, note - this field was only added in March 2023. | Checkbox on form |
|
notsubjecttosection16 | 1/0, Present only in 4, 4/A, 5, 5/A filings 1 indicates the reporting person is no longer subject to Section 16 for this issuer | Checkbox on form |
|
RID | Imputed field, represents the row count from the first transaction/holding reported in the filing to the last - this value is derived from the XML filing element order |
| |
datatype | Derived from the nature of the content of the filing and row, values can be None, nonderivativetransaction, derivativetransaction, nonderivativeholding, derivativeholding or remarks | ||
The Following Values Are Pulled from Table 1 (Nonderivative Transactions and or Holdings) or Table 2 (Derivative Transactions and or Holdings) The Column Numbers Represent the Column Numbers as Shown on the Various Forms | |||
FIELDNAME | DESCRIPTION | Table 1 (Nonderivative Transaction & Holdings) | Table 2 (Derivative Transaction & Holdings) |
securitytitle | Name of the security as reported in the filing, for nonderivative transactions and holdings the name represents the name of the derivative instrument, convertible classes of common can be derivative securities. | Column 1 | Column 1 |
conversionorexerciseprice | Conversion or exercise price of the derivative security | Column 2 | |
deemedexecutiondate | If the transaction is executed by a plan administrator, the deemed execution date is deemed to be the date the administrator notifies the reporting person of the transaction, if the notification occurs later than the 3rd businss date following the transaction - the deemed execution date is the third business day following the transaction. | Column 2A | Column 3A |
transactiondate | The date of the transaction that is being reported. | Column 2 | Column 3 |
transactionformtype | This value identifies the form type that otherwise should have been used to report the transaction or holding. Valid values for a 4 or 4/A submission are 4 or 5. Valid values for a 5 or 5/A submission are 3, 4 or 5. | This value is not reported/visible in the html. In some circumstance it could be be established by analyzing attributes of the transaction or holding reported |
|
transactioncode | See the list of valid values below this schedule, the code describes the nature of the underlying transaction conformed to the SEC's set of transaction reasons. | Column 3 Code | Column 3 Code |
equityswapinvolved | Value is 1/O in the database | In the HTML version of the filing the value in Column 3 will have a /K appended | In the HTML version of the filing the value in Column 4 will have a /K appended |
transactionshares_number | The number of shares that were acquired or disposed of in the transaction. | Column 4 | Column 5 |
exercisedate | The date the derivative security became/becomes exercisable | Column 6, Date Exercisable | |
expirationdate | The expiration date of the derivative security. | Column 6 Expiration Date | |
transactionpricepershare | For nonderivative transactions, the amount reported in Column 4 Price, for derivative transactions this is the amount reported in Column 8 Price of Derivative Security | Column 4 Price | Column 8 |
transactionacquireddisposedcode | For nonderivative transactions this is the value reported in Column 4 (A) or (D). For derivativetransactions this is the column (A) or (D) that the transactionshares_number was reported in | Column 5 (A) or Column 5 (D) | |
Note - only one of Number or Value can be reported |
| ||
number_shares_owned_following_transaction | Number of securities owned owned following the reported transaction | Column 5 | Column 9 |
value_shares_owned_following_transaction | Dollar value of the listed security held following the transaction | Column 5 - when a $ sign prepended to the value reported | Column 9 - when a $ sign prepended to the value reported |
directorindirectownership | D/I to indicate direct or indirect ownership | Column 6 | Column 10 |
natureofownership | If Indirect Ownership, explanation of the nature of that ownership | Column 7 | Column 11 |
underlyingsecuritytitle | Title/Name of securities underlying Derivative Security | Column 7 Title | |
Note - only one of Number or Value can be reported |
| ||
underlyingsecurityshares_number | Number of securities underlying the derivative security described in Column 1 | Column 7 Amount or Number of Shares | |
underlyingsecurityvalue_amount | Total value of Securities Described in Column 7 that underly the derivative security named in Column 1 | Column 7 Amount or Number of Shares when reported value is prepended with a $. | |
transactiontotalvalue | Value of derivative securities acquired or disposed in the reported transaction | Column 5 Number of Derivative Securities Acquired or Disposed - when value is prepended with a $. | |
remarks | This is the text reported at the bottom of the form in the section labeled REMARKS |
| |
EXTENDED | If there are more than 2 footnotes indicated for any reporting field this observation is repeated in the INSIDER_TRADING_EXTENDED database and can be identified using this field which is the ACCESSION_NUMBER concatenated to the RID with an underscore. Note, the INSIDER_TRADING_EXTENDED database has over 300 fields with approximately 200 additional footnote fields. The cases where there are more than two footnotes indicated for any data field are relativly infrequent and so this design is an attempt to balance availability with ease of access. |
| |
conversionorexerciseprice_footnote | Footnote mapped based on footnote code present in Conversion or Exercise Price of Derivative Security field | Column 2 | |
conversionorexerciseprice_footnote_1 | Footnote mapped based on footnote code present in Conversion or Exercise Price of Derivative Security field | Column 2 | |
deemedexecutiondate_footnote | Footnote mapped based on footnote code present in Deemed Execution Date Field field | Column 3A | |
deemedexecutiondate_footnote_1 | Footnote mapped based on footnote code present in Deemed Execution Date Field field | Column 3A | |
directorindirectownership_footnote | Footnote to Nature of Indirect Ownership | Column 7 | Column 11 |
directorindirectownership_footnote_1 | Footnote to Nature of Indirect Ownership | Column 7 | Column 11 |
exercisedate_footnote | Column 6 Date Exercisable | ||
exercisedate_footnote_1 | Column 6 Date Exercisable | ||
expirationdate_footnote | Column 6 Expiration Date | ||
expirationdate_footnote_1 | Column 6 Expiration Date | ||
natureofownership_footnote | Column 6 Ownership Form | Column 10 Ownership Form | |
natureofownership_footnote_1 | Column 6 Ownership Form | Column 10 Ownership Form | |
natureofownership_footnote_2 | Column 6 Ownership Form | Column 10 Ownership Form | |
natureofownership_footnote_3 | Column 6 Ownership Form | Column 10 Ownership Form | |
securitytitle_footnote | Column 1 | Column 1 | |
securitytitle_footnote_1 | Column 1 | Column 1 | |
sharesownedfollowingtransaction_footnote | Column 5 | Column 9 | |
sharesownedfollowingtransaction_footnote_1 | Column 5 | Column 9 | |
transactionacquireddisposedcode_footnote | Column 4 | ||
transactionacquireddisposedcode_footnote_1 | Column 4 | ||
transactioncoding_footnote | Column 3 | Column 4 | |
transactioncoding_footnote_1 | Column 3 | Column 4 | |
transactiondate_footnote | Column 2 | Column 3 | |
transactiondate_footnote_1 | Column 2 | Column 3 | |
transactionpricepershare_footnote | Column 4 Price | Column 8 | |
transactionpricepershare_footnote_1 | Column 4 Price | Column 8 | |
transactionshares_footnote | Column 4 Amount | Column 5 (A or D) | |
transactionshares_footnote_1 | Column 4 Amount | Column 5 (A or D) | |
transactiontimeliness_footnote | Not Visible on Form | Not Visible on Form | |
transactiontimeliness_footnote_1 | Not Visible on Form | Not Visible on Form | |
transactiontotalvalue_footnote | Column 5 (When value reported) | ||
transactiontotalvalue_footnote_1 | Column 5 (When value reported) | ||
underlyingsecurityshares_footnote | Column 7 (When number reported) | ||
underlyingsecurityshares_footnote_1 | Column 7 (When number reported) | ||
underlyingsecuritytitle_footnote | Column 7 Title | ||
underlyingsecuritytitle_footnote_1 | Column 7 Title | ||
underlyingsecurityvalue_footnote | Column 7 (When value reported) | ||
underlyingsecurityvalue_footnote_1 | Column 7 When value reported) | ||
valueownedfollowingtransaction_footnote | Column 5 (When Value Reported) | Column 9 (When Value Reported) | |
valueownedfollowingtransaction_footnote_1 | Column 5 (When Value Reported) | Column 9 (When Value Reported) | |
General Transaction Codes: | |
P | Open market or private purchase of non-derivative or derivative security |
S | Open market or private sale of non-derivative or derivative security |
V | Transaction voluntarily reported earlier than required |
Rule 16b-3 Transaction Codes: | |
A | Grant, award, or other acquisition pursuant to Rule 16b-3(d) |
D | Disposition to the issuer of issuer equity securities pursuant to Rule 16b-3(e) |
F | Payment of exercise price or tax liability by delivering or withholding securities incident to the receipt, exercise, or vesting of a security issued in accordance with Rule 16b-3 |
I | Discretionary transaction in accordance with Rule 16b-3(f) resulting in acquisition or disposition of issuer securities |
M | Exercise or conversion of derivative security exempted pursuant to Rule 16b-3 |
Derivative Securities Codes (Except transactions exempted pursuant to Rule 16b-3): | |
C | Conversion of derivative security |
E | Expiration of short derivative position |
H | Expiration (or cancellation) of long derivative position with value received |
O | Exercise of out-of-the-money derivative security |
X | Exercise of in-the-money or at-the-money derivative security |
Other Section 16(b) Exempt Transaction and Small Acquisition Codes: | |
G | Bona fide gift |
L | Small acquisition under Rule 16a-6 |
W | Acquisition or disposition by will or the laws of descent and distribution |
Z | Deposit into or withdrawal from voting trust |
Other Transaction Codes:
| |
J | Other acquisition or disposition (describe transaction) |
K | Transaction in equity swap or instrument with similar characteristics |
U | Disposition pursuant to a tender of shares in a change of control transaction? |