Skip to main content
How Can We Help?

Search for answers or browse our knowledge base.

Return to Support Front Page

Categories
Print

Insider Trading Database

We have successfully moved all of the parsed and extracted 2005-2021 insider trading and transactions reported on Forms 3/4/5 as well as the amended versions of those forms to the INSIDER_TRADING.db file accessible through the user instances. We expect to have the 2022 data available by the end of November and the 2023 data will be fully available by the middle of January 2024.

There are three caveats as of 11/13/2023. When the data was initially pulled we were responding to a client request and made a mistake in that we did not parse and include the ACCEPTANCE_DATETIME field. At the present time we are back-filling these values. Because of the importance of respecting the SEC limits on automated data collection from EDGAR we can only do this work during the evenings and weekends so it does not interfere with our primary collection of the filings we pull and parse each day. Each week we should be able to update approximately one million rows until the task is complete. When it is complete this caveat will disappear.

The second caveat is that this data is very dense and the main insider trading database has over 90 columns. It is going to challenge your patience to attempt to use the ExtractionEngine’s QueryTool to identify and extract data. We have made available a Python script that is written to pull the data by CIK, YEAR and save the results to csv files. You are not likely to be successful using Panda’s to access this data because of the impact of the size of the database and the way Pandas uses memory. The script can be found on the platform in the S:\PythonCode folder (“S:\PythonCode\read_insider_trading_db.py”). Please do not hesitate to ask for help modifying the script to match your particular needs.

The third caveat is that the Insider Trading Database is incomplete. Some filings have more than 30 footnotes associated with one data value (Example Link). To make this database more tractable this primary database only includes the first two footnotes associated with any particular field. If a row has more than two footnotes, there is value in the EXTENDED field. That value is a derived value of the ACCESSION_NUMBER and row number (RID) (ACCESSION_RID). If there is a value in EXTENDED then the entire row is repeated in the INSIDER_TRADING_EXTENDED.db file. We will be anxious to hear your comments after you have had some experience using this data.

There are two linked tables. The first one has the field names and an explanation as well as a mapping of the field to the forms. The second one contains a list of the transaction codes that are reported in the forms.

Path

"S:/directEDGAR_DATA/INSIDER_TRADING.db"

Table Name

INSIDER_TRADING


FIELDNAME

DESCRIPTION

The following fields are pulled from the header file or the top of the form that identify the reporting person, the issuer and the relationship of the reporting person to the issuer

ACCESSION_NUMBER

The ACCESSION number for the filing the data was pulled from.

Header

DISSEMINATION_DATE

Based on the header, this represents the date the filing was made available through EDGAR. Ownership reports are accepted until 10:00 pm ET M-F and are generally made available on EDGAR almost immediately after they have been filed.

Header

ACCEPTANCE_DATETIME

This is the value as reported in the header file as the date/time the filing was accepted by the EDGAR system.

Header - note as of 11/13/2023 this value is present in only

YEAR

Imputed from the ACCEPTANCE_DATETIME

Header

CIK

The Central Index Key of the issuer whose securties the report relates to

Header

documenttype

The specific filing type, expected values are 3, 3/A, 4, 4/A, 5, 5/A

Header and documenttype field in raw xml

form3holdingsreported

1/0 Expected only in Forms 5 & 5/A

Check Box above name box in Form 5

form4transactionsreported

1/0 Expected only in Forms 5 & 5/A

Check Box above name box in Form 5

nosecuritiesowned

1/0, expected only in 3 & 3/A filings. Value set by EDGAR 1 to indicate report has some ownership disclosure, 0 to indicate no ownership - value is often not consistent with data tables and should generally not be relied upon to filter.

Pulled directly from XML - EDGAR imputes this - it often wrong when a non-blank 3 or 3/A submitted when the holdings section reports 0 Securities Owned

transactiontimeliness

E - Reported Early, L Reported Late, blank - reported On-time

Note - these codes are not visible on the form, instead for transactions/holdings relating to Nonderivative securities Column 3 V will have a V value, for Derivative securities Column 4 V will report a V value.

dateoforiginalsubmission

If 3/A, 4/A, or 5/A - the date of the original filing that is being amended

Box 4

issuertradingsymbol

Issuer Trading Symbol - as reported on the date of the filing

Box 2

issuername

Issuer Name - as reported on the date of the filing

Box 2

rptownercik

Central Index Key of the reporting owner

Header

rptownername

Name of the reporting owner

Box 1

rptownerstreet1

Line 1 of the street address of the reporting owner

Box 1

rptownerstreet2

Line 2 of the street address of the reporting owner

Box 1

rptownercity

City of the reporting address of the reporting owner

Box 1

rptownerstate

State of the reporting address of the reporting owner

Box 1

rptownerzipcode

Zip-code of the reporting address of the reporting owner

Box 1

rptownerstatedescription

Country of the reporting owner if not a US State Code

Not visible on form - imputed by EDGAR based on value of rptownerstate

isdirector

1/0 to indicate if the reporting person is a director of the issuer.

Box 5

isofficer

1/0 to indicate if the reporting person is an officer of the issuer.

Box 5

officertitle

Title of officer

Box 5

isother

1/0, if 1 then field othertext should be present and describe the relationship between the reporting person and the issuer such that they are filing the report

Box 5

othertext

If Other is checked in Box 5 - Relationship this is the explanation of the relationship between the reporting person(s) and the issuer.

Box 5

istenpercentowner

1/0, if 1 then the reporting person owns 10% or more of the securities of the issuer

Box 5

aff10b5One

1/0, if 1 indicates the reporting person is asserting that the transactions reported were carried out under a 10b5-1(c) plan, note - this field was only added in March 2023.

Checkbox on form

notsubjecttosection16

1/0, Present only in 4, 4/A, 5, 5/A filings 1 indicates the reporting person is no longer subject to Section 16 for this issuer

Checkbox on form

RID

Imputed field, represents the row count from the first transaction/holding reported in the filing to the last - this value is derived from the XML filing element order

datatype

Derived from the nature of the content of the filing and row, values can be None, nonderivativetransaction, derivativetransaction, nonderivativeholding, derivativeholding or remarks

The Following Values Are Pulled from Table 1 (Nonderivative Transactions and or Holdings) or Table 2 (Derivative Transactions and or Holdings) The Column Numbers Represent the Column Numbers as Shown on the Various Forms

FIELDNAME

DESCRIPTION

Table 1 (Nonderivative Transaction & Holdings)

Table 2 (Derivative Transaction & Holdings)

securitytitle

Name of the security as reported in the filing, for nonderivative transactions and holdings the name represents the name of the derivative instrument, convertible classes of common can be derivative securities.

Column 1

Column 1

conversionorexerciseprice

Conversion or exercise price of the derivative security

Column 2

deemedexecutiondate

If the transaction is executed by a plan administrator, the deemed execution date is deemed to be the date the administrator notifies the reporting person of the transaction, if the notification occurs later than the 3rd businss date following the transaction - the deemed execution date is the third business day following the transaction.

Column 2A

Column 3A

transactiondate

The date of the transaction that is being reported.

Column 2

Column 3

transactionformtype

This value identifies the form type that otherwise should have been used to report the transaction or holding. Valid values for a 4 or 4/A submission are 4 or 5. Valid values for a 5 or 5/A submission are 3, 4 or 5.

This value is not reported/visible in the html. In some circumstance it could be be established by analyzing attributes of the transaction or holding reported

transactioncode

See the list of valid values below this schedule, the code describes the nature of the underlying transaction conformed to the SEC's set of transaction reasons.

Column 3 Code

Column 3 Code

equityswapinvolved

Value is 1/O in the database

In the HTML version of the filing the value in Column 3 will have a /K appended

In the HTML version of the filing the value in Column 4 will have a /K appended

transactionshares_number

The number of shares that were acquired or disposed of in the transaction.

Column 4

Column 5

exercisedate

The date the derivative security became/becomes exercisable

Column 6, Date Exercisable

expirationdate

The expiration date of the derivative security.

Column 6 Expiration Date

transactionpricepershare

For nonderivative transactions, the amount reported in Column 4 Price, for derivative transactions this is the amount reported in Column 8 Price of Derivative Security

Column 4 Price

Column 8

transactionacquireddisposedcode

For nonderivative transactions this is the value reported in Column 4 (A) or (D). For derivativetransactions this is the column (A) or (D) that the transactionshares_number was reported in

Column 5 (A) or Column 5 (D)

Note - only one of Number or Value can be reported

number_shares_owned_following_transaction

Number of securities owned owned following the reported transaction

Column 5

Column 9

value_shares_owned_following_transaction

Dollar value of the listed security held following the transaction

Column 5 - when a $ sign prepended to the value reported

Column 9 - when a $ sign prepended to the value reported

directorindirectownership

D/I to indicate direct or indirect ownership

Column 6

Column 10

natureofownership

If Indirect Ownership, explanation of the nature of that ownership

Column 7

Column 11

underlyingsecuritytitle

Title/Name of securities underlying Derivative Security

Column 7 Title

Note - only one of Number or Value can be reported

underlyingsecurityshares_number

Number of securities underlying the derivative security described in Column 1

Column 7 Amount or Number of Shares

underlyingsecurityvalue_amount

Total value of Securities Described in Column 7 that underly the derivative security named in Column 1

Column 7 Amount or Number of Shares when reported value is prepended with a $.

transactiontotalvalue

Value of derivative securities acquired or disposed in the reported transaction

Column 5 Number of Derivative Securities Acquired or Disposed - when value is prepended with a $.

remarks

This is the text reported at the bottom of the form in the section labeled REMARKS

EXTENDED

If there are more than 2 footnotes indicated for any reporting field this observation is repeated in the INSIDER_TRADING_EXTENDED database and can be identified using this field which is the ACCESSION_NUMBER concatenated to the RID with an underscore. Note, the INSIDER_TRADING_EXTENDED database has over 300 fields with approximately 200 additional footnote fields. The cases where there are more than two footnotes indicated for any data field are relativly infrequent and so this design is an attempt to balance availability with ease of access.

conversionorexerciseprice_footnote

Footnote mapped based on footnote code present in Conversion or Exercise Price of Derivative Security field

Column 2

conversionorexerciseprice_footnote_1

Footnote mapped based on footnote code present in Conversion or Exercise Price of Derivative Security field

Column 2

deemedexecutiondate_footnote

Footnote mapped based on footnote code present in Deemed Execution Date Field field

Column 3A

deemedexecutiondate_footnote_1

Footnote mapped based on footnote code present in Deemed Execution Date Field field

Column 3A

directorindirectownership_footnote

Footnote to Nature of Indirect Ownership

Column 7

Column 11

directorindirectownership_footnote_1

Footnote to Nature of Indirect Ownership

Column 7

Column 11

exercisedate_footnote

Column 6 Date Exercisable

exercisedate_footnote_1

Column 6 Date Exercisable

expirationdate_footnote

Column 6 Expiration Date

expirationdate_footnote_1

Column 6 Expiration Date

natureofownership_footnote

Column 6 Ownership Form

Column 10 Ownership Form

natureofownership_footnote_1

Column 6 Ownership Form

Column 10 Ownership Form

natureofownership_footnote_2

Column 6 Ownership Form

Column 10 Ownership Form

natureofownership_footnote_3

Column 6 Ownership Form

Column 10 Ownership Form

securitytitle_footnote

Column 1

Column 1

securitytitle_footnote_1

Column 1

Column 1

sharesownedfollowingtransaction_footnote

Column 5

Column 9

sharesownedfollowingtransaction_footnote_1

Column 5

Column 9

transactionacquireddisposedcode_footnote

Column 4

transactionacquireddisposedcode_footnote_1

Column 4

transactioncoding_footnote

Column 3

Column 4

transactioncoding_footnote_1

Column 3

Column 4

transactiondate_footnote

Column 2

Column 3

transactiondate_footnote_1

Column 2

Column 3

transactionpricepershare_footnote

Column 4 Price

Column 8

transactionpricepershare_footnote_1

Column 4 Price

Column 8

transactionshares_footnote

Column 4 Amount

Column 5 (A or D)

transactionshares_footnote_1

Column 4 Amount

Column 5 (A or D)

transactiontimeliness_footnote

Not Visible on Form

Not Visible on Form

transactiontimeliness_footnote_1

Not Visible on Form

Not Visible on Form

transactiontotalvalue_footnote

Column 5 (When value reported)

transactiontotalvalue_footnote_1

Column 5 (When value reported)

underlyingsecurityshares_footnote

Column 7 (When number reported)

underlyingsecurityshares_footnote_1

Column 7 (When number reported)

underlyingsecuritytitle_footnote

Column 7 Title

underlyingsecuritytitle_footnote_1

Column 7 Title

underlyingsecurityvalue_footnote

Column 7 (When value reported)

underlyingsecurityvalue_footnote_1

Column 7 When value reported)

valueownedfollowingtransaction_footnote

Column 5 (When Value Reported)

Column 9 (When Value Reported)

valueownedfollowingtransaction_footnote_1

Column 5 (When Value Reported)

Column 9 (When Value Reported)

General Transaction Codes:

P

Open market or private purchase of non-derivative or derivative security

S

Open market or private sale of non-derivative or derivative security

V

Transaction voluntarily reported earlier than required

Rule 16b-3 Transaction Codes:

A

Grant, award, or other acquisition pursuant to Rule 16b-3(d)

D

Disposition to the issuer of issuer equity securities pursuant to Rule 16b-3(e)

F

Payment of exercise price or tax liability by delivering or withholding securities incident to the receipt, exercise, or vesting of a security issued in accordance with Rule 16b-3

I

Discretionary transaction in accordance with Rule 16b-3(f) resulting in acquisition or disposition of issuer securities

M

Exercise or conversion of derivative security exempted pursuant to Rule 16b-3

Derivative Securities Codes (Except transactions exempted pursuant to Rule 16b-3):

C

Conversion of derivative security

E

Expiration of short derivative position

H

Expiration (or cancellation) of long derivative position with value received

O

Exercise of out-of-the-money derivative security

X

Exercise of in-the-money or at-the-money derivative security

Other Section 16(b) Exempt Transaction and Small Acquisition Codes:

G

Bona fide gift

L

Small acquisition under Rule 16a-6

W

Acquisition or disposition by will or the laws of descent and distribution

Z

Deposit into or withdrawal from voting trust

Other Transaction Codes:

J

Other acquisition or disposition (describe transaction)

K

Transaction in equity swap or instrument with similar characteristics

U

Disposition pursuant to a tender of shares in a change of control transaction?

Table of Contents