Data dictionary and feeds

Every field in the 7 datasets, with its type, unit, meaning and the law it is disclosed under. On the Company and Enterprise plans the same data comes as fixed feed URLs for Excel, Power BI or your data warehouse.

Connecting

Feeds are part of the Company and Enterprise plans. Send your licence key as an Authorization: Bearer <key> header, or, in tools that cannot set headers, add ?token= with the read-only feed token from the dashboard's Downloads page (the licence key itself is not accepted in a URL). The data changes only when it is refreshed, and the feeds support ETag and Last-Modified, so scheduled refreshes skip unchanged data. Filter with ?industry=, ?size=, ?market= and ?sec= (comma-separated codes).

Excel (Power Query): Data → From Web → enter https://hardestmarket.com/api/hc/feed/companies.csv?token=<feed token>.

Power BI: Get data → Web → Advanced: URL https://hardestmarket.com/api/hc/feed/companies.csv, HTTP request header Authorization = Bearer <key>.

curl -H "Authorization: Bearer $HC_KEY" https://hardestmarket.com/api/hc/feed/history.json

Treat the licence key like a password. The feed token opens the feeds only, and you can replace it at any time, which stops the old one. Manage it and team members from the dashboard.

Companies, latest figures

One row per listed company: the latest workforce and gender figures, industry percentiles, board, executive pay and targets.

Feed: https://hardestmarket.com/api/hc/feed/companies.csv · https://hardestmarket.com/api/hc/feed/companies.json

ColumnType · unitMeaningSource
sectextSecurities code (4 characters) on the Tokyo Stock Exchange.JPX
edinettextEDINET filer code.EDINET
corporate_numbertextNational Tax Agency corporate number (法人番号, 13 digits).NTA
leitextLegal Entity Identifier, where one exists.GLEIF
nametextCompany name in English.EDINET / JPX
industrytextTokyo Stock Exchange 33-industry classification.JPX
markettextListing market (Prime, Standard, Growth).JPX
size_bandtextHeadcount band used for benchmarks.The Hardest Market
period_enddateEnd of the fiscal year the figures relate to.Annual securities report (有価証券報告書), EDINET
fileddateDate the report was filed.EDINET
edinet_doctextEDINET document ID of the source filing, for audit.EDINET
employeesnumber · peopleEmployees of the reporting (parent) company.Annual securities report (有価証券報告書), EDINET
avg_salary_yennumber · JPY a yearAverage annual salary of the reporting company's employees, including bonuses.Annual securities report (有価証券報告書), EDINET
avg_agenumber · yearsAverage age of the reporting company's employees.Annual securities report (有価証券報告書), EDINET
avg_tenurenumber · yearsAverage length of service.Annual securities report (有価証券報告書), EDINET
female_manager_rationumber · %Women as a share of employees in management positions.Annual securities report; figure required under the Women's Advancement Act (女性活躍推進法)
male_childcare_leavenumber · %Share of eligible male employees who took childcare leave in the year. The legal formula can exceed 100% (leave this year for a child born last year). The basis (leave only, or leave plus childcare-purpose leave) is in gender_basis/notes.Annual securities report; Childcare and Family Care Leave Act
pay_gap_allnumber · % of menWomen's average pay as a percentage of men's, all employees.Annual securities report; figure required under the Women's Advancement Act (女性活躍推進法)
pay_gap_regularnumber · % of menWomen's average pay as a percentage of men's, regular (正規) employees.Annual securities report; figure required under the Women's Advancement Act (女性活躍推進法)
pay_gap_nonregularnumber · % of menWomen's average pay as a percentage of men's, part-time and fixed-term employees.Annual securities report; figure required under the Women's Advancement Act (女性活躍推進法)
employees_consolidatednumber · peopleEmployees of the group (consolidated).Annual securities report (有価証券報告書), EDINET
avg_salary_yen_industry_pctnumber · percentilePercentile of avg_salary_yen within the company's TSE industry (0 lowest, 100 highest).The Hardest Market
avg_age_industry_pctnumber · percentilePercentile of avg_age within the company's TSE industry (0 lowest, 100 highest).The Hardest Market
avg_tenure_industry_pctnumber · percentilePercentile of avg_tenure within the company's TSE industry (0 lowest, 100 highest).The Hardest Market
female_manager_ratio_industry_pctnumber · percentilePercentile of female_manager_ratio within the company's TSE industry (0 lowest, 100 highest).The Hardest Market
male_childcare_leave_industry_pctnumber · percentilePercentile of male_childcare_leave within the company's TSE industry (0 lowest, 100 highest).The Hardest Market
pay_gap_all_industry_pctnumber · percentilePercentile of pay_gap_all within the company's TSE industry (0 lowest, 100 highest).The Hardest Market
pay_gap_regular_industry_pctnumber · percentilePercentile of pay_gap_regular within the company's TSE industry (0 lowest, 100 highest).The Hardest Market
pay_gap_nonregular_industry_pctnumber · percentilePercentile of pay_gap_nonregular within the company's TSE industry (0 lowest, 100 highest).The Hardest Market
gender_basistextWhether the gender figures are the parent's or, where the parent has none, a named subsidiary's.Annual securities report (有価証券報告書), EDINET
notestextQuality notes on the figures (e.g. basis of the leave rate, corrections).The Hardest Market
officersnumber · peopleDirectors and auditors listed in the report (after the AGM where the report shows the proposal).Annual securities report (有価証券報告書), EDINET
women_officers_pctnumber · %Women as a share of officers.Annual securities report (有価証券報告書), EDINET
officers_median_agenumber · yearsMedian age of officers.Annual securities report (有価証券報告書), EDINET
hr_leader_among_officersyes/noWhether an inside director or listed officer has a title or current role covering HR.Annual securities report (有価証券報告書), EDINET
avg_exec_director_pay_yennumber · JPY a yearAverage pay of inside (executive) directors.Annual securities report (有価証券報告書), EDINET
exec_pay_multiple_of_avg_salarynumber · timesAverage inside-director pay divided by the average employee salary.Annual securities report (有価証券報告書), EDINET
officers_paid_100m_yen_plusnumber · peopleOfficers whose total pay of ¥100 million or more is disclosed individually.Annual securities report (有価証券報告書), EDINET
temporary_workers_parentnumber · peopleAverage temporary workers at the reporting company (outside the headcount).Annual securities report (有価証券報告書), EDINET
temporary_share_parent_pctnumber · %Temporary workers as a share of employees plus temporary workers.Annual securities report (有価証券報告書), EDINET
avg_salary_change_pctnumber · %Change in average salary on the previous report.Annual securities report (有価証券報告書), EDINET
women_managers_target_pctnumber · %The company's own published target for women in management.Annual securities report (有価証券報告書), EDINET
women_managers_target_yearinteger · yearYear by which the target is to be met.Annual securities report (有価証券報告書), EDINET
women_managers_actual_vs_target_pctnumber · %The actual figure the company reports beside its target.Annual securities report (有価証券報告書), EDINET

History

One row per company and fiscal year filed: the same figures over time.

Feed: https://hardestmarket.com/api/hc/feed/history.csv · https://hardestmarket.com/api/hc/feed/history.json

ColumnType · unitMeaningSource
sectextSecurities code (4 characters) on the Tokyo Stock Exchange.JPX
edinettextEDINET filer code.EDINET
corporate_numbertextNational Tax Agency corporate number (法人番号, 13 digits).NTA
nametextCompany name in English.EDINET / JPX
fiscal_yearinteger · yearFiscal year (calendar year in which it ends).Annual securities report (有価証券報告書), EDINET
period_enddateEnd of the fiscal year the figures relate to.Annual securities report (有価証券報告書), EDINET
fileddateDate the report was filed.EDINET
edinet_doctextEDINET document ID of the source filing, for audit.EDINET
employeesnumber · peopleEmployees of the reporting (parent) company.Annual securities report (有価証券報告書), EDINET
avg_salary_yennumber · JPY a yearAverage annual salary of the reporting company's employees, including bonuses.Annual securities report (有価証券報告書), EDINET
avg_agenumber · yearsAverage age of the reporting company's employees.Annual securities report (有価証券報告書), EDINET
avg_tenurenumber · yearsAverage length of service.Annual securities report (有価証券報告書), EDINET
female_manager_rationumber · %Women as a share of employees in management positions.Annual securities report; figure required under the Women's Advancement Act (女性活躍推進法)
male_childcare_leavenumber · %Share of eligible male employees who took childcare leave in the year. The legal formula can exceed 100% (leave this year for a child born last year). The basis (leave only, or leave plus childcare-purpose leave) is in gender_basis/notes.Annual securities report; Childcare and Family Care Leave Act
pay_gap_allnumber · % of menWomen's average pay as a percentage of men's, all employees.Annual securities report; figure required under the Women's Advancement Act (女性活躍推進法)
pay_gap_regularnumber · % of menWomen's average pay as a percentage of men's, regular (正規) employees.Annual securities report; figure required under the Women's Advancement Act (女性活躍推進法)
pay_gap_nonregularnumber · % of menWomen's average pay as a percentage of men's, part-time and fixed-term employees.Annual securities report; figure required under the Women's Advancement Act (女性活躍推進法)
employees_consolidatednumber · peopleEmployees of the group (consolidated).Annual securities report (有価証券報告書), EDINET

Boards and HR leaders

One row per company (or per HR leader where there are several): board size, women, ages, and the HR leader named among officers.

Feed: https://hardestmarket.com/api/hc/feed/board.csv · https://hardestmarket.com/api/hc/feed/board.json

ColumnType · unitMeaningSource
sectextSecurities code (4 characters) on the Tokyo Stock Exchange.JPX
edinettextEDINET filer code.EDINET
corporate_numbertextNational Tax Agency corporate number (法人番号, 13 digits).NTA
nametextCompany name in English.EDINET / JPX
industrytextTokyo Stock Exchange 33-industry classification.JPX
fileddateDate the report was filed.EDINET
basistextWhether the board is as at filing or as proposed to the AGM.Annual securities report (有価証券報告書), EDINET
officersnumber · peopleDirectors and auditors listed in the report (after the AGM where the report shows the proposal).Annual securities report (有価証券報告書), EDINET
womennumber · peopleWomen among them.Annual securities report (有価証券報告書), EDINET
women_pctnumber · %Women as a share of officers.Annual securities report (有価証券報告書), EDINET
median_agenumber · yearsMedian age of officers.Annual securities report (有価証券報告書), EDINET
mean_agenumber · yearsMean age of officers.Annual securities report (有価証券報告書), EDINET
under_50number · peopleOfficers under 50.Annual securities report (有価証券報告書), EDINET
aged_70_plusnumber · peopleOfficers aged 70 or over.Annual securities report (有価証券報告書), EDINET
hr_leader_nametextName of that HR leader (romanised).Annual securities report (有価証券報告書), EDINET
hr_leader_name_jatextName in Japanese.Annual securities report (有価証券報告書), EDINET
hr_leader_title_jatextTitle as printed in the report.Annual securities report (有価証券報告書), EDINET
hr_leader_current_role_jatextCurrent role from the career summary, where the title does not mention HR.Annual securities report (有価証券報告書), EDINET
identified_fromtext"title" or "career": where the HR role was found.The Hardest Market
chro_titleyes/noWhether the title is CHRO or chief human resources officer.Annual securities report (有価証券報告書), EDINET

Targets

One row per published target (women in management, fathers' leave, pay gap and others), with the actual figure beside it.

Feed: https://hardestmarket.com/api/hc/feed/targets.csv · https://hardestmarket.com/api/hc/feed/targets.json

ColumnType · unitMeaningSource
sectextSecurities code (4 characters) on the Tokyo Stock Exchange.JPX
edinettextEDINET filer code.EDINET
corporate_numbertextNational Tax Agency corporate number (法人番号, 13 digits).NTA
nametextCompany name in English.EDINET / JPX
industrytextTokyo Stock Exchange 33-industry classification.JPX
period_enddateEnd of the fiscal year the figures relate to.Annual securities report (有価証券報告書), EDINET
metric_typetextWhich target: women_managers, male_leave, pay_gap or other.The Hardest Market
metric_jatextThe metric as named in the report.Annual securities report (有価証券報告書), EDINET
unit_jatextUnit as printed.Annual securities report (有価証券報告書), EDINET
targetnumber · as unit_jaTarget value.Annual securities report (有価証券報告書), EDINET
actualnumber · as unit_jaActual value reported beside the target.Annual securities report (有価証券報告書), EDINET
target_yearinteger · yearTarget year.Annual securities report (有価証券報告書), EDINET

Executive pay

One row per company (or per officer paid ¥100 million or more): inside-director pay and its multiple of the average salary.

Feed: https://hardestmarket.com/api/hc/feed/officer-pay.csv · https://hardestmarket.com/api/hc/feed/officer-pay.json

ColumnType · unitMeaningSource
sectextSecurities code (4 characters) on the Tokyo Stock Exchange.JPX
edinettextEDINET filer code.EDINET
corporate_numbertextNational Tax Agency corporate number (法人番号, 13 digits).NTA
nametextCompany name in English.EDINET / JPX
industrytextTokyo Stock Exchange 33-industry classification.JPX
period_enddateEnd of the fiscal year the figures relate to.Annual securities report (有価証券報告書), EDINET
exec_directorsnumber · peopleInside directors in the pay disclosure.Annual securities report (有価証券報告書), EDINET
avg_exec_director_pay_yennumber · JPY a yearAverage pay of inside (executive) directors.Annual securities report (有価証券報告書), EDINET
avg_salary_yennumber · JPY a yearAverage annual salary of the reporting company's employees, including bonuses.Annual securities report (有価証券報告書), EDINET
multiplenumber · timesAverage inside-director pay divided by the average employee salary.Annual securities report (有価証券報告書), EDINET
officer_paid_100m_plustextName of an officer paid ¥100 million or more (one row each).Annual securities report (有価証券報告書), EDINET
officer_jatextName in Japanese.Annual securities report (有価証券報告書), EDINET
officer_group_pay_yennumber · JPY a yearThat officer's total pay.Annual securities report (有価証券報告書), EDINET

Subsidiaries

One row per subsidiary that a listed parent reports gender figures for.

Feed: https://hardestmarket.com/api/hc/feed/subsidiaries.csv · https://hardestmarket.com/api/hc/feed/subsidiaries.json

ColumnType · unitMeaningSource
sectextSecurities code (4 characters) on the Tokyo Stock Exchange.JPX
parent_corporate_numbertextCorporate number of the listed parent.NTA
parenttextListed parent company name.EDINET
fiscal_yearinteger · yearFiscal year (calendar year in which it ends).Annual securities report (有価証券報告書), EDINET
orderintegerOrder of the subsidiary in the report.Annual securities report (有価証券報告書), EDINET
subsidiarytextSubsidiary name (English).Annual securities report (有価証券報告書), EDINET
subsidiary_jatextSubsidiary name (Japanese).Annual securities report (有価証券報告書), EDINET
female_manager_rationumber · %Women as a share of employees in management positions.Annual securities report; figure required under the Women's Advancement Act (女性活躍推進法)
male_childcare_leavenumber · %Share of eligible male employees who took childcare leave in the year. The legal formula can exceed 100% (leave this year for a child born last year). The basis (leave only, or leave plus childcare-purpose leave) is in gender_basis/notes.Annual securities report; Childcare and Family Care Leave Act
pay_gap_allnumber · % of menWomen's average pay as a percentage of men's, all employees.Annual securities report; figure required under the Women's Advancement Act (女性活躍推進法)
pay_gap_regularnumber · % of menWomen's average pay as a percentage of men's, regular (正規) employees.Annual securities report; figure required under the Women's Advancement Act (女性活躍推進法)
pay_gap_nonregularnumber · % of menWomen's average pay as a percentage of men's, part-time and fixed-term employees.Annual securities report; figure required under the Women's Advancement Act (女性活躍推進法)

All employers (MHLW)

One row per employer in MHLW's women's-advancement database, listed and unlisted, including foreign-owned subsidiaries.

Feed: https://hardestmarket.com/api/hc/feed/employers.csv · https://hardestmarket.com/api/hc/feed/employers.json

ColumnType · unitMeaningSource
corporate_numbertextNational Tax Agency corporate number (法人番号, 13 digits).NTA
name_jatextEmployer name in Japanese.MHLW women's-advancement database (女性の活躍推進企業データベース)
prefecturetextPrefecture of the head office.MHLW women's-advancement database (女性の活躍推進企業データベース)
industry_jsictextJapan Standard Industrial Classification division, as MHLW labels it.MHLW women's-advancement database (女性の活躍推進企業データベース)
industry_jsic_entextThe same in English.The Hardest Market
size_bandtextHeadcount band used for benchmarks.The Hardest Market
data_scopetextWhether figures cover the employer or a group.MHLW women's-advancement database (女性の活躍推進企業データベース)
data_as_oftextDate the employer states its figures relate to.MHLW women's-advancement database (女性の活躍推進企業データベース)
updateddateDate the employer last updated its entry.MHLW women's-advancement database (女性の活躍推進企業データベース)
employment_category_1textEmployment category the figures refer to, as the employer reports.MHLW women's-advancement database (女性の活躍推進企業データベース)
women_managersnumber · %Women in management.MHLW women's-advancement database (女性の活躍推進企業データベース)
women_supervisorsnumber · %Women at supervisor (係長) level.MHLW women's-advancement database (女性の活躍推進企業データベース)
women_officersnumber · %Women among officers (役員), as the employer reports.MHLW women's-advancement database (女性の活躍推進企業データベース)
pay_gap_allnumber · % of menWomen's average pay as a percentage of men's, all employees.Annual securities report; figure required under the Women's Advancement Act (女性活躍推進法)
pay_gap_regularnumber · % of menWomen's average pay as a percentage of men's, regular (正規) employees.Annual securities report; figure required under the Women's Advancement Act (女性活躍推進法)
pay_gap_nonregularnumber · % of menWomen's average pay as a percentage of men's, part-time and fixed-term employees.Annual securities report; figure required under the Women's Advancement Act (女性活躍推進法)
male_childcare_leavenumber · %Share of eligible male employees who took childcare leave in the year. The legal formula can exceed 100% (leave this year for a child born last year). The basis (leave only, or leave plus childcare-purpose leave) is in gender_basis/notes.Annual securities report; Childcare and Family Care Leave Act
female_childcare_leavenumber · %Women taking childcare leave.MHLW women's-advancement database (女性の活躍推進企業データベース)
overtime_hoursnumber · hours a monthAverage overtime per worker.MHLW women's-advancement database (女性の活躍推進企業データベース)
paid_leave_uptakenumber · %Annual paid leave taken as a share of leave granted.MHLW women's-advancement database (女性の活躍推進企業データベース)
women_share_of_hiresnumber · %Women as a share of new hires.MHLW women's-advancement database (女性の活躍推進企業データベース)
women_share_of_workforcenumber · %Women as a share of the workforce.MHLW women's-advancement database (女性の活躍推進企業データベース)
tenure_mnumber · yearsAverage tenure, men.MHLW women's-advancement database (女性の活躍推進企業データベース)
tenure_fnumber · yearsAverage tenure, women.MHLW women's-advancement database (女性の活躍推進企業データベース)
retention10_mnumber · %Men hired about ten years ago who are still employed.MHLW women's-advancement database (女性の活躍推進企業データベース)
retention10_fnumber · %Women hired about ten years ago who are still employed.MHLW women's-advancement database (女性の活躍推進企業データベース)
hiring_ratio_mnumber · applicants per hireCompetition for jobs, men.MHLW women's-advancement database (女性の活躍推進企業データベース)
hiring_ratio_fnumber · applicants per hireCompetition for jobs, women.MHLW women's-advancement database (女性の活躍推進企業データベース)
midcareer_hires_mnumber · peopleMid-career hires, men.MHLW women's-advancement database (女性の活躍推進企業データベース)
midcareer_hires_fnumber · peopleMid-career hires, women.MHLW women's-advancement database (女性の活躍推進企業データベース)
policiestextPolicies the employer lists.MHLW women's-advancement database (女性の活躍推進企業データベース)
certificationstextGovernment certifications held (e.g. Eruboshi, Kurumin, Health & Productivity).MHLW / METI / gBizINFO
foreign_parenttextForeign parent company, where identified.GLEIF / company websites
foreign_parent_countrytextCountry of that parent.GLEIF
notestextQuality notes on the figures (e.g. basis of the leave rate, corrections).The Hardest Market

Plans and prices: Company and Enterprise. Sources: EDINET (Financial Services Agency, Public Data License 1.0), MHLW, National Tax Agency, GLEIF.