First: labor market changes that began before ChatGPT
- The number of entry-level software developer postings hit a low in spring 2020, when COVID-19 took hold, then roughly doubled to a peak in summer 2022. It began a steady decline in the second half of that year (before ChatGPT's release in late November), and by January 2025 it had fallen by more than half, to a level below even the 2020 low.
- To measure this drop in entry-level hiring, we used blue-collar jobs, which have almost nothing to do with generative AI, as a comparison group. Only two occupations showed a statistically significant decline: software developers (-33.5%) and digital design (-20.6%). The decline appeared at both tech and non-tech firms.
Second: labor market changes that began after generative AI arrived (November 2022) Key finding of this study
- The experience required in software developer postings held at about 3.73 years on average through summer 2022. After ChatGPT's release it rose steadily, reaching 5.18 years as of January 2025.
- The pattern goes beyond developers: the more exposed a job is to generative AI, the more its required experience rose. Even when comparing postings from the same firm, month and occupational group, jobs with 1 standard deviation higher exposure to generative AI saw required experience rise by an additional 0.073 years after generative AI arrived. The effect stayed significant at +0.055 years (p<.05) after excluding IT occupations and IT-industry firms.
- Some argue that this is an "illusion" created by the factors below rather than an effect of AI. Our models rejected all of them.
After ChatGPT arrived in November 2022 as the first conversational generative AI in wide public use, two debates emerged.
- Has AI reduced white-collar jobs? Or, contrary to popular belief, is there no clear sign of that?
- Does AI favor junior workers, because it makes it easier to learn new knowledge and build skills? Or does it favor senior workers, because it lets people who already have expert knowledge handle more work at once?
There is also substantial pushback, because hiring in these occupations may have started falling before ChatGPT (AI) arrived.
There are counter-rebuttals too. The main argument is that even if the drop in total hiring is explained by rate hikes and the business cycle, the shift in the share of young and junior hires began after ChatGPT or continued after rates peaked.
Studies are also coming out in Korea, and the debate there looks much like the one abroad.
These debates persist mainly because an unusually large number of confounding factors appeared within a year on either side of ChatGPT's arrival.
Confounding factors around ChatGPT's release
Tap each marker to see details.
- Pandemic-era surge in IT hiring and the correction that followed: the COVID-19 digital transformation boom of 2020-2021 drove a surge in developer hiring, which then declined from the second half of 2022.
- Interest rate hikes: the Bank of Korea began raising its base rate in August 2021, and the U.S. Federal Reserve in March 2022.
- Investment slump and restructuring: as an extension of those rate hikes, a slowdown in venture investment followed in 2022-2023.
Underscore collected 15,073,974 job postings from February 2017 to April 2025 from one of Korea's largest job platforms. We excluded 2017 through the first half of 2019, a period when many old postings have since been deleted, and analyzed the 10,413,271 postings with a posting date (application start date) between July 2019 and January 2025.
From each posting we extracted variables including the title, company name, experience requirement, education requirement, employment type, salary, work location, qualifications, preferred qualifications, application start and end dates, and job and region tags. The variables below were central to this analysis.
- Job classification: beyond occupational groups such as "IT Development & Data, Backend/Server Development," the job tags go down to detailed keywords such as "languages and frameworks (Java, Python, embedded, firmware, etc.)." This let us look in more detail at software development, the occupation at the center of the debate over AI and job losses.
- Experience requirement: requirements such as "Entry-level," "Any (incl. entry-level)," "Entry-level or 3+ yrs" and "3-10 yrs experience." From these we calculated entry eligibility (whether entry-level applicants can apply) and the average required years of experience. (e.g., 3-10 years → 6.5; 4 years or less → 2)
- Firm identification: using the firm identifier attached to each posting, we obtained the industry, business description, founding date and firm type for 337,158 companies, 77.6% of the 434,688 unique firms behind the 10,413,271 postings (87% of postings). We also matched business registration numbers (BRN) using the Korea Fair Trade Commission (KFTC) registry of mail-order businesses and the Financial Supervisory Service (FSS) DART electronic disclosure system, among other sources. This let us confirm the business details of 96.7% of the firms with firm information (75.0% of all firms) in administrative records, beyond the identifiers the job platform provides.
To measure each job's exposure to AI, we followed the method of Eloundou et al. (2023). That study scored whether about 19,000 detailed tasks in the U.S. Occupational Information Network (O*NET) could be done in at least half the time at the same quality using a large language model (LLM). We linked 1,920 job keywords in the postings data to O*NET occupations and gave each a job exposure score β.
Look up your job's exposure to generative AI
Job exposure β (0-1) for 1,915 job keywords from job postings. Each keyword is shown in English along with its original Korean tag and the matched O*NET occupation, and you can search by any of them or tap an example below. The bars below show how all postings are distributed by exposure.
- The roughly 1,900 β values cover 99.8% of all postings.
- We linked keywords to O*NET occupations in two ways.
- 800 were linked to O*NET occupations through the KNOW occupations of the Korea Employment Information Service (KEIS) (681 of them directly via KNOW occupation codes). The remaining 1,120 were matched directly to O*NET occupations with help from generative AI, then reviewed and confirmed by people.
- Keywords with no matching O*NET occupation (119 via the KNOW route, 35 via direct matching) were assigned the average β of the 2-3 keywords closest in meaning.
- The scores were high for backend development (0.87), app development (0.87) and bookkeeping (0.78), and low for basic production work (0.08) and nursing assistants (0.11), in line with intuition.
- Unless noted otherwise, the tables and charts in this report measure a posting's exposure using the first keyword with a β value in its list of job keywords, because earlier tags better represent the job in a posting. In a random sample of 1 million postings, the share of keywords that appear in the posting title was 28% for the first tag, 16% for the second and 12% for the third, falling with each position. As described later, we also checked that the results hold when exposure is aggregated in other ways, such as the mean, median or maximum across all job keywords.
- We defined occupations by job keywords. For each of 16 occupations, including software developers (16 keywords such as Backend/Server Development, Frontend and Java), IT infrastructure (H/W, SE), physical design (interior, fashion, exhibition), digital design and bookkeeping, we set a keyword list (Appendix) and split each posting across occupations in proportion to each occupation's share of the posting's job keywords.
Separately, we quantified firms' exposure to AI, that is, "Can generative AI directly produce the core output of this firm's industry?" Two models, OpenAI's GPT-5.6 Astra and Anthropic's Claude Opus 5, scored each industry on the same criteria, giving us firm exposure A.
- The two models' scores had a correlation of 0.983, which is very high.
- As with job exposure, the scores matched intuition: application software development (0.93) and advertising agencies (0.89) scored high, while general clinics (0.07) and restaurants (0.05) scored low.
To check the posting data against actual employment outcomes, we also collected and analyzed the Employment Insurance Statistics that the Korea Employment Information Service (KEIS) publishes monthly (new enrollments by broad industry and insured workers by age). Because these figures are broken down only by broad industry, they show the information and communications industry as a whole but not the detail available in the posting data, so we used them only as supporting evidence.
1Since 2022, the share of entry-level postings has fallen in IT and across office and professional jobs more broadly.
Share of entry-level postings by occupation
Share of all postings open to entry-level applicants (%), annual average
- For software developers, digital design and bookkeeping, both entry-level and experienced-worker postings fell, while for IT infrastructure, physical design, marketing and sales, experienced-worker postings rose and only entry-level postings fell. From 2022 to 2024, the entry-level share changed by -10.3 pp for software developers, -13.8 pp for IT infrastructure, -12.7 pp for physical design, -9.7 pp for sales and -2.6 pp for blue-collar jobs (the comparison group).
- Up to this point, the entry-level hiring rate for blue-collar jobs is almost unchanged, while other office occupations appear to turn in 2022, the year ChatGPT appeared. That makes it look like a causal effect of AI. But...
2Entry-level developer postings began a sustained decline in summer 2022.
Index of postings open to entry-level applicants, by occupation
Number of postings open to entry-level applicants (2022 average = 100), monthly. Tap the legend to turn occupations on and off.
- Compared with 2022, average monthly entry-level postings in 2024 changed by -43% for software developers, -34% for digital design, -24% for IT infrastructure and -4% for blue-collar jobs.
- Because a clear decline shows up relative to blue-collar jobs, the comparison group, it is tempting to read this as an AI effect. But the turning point overlaps with the rate-hike period, so it is hard to say clearly how much of the change comes from the business cycle and how much from AI. On top of that, the turning point, summer 2022, came a full six months before ChatGPT appeared.
- That question aside, our data does not support the claim that "developer hiring fell because of the startup investment slump and tech firms' funding troubles, not AI". Relative to blue-collar jobs, entry-level developer postings at tech firms (e.g., Naver, Kakao) fell by about 48% (p<.001), while those at non-tech firms (e.g., GS E&C, MBC, SM Entertainment) also fell by 24% (p<.1).
Entry-level developer postings at tech and non-tech firms
Number of entry-level developer postings (2022 average = 100), tech firms (firm exposure A≥0.7) and non-tech firms (A≤0.35)
3Relative to blue-collar jobs, only two occupations saw a significant drop in entry-level postings: software developers and digital design.
The chart below compares the change in postings for each occupation after ChatGPT's release with blue-collar jobs, the comparison group, using difference-in-differences estimated by Poisson pseudo-maximum likelihood (PPML). Each block is 5%. Solid blocks are statistically significant changes; dotted blocks are not significant.
Change in postings by occupation, relative to blue-collar jobs
Change (%) relative to the blue-collar comparison group after ChatGPT's release (postings from December 2022), PPML difference-in-differences
- Only two occupations showed a significant difference: software developers (-33.5%, p<.01) and digital design (-20.6%, p<.05). Both also passed the placebo test, a statistical test that uses July 2021, before ChatGPT appeared, as a "fake post date" (developers -9.8%, p-value 0.352; digital design +3.7%, p-value 0.783).
- Education (-16.6%, p<.1) is borderline, but the placebo test already shows a decline of -21.7% (p<.001), so this looks like a trend that began before ChatGPT.
- For experienced-worker postings, no occupation differed significantly from blue-collar jobs.
4The drop in entry-level developer postings appeared regardless of firm size or age, and was clearest at small and medium-sized firms.
Change in entry-level developer postings by firm size and age
Difference-in-differences effect (PPML, %) on entry-level developer postings relative to the blue-collar comparison group, postings from December 2022 on
- The chart above breaks down the decline in entry-level developer postings by firm type and compares each with the comparison group (blue-collar jobs).
- A decline appeared at every type of firm, but the only statistically significant ones were small and medium-sized firms (-35%) by size and firms founded less than 20 years ago (-30%) by age.
- Contrary to the common belief that "startups that struggled to raise money stopped hiring juniors," startups' entry-level developer hiring changed by -11%, not significantly different from blue-collar jobs.
5Employment insurance data on actual jobs also show a decline in youth employment.
Insured workers in the information and communications industry, by age
Workers insured under employment insurance (H1 2022 = 100), half-year averages, H2 2019 to H2 2025
- Employment of people aged 29 and under in the information and communications industry peaked in the second half of 2022 and has declined steadily for 3 years since.
- In the same industry, by contrast, employment of people in their 30s and those aged 50 and over rose.
- Employment of people aged 29 and under in manufacturing, on the other hand, showed no change.
In short
Over the past few years, office and professional hiring in Korea has shifted from entry-level toward experienced workers, and the change was largest in IT development. But because the drop in entry-level developer postings began in mid-2022, a few months before ChatGPT's release, we could not separate the effects of these different factors:
- Lower spending on labor costs after rate hikes in Korea and the U.S.
- Firms in remote services, content and IT having "already" hired entry-level workers in advance during COVID
- Less hiring because of the arrival of AI
There were two main reasons we could not clearly separate the effects of these confounding factors using only the number of job postings firms published.
- The conclusion depends on the comparison group. Compared with blue-collar jobs, entry-level developer postings fell by a significant 33.5% more, but compared with IT infrastructure (H/W, SE), which is also part of IT, the difference (-18.9%) is not significant.
- The confounding factors appeared close together in time and all pushed down the incentive to hire entry-level workers. Rate hikes, the correction after the 2021 hiring boom and the venture investment slump all, like AI, reduce the preference for entry-level relative to experienced workers.
With these problems in mind, we set two directions for the analysis.
- First, while controlling for the various confounding factors, we set out to measure accurately the causal effect of generative AI, represented by ChatGPT, on the labor market. Instead of simply comparing differences across occupations or industries over time, we held the firm, month and occupational group fixed (fixed effects) and examined the data statistically.
- Second, instead of the number of postings, we used the years of experience each posting requires as the main variable. If the hypothesis that AI replaces junior workers holds, required experience may be a more important indicator than the simple count of postings.
Below are six major changes in Korea's labor market that we found on this basis.
1Required experience in major office jobs changed little in the 3 years before AI, but began to rise after ChatGPT arrived.
Average required experience by occupation
Average required experience in job postings (years), monthly. Tap the legend to turn occupations on and off.
- Software developer postings required about 3.7 years of experience on average from 2019 to 2022. That figure barely moved, even as entry-level postings fell by more than half during COVID and then more than doubled during the hiring surge.
- After ChatGPT arrived, it rose to 4.07 years in December 2022 and an average of 4.82 years in 2024, reaching 5.18 years in January 2025. The pattern is even clearer compared with blue-collar jobs, the comparison group (+0.66 years; p<.001).
- Other office and professional jobs also rose from a low in 2022, but IT infrastructure and physical design were already on a different trend from blue-collar jobs before ChatGPT, and the difference for sales was not significant.
- But looking at occupations one at a time, or defining "major occupations" arbitrarily, can lead to conclusions distorted by the researchers' cognitive biases. So instead of occupation averages, we analyzed the exposure to AI of each job appearing in each posting, which gave us a more neutral and clearer conclusion.
2The more of a job's work AI can do, the more its required experience rose.
Change by jobs' exposure to generative AI
By exposure (β) quintile, 2022 → 2024. Each block is 0.05 years (about 18 days).
- As mentioned, we assigned job exposure values to about 2,000 job keywords. The analysis showed a very clear correlation between exposure to AI and the rise in required experience in the 2 years after ChatGPT appeared.
- One could still question this result. Highly AI-exposed jobs are concentrated at firms that are themselves highly exposed to AI, such as IT companies, so one could argue there is no way to tell whether the "job" was affected by AI or the "industry" that employs many people in that job. Our analysis below rejected this scenario as well.
3Even comparing postings from the same firm in the same month, the rise in required experience grew with exposure to AI.
Job exposure effect by 3-month period
Difference in required experience (years) per 1 standard deviation of exposure, within the same firm, month and occupational group, relative to the pre-rate-hike period (Jul 2019-May 2021). Filled squares are periods significant at the 5% level; empty squares are not significant.
- Comparing only postings from the same firm, in the same month and within the same occupational group (fixed effects) statistically controls for the firm's finances and restructuring, the effect of interest rates and the economy on that firm, and trends across the whole industry.
- The result held: jobs with 1 standard deviation higher exposure to AI saw required experience rise by an additional 0.073 years after ChatGPT (p<.01). By 2024, the gap in required experience between jobs in the top (5th) and bottom (1st) exposure quintiles had widened to about 5 months.
- As a robustness check, a placebo test that uses July 2021, before ChatGPT, as a "fake post date" found no such difference (+0.009 years), and excluding IT occupations and IT-industry firms left the gap in place at +0.055 years.
- The timing is also clear. As the chart above shows, the gap in required experience by AI exposure became significant at the 10% level from spring 2023, a few months after ChatGPT's release, and at the 5% level from September–November 2023, widening to +0.08 to +0.11 years in 2024. Since firms take time to adopt AI, this lag makes sense.
- For a job one step (1 SD) higher in AI exposure, the share of postings open to entry-level applicants fell by 0.77 percentage points (p<.01), and among postings that require experience, required years rose by 0.088 (p<.01). The hiring market shifted toward experienced over entry-level workers, and, among experienced workers, toward more years of experience.
4Interest rates, the hiring boom, skill levels and industry differences did not explain this gap.
Were these jobs simply more sensitive to interest rates or the hiring boom?Rejected
Is it because highly AI-exposed jobs are skilled jobs?Rejected
Is it an illusion created by rate hikes?Rejected
Is it because these firms are in AI-related industries?Rejected
Change in required experience by firm exposure and job exposure
Average change in required experience (years) by firm exposure (A) tercile × job exposure (β) tercile, 2022 → 2024. Hover over a cell to see the number of postings.
5These changes were clearest in IT development and data, and also appeared in office and professional jobs outside IT, such as sales, retail and trade.
Job subcategories that passed all four criteria
Of 167 job subcategories, those meeting all of the following: required experience up 0.5 years or more, entry-level share changed by −5 pp or less, a relative drop in entry-level postings, and no prior change. Bars show the change in required experience from 2022 to 2024 (years).
- Ranking the 167 job subcategories on the same criteria (required experience up 0.5 years or more, entry-level share down 5 pp or more, entry-level postings falling at least 20 pp more than experienced-worker postings, no change before ChatGPT), the 7 subcategories that passed every test (SE systems engineering, S/W, information security, backend/server development and others) were all in IT.
- The effect was simply largest in IT jobs: the drop in junior hiring and the rise in demand for experienced workers appeared across office and professional jobs with high exposure to AI.
6In timing, the rise in required experience in postings came before the decline in youth employment.
Required experience in developer postings and young insured workers in the information and communications industry
Average required experience in developer postings (years, left axis) and insured workers aged 29 and under in the information and communications industry (employment insurance; H1 2022 = 100, right axis), by half-year
- The chart above plots "insured workers aged 29 and under in the information and communications industry," from the employment insurance statistics by industry introduced in the previous section, alongside "required experience in developer postings" from our job posting data.
- Required experience in developer postings rose first, from 3.76 years in the second half of 2022 to 4.10 years in the first half of 2023, while employment of people aged 29 and under in the information and communications industry peaked in the second half of 2022 and fell from 2023. With so few data points, we recommend treating this as a reference only.
▶ In short, here is what our data allows us to conclude.
- After ChatGPT arrived in late November 2022, Korean firms began to require more experience for jobs with more work that generative AI can do, and reduced their demand for entry-level workers.
- This pattern stays significant even when comparing only within the same month (time) and the same firm.
- In other words, this can be read as an "AI effect" that rate hikes, the COVID-era hiring surge, skill levels and firms' industries alone do not explain.
Naturally, a different job posting dataset could lead to somewhat different conclusions. The platform we collected from is one of the largest in Korea, but it does not cover every firm's postings. Some firms run their own recruiting pages, and some may choose not to post on this service.
Likewise, job exposure β could be calculated in other ways. Matching job keywords to O*NET occupations was done with generative AI assistance and then reviewed by people, but it still involves judgment. That said, for the 681 keywords linked directly through KNOW occupation codes, β from the KNOW route and from direct matching agree with a correlation of 0.85, and the results hold when a posting's exposure is based on its first job keyword or its most exposed keyword instead.
Job postings and employment are not the same thing. Required experience, the main variable in this report, is only the condition a firm sets; we cannot see the experience of the people actually hired. Still, firms are very unlikely to hire applicants with less experience than the posting requires.
The data has survivorship bias. The older a posting, the more likely it has disappeared because the firm closed or for similar reasons: about 30% of 2017-2018 postings have since been deleted, compared with about 13% of recent ones. That is why we limited the analysis to July 2019 onward. Unless entry-level postings in particular were deleted at a higher rate, this should not pose a major problem for our conclusions.
This appendix sets out the criteria and models behind the statistical analyses in the main text. Readers unfamiliar with equations can follow the overall structure of the analysis by reading just the heading and first sentence of each item. Fuller details are available in our working paper, written up in academic format.
How required experience is calculated
We converted the experience requirement in each posting into a number of years using the rules below. Postings that do not state a number of years were excluded from the required-experience analysis.
| Experience requirement as listed | Required experience | Example |
|---|---|---|
| Entry-level; Any (incl. entry-level) | 0 years | |
| N-M years of experience | (N+M)/2 | 3-10 years → 6.5 years |
| N+ years of experience | N | 5+ years → 5 years |
| N years of experience or less | N/2 | 4 years or less → 2 years |
| Entry-level or N+ years | N/2 | Entry-level or 3+ years → 1.5 years |
| "Any" or "Experienced (years not specified)" with no number of years | Excluded from analysis |
In the main text, entry-level postings means postings whose experience requirement includes entry-level applicants, so they can apply (e.g., Entry-level; Any (incl. entry-level)).
Unit of analysis
Comparisons across occupations aggregate postings by occupation and month; the AI exposure analysis uses each individual posting as the unit. Months are always based on the posting date (application start date).
- When a posting carries keywords from several occupations, we split it in proportion to each occupation's share of its job keywords. For example, a posting where 2 of its 4 job keywords are developer keywords counts as 0.5 postings for software developers.
- The occupation-by-month aggregates include months with no postings as 0.
Comparing postings by occupation (difference-in-differences, PPML)
The main text's comparison of postings by occupation compares the factor by which each occupation's postings (treatment group) changed from before to after ChatGPT with the same factor for blue-collar jobs (comparison group).
Taking logs of posting counts drops months with zero postings from the sample, so the observations with the largest declines end up excluded from the analysis (Chen & Roth, 2024). To avoid this, we kept the zeros and estimated with Poisson pseudo-maximum likelihood (PPML).
- : number of entry-level postings for occupation in month
- : occupation fixed effects. Controls for each occupation's different baseline volume of postings.
- : month fixed effects. Controls for changes common to all occupations, such as the business cycle and seasonality.
- : 1 for the treated occupation, 0 for the comparison group
- : 1 for postings from December 2022 on
- : coefficient of interest. is the relative change versus the comparison group; the main text's -33.5% for software developers and -20.6% for digital design are this value.
Changing the unit of aggregation to days, weeks, quarters or half-years made little difference to the estimates, because this model's estimates are determined by the total postings before and after ChatGPT in the treatment and comparison groups.
Comparing required experience and entry-level share by occupation (difference-in-differences)
Continuous outcomes such as required experience were estimated with a linear regression of the same structure, weighted by the number of postings in each occupation-month cell. The "Vs. blue-collar" column in the main table (e.g., software developers +0.66 years) is this model's .
AI exposure model (preferred specification)
This is the analysis described in the main text as "comparing postings within the same firm, month and occupational group." The study's key result, +0.073 years, comes from this model.
- : required experience for posting
- : job fixed effects. Controls for each job's different baseline level of required experience.
- : firm-by-month fixed effects. Controls for factors common to the whole firm that month, such as its finances, restructuring, and the effects of interest rates and the economy.
- : occupational-group-by-month fixed effects. The occupational group is the top level of the job platform's job tags (e.g., IT Development & Data; Accounting/Tax/Finance); this term controls for changes common to the whole occupational group that month.
- : the standardized job exposure β of posting (mean 0, standard deviation 1). We use the value of the first keyword with a β in the posting's keyword list, skipping generic keywords identical to a category name, such as "IT Development & Data."
- : exposure main effect. A job is identified by its first job keyword, but exposure comes from the first keyword with a β, so some postings within the same job differ in exposure (1.1% of all postings). This term controls for the difference in required experience that already existed among such postings.
- : coefficient of interest. How much more required experience rose after ChatGPT for a job with 1 standard deviation higher exposure, within the same firm, month and occupational group.
- Standard errors are two-way clustered by firm and job.
Variations on the preferred specification
The robustness results in the main text keep the fixed-effects structure of the model above and change only the elements below.
- Non-IT sample: excludes all postings in the IT Development & Data occupational group and all postings from IT-industry firms (+0.055 years in the main text).
- Cycle controls: adds terms interacting with each job's boom size (the 2021 hiring boom), cooling size (the 2022 drop in entry-level hiring) and rate sensitivity.
- Skill controls: adds terms interacting with each job's pre-ChatGPT required experience, share of postings requiring a four-year degree and posted salary (+0.107 years in the main text).
- Exposure aggregation: replaces the first keyword with a β by the first job keyword; the mean, median or maximum (most exposed keyword) across all keywords; or the mean of stable keywords (see the group definitions below).
- Margins of the increase: replaces required experience with entry eligibility (whether entry-level applicants can apply), whether required experience is 0 years, required years among postings that require experience, and whether 3 or more and 5 or more years are required (in the main text: entry eligibility -0.77 pp, +0.088 years among postings that require experience).
- Same firm, same month comparison: a specification without occupational-group-by-month fixed effects, estimated for comparison with the placebo test results below.
Firm exposure model
The firm-by-month fixed effects in the preferred specification also absorb the effect of firm exposure itself, so we estimated the effect of firm exposure A in a separate model.
- : firm fixed effects. Controls for each firm's different baseline level of required experience.
- : job-by-month fixed effects. Controls for changes common to the same job that month.
- : the standardized firm exposure A of firm
- : how much more required experience rose, relative to the pre-ChatGPT period (July 2019-November 2022), at a firm with 1 standard deviation higher firm exposure.
Event study
This method splits in the models above into dummy variables for several periods instead of a single dummy, estimating the effect separately for each period. If the coefficients before ChatGPT stay near 0, the treatment and comparison groups were on similar trends to begin with (parallel trends), and the path of the coefficients after ChatGPT shows how quickly the effect appeared.
- The event study of postings by occupation uses quarterly dummies, with Q3 2022 as the reference.
- The event study for the preferred specification uses 3-month periods split at ChatGPT's release date (November 30, 2022), so that no period mixes postings from before and after the release. The reference period is July 2019-May 2021, before the Bank of Korea's first rate hike, and we estimated 15 periods from June 2021 to January 2025. The exposure main effect () is kept in the event study as well.
- We also ran event studies with January-September 2022 or January-June 2022 as the reference period. But in the first half of 2022 the gap in required experience by exposure was somewhat smaller than usual, so using that period as the reference makes the rise in the period just before ChatGPT's release look relatively large. That is why we used the long pre-rate-hike period as the reference.
Placebo test
We limited the sample to postings through November 2022 and estimated the same model using July 2021, before ChatGPT, as a "fake post date." If this coefficient differs significantly from 0, the treatment and comparison groups were already moving differently before ChatGPT.
| Analysis | Placebo coefficient |
|---|---|
| Entry-level developer postings (vs. blue-collar) | -9.8% |
| Entry-level digital design postings (vs. blue-collar) | +3.7% |
| Developer required experience (vs. blue-collar) | -0.02 years |
| AI exposure, preferred specification | +0.009 years |
| AI exposure, preferred specification (non-IT sample) | +0.009 years |
| Same firm, same month (without occupational-group-by-month fixed effects) | +0.053 years** |
p<.1*, p<.05**, p<.01***
In the specification without occupational-group-by-month fixed effects, the placebo coefficient was borderline significant, but in the preferred specification, which includes them, it was close to 0. That is why the main text reports its key results from the preferred specification.
Trend breaks and turning-point search
We separately tested whether the gap in required experience jumped at ChatGPT's release or began rising faster.
- A trend-break model on the preferred specification that allows both a level change and a slope change at the release (December 2022) gave a level change of +0.026 years and a slope change of +0.004 years, neither significant. As described in the main text, the gap widened gradually from spring 2023 rather than all at once right after the release.
- Separately, we searched for the break point in the data instead of fixing it in advance (finding the point that minimizes the residual sum of squares (RSS), with a minimum segment length of 9 months). In the monthly gap in required experience between postings in the top and bottom exposure quintiles (top 5th vs. bottom 5th), calculated without fixed effects, the turning point came in July 2022.
Occupation definitions
Occupations in the main text are defined by job keywords used steadily throughout the analysis period (stable keywords).
| Occupation | Job keywords |
|---|---|
| Software developers | .NET, Android, C#, C++, CSS, HTML, Java, Python, S/W, Game Development, Backend/Server Development, App Development, Embedded, Web Publisher, Firmware, Frontend |
| IT infrastructure | H/W, SE (Systems Engineer) |
| Digital design | UI/UX Design, Advertising Design, Graphic Design, Mobile Design, Web Design, Illustrator |
| Physical design | Interior Design, Fashion Design, Exhibition Design |
| Video | Animator, Video Design, Video Editing, Filming |
| Translation and content | CW (Copywriter), Reporter, Publishing Planning, Content Planning, Interpretation/Translation |
| Bookkeeping | Bookkeeping, Treasury Management, Voucher Entry, Accounting and Closing |
| Clerical and office | Office Assistant, Office Worker, Document Management |
| Customer service | Customer Management, Call Center Agent |
| Sales | Account Management, Technical Sales, Sales Management, Sales Rep, Retail Sales, Overseas Sales |
| Logistics and purchasing | Logistics Management, Materials Management, Inventory Management |
| Marketing | Advertising Marketing, Corporate PR, Marketing Planning, Online Marketing |
| Construction sites | Construction Supervisor, Site Administration, Safety Manager, Site Manager |
| Education | Education Operations, Math, English |
- HR and general affairs (education administration) and data analysis (big data) each had only one stable keyword, so their results are not reported separately. That is why the main text shows results for only 14 of the 16 occupations.
- The comparison group, blue-collar, is defined as job keywords that belong to none of the occupations above and have a job exposure β of 0.2 or below.



