Measured resultThe experiment was run and the numbers below are ours. The environment, sample and limitations are stated so the result can be challenged.
Original research
GitHub's Copilot Docs Contradicted Its Own Changelog on Retirement Day
On 1 September 2026, six Copilot models were retired. GitHub's supported-models reference page listed all six as generally available, with no deprecation notice anywhere on it.
The question
When GitHub retires a Copilot model, does its reference documentation reflect that on the day the retirement takes effect?
What was measured
One observation on one day, covering the complete set of models GitHub listed as supported (31 at time of reading) checked against two changelog entries announcing seven retirements. Both sources were read within the same hour on 1 September 2026.
Environment
- Sources read 2026-09-01, approximately 03:00–04:00 UTC
- docs.github.com supported-models and model-comparison reference pages
- github.blog changelog entries dated 2026-07-31 and 2026-08-11
- Automated fetch, no authentication, no cache
We maintain a model tracker with a seven-day review interval. On 1 September 2026 that interval lapsed, and the re-verification produced a result worth publishing.
What we found
Six models were deprecated across GitHub Copilot on 1 September 2026. The changelog entry announcing it is dated 31 July 2026 and names them:
| Model | Replacement GitHub named |
|---|---|
| Gemini 3.1 Pro | Gemini 3.6 Flash |
| Claude Opus 4.5 | Claude Opus 4.7, 4.8 or Opus 5 |
| Claude Opus 4.6 | Claude Opus 4.7, 4.8 or Opus 5 |
| Claude Sonnet 4.5 | Claude Sonnet 5 |
| Claude Sonnet 4.6 | Claude Sonnet 5 |
| Raptor mini | MAI-Code-1-Flash |
On the same day, GitHub’s supported-models reference page listed all six as generally available, and contained no deprecation notice, no retirement date and no successor for any model. Its only statement on the subject was the generic line that “model availability is subject to change”.
The model-comparison page went further. Of the six models it placed in the deep reasoning group, two were retiring that day — Claude Sonnet 4.6 and Gemini 3.1 Pro. Of the three in visual work, the same two. The page was recommending models for a task on the day they were withdrawn.
The successor that retires first
One detail is worth separating out, because following the guidance literally produces a wrong outcome.
GitHub names MAI-Code-1-Flash as the replacement for Raptor mini, which was deprecated on 1 September. A second changelog entry, dated 11 August, deprecates MAI-Code-1-Flash on 10 September.
Migrating as instructed means moving twice in nine days. MAI-Code-1.1-Flash is the destination that survives both dates, and neither entry says so — the inference requires reading both.
Why this matters beyond the specific models
The practical consequence is which source you check.
Reference documentation is the natural place to look and is the wrong place to look for this class of fact. It is written to describe a current state and updated when someone updates it; a changelog is written to record an event on a date and is correct by construction. When the two disagree, the dated one is the one to trust.
For anyone maintaining a prompt file, a CI workflow, a runbook or a comparison table that names a model, that means subscribing to the changelog rather than periodically re-reading the reference page.
What we changed as a result
Our model tracker’s source list now includes the changelog entries alongside the reference pages, with a comment recording why. The change history on that page carries all seven retirements with their sources.
We also corrected something of our own the same day: our task groupings had assigned every Opus release to deep reasoning and every Flash release to fast work by inference. GitHub names five models under general-purpose and three under fast, out of 32 — 20 models sit in no group at all. Our inference was this site’s opinion wearing GitHub’s label, which is the same class of error in the opposite direction.
What this does not show
We read the reference page once. We do not know whether it was stale for an hour, a day or a week, and we are not claiming a pattern from one observation.
Nor is this a criticism of the documentation’s accuracy in general. It is a narrow, dated finding about one class of fact — retirement status — and the practical response is to check the changelog for that class rather than to distrust the documentation broadly.
Limitations
What this cannot tell you. Stated in the frontmatter so it cannot be dropped in an edit.
- A single observation on a single day. It establishes that the drift occurred, not how often it occurs.
- We did not measure how long the reference page remained stale, because we read it once.
- Reference documentation is often regionally cached; another reader on the same day may have seen different content.
- This measures documentation consistency, not model availability. We did not test whether the retired models still answered requests.
- No conclusion is drawn about GitHub's internal processes, which we cannot observe.
Reproduce this
Read GitHub's supported-models reference page and its Copilot changelog on the same day, and diff the model list against any deprecation entry whose effective date has passed. The two changelog entries cited below are dated and permanent; the reference page is not versioned, so a reproduction today will show a different (likely corrected) state. That is the nature of the finding — it is an observation of a moment, and it is recorded with the moment attached.
Sources
Every version-sensitive claim on this page was checked against first-party documentation. Only sources actually used are listed.
Cite this research
Free to use, republish and build on. A link back is appreciated and is not a condition. The one thing we ask is that theverification date travels with the numbers — several of these figures change monthly, and a table with no date on it becomes misinformation within a quarter however accurate it was when copied.
Plain citation
The Copilot Stack. "GitHub's Copilot Docs Contradicted Its Own Changelog on Retirement Day." Version 2026-09-04. https://thecopilotstack.com/research/documentation-drift-model-retirements/ (verified 2026-09-04).Markdown
[The Copilot Stack — GitHub's Copilot Docs Contradicted Its Own Changelog on Retirement Day](https://thecopilotstack.com/research/documentation-drift-model-retirements/) (verified 2026-09-04)BibTeX
@misc{copilotstack_research-documentation-drift-model-retirements_2026,
title = {GitHub's Copilot Docs Contradicted Its Own Changelog on Retirement Day},
author = {{The Copilot Stack}},
year = {2026},
note = {Version 2026-09-04. Maintained research, not peer reviewed},
howpublished = {\url{https://thecopilotstack.com/research/documentation-drift-model-retirements/}},
urldate = {2026-09-04}
}@misc rather than @article or@dataset, and the note records that this is a maintained research that has not been peer reviewed. Formatting it as a journal reference would imply a review process that did not happen.
Licence. Free to reuse for any purpose, including commercially. This is original work by The Copilot Stack — the method, the harness and the results — and it has not been peer reviewed.
Share this
https://thecopilotstack.com/research/documentation-drift-model-retirements/
Was this lesson helpful?
We record which lesson you rated and whether it helped. Nothing identifies you — no account, no cookie, no session.