01 · Experiment report
Executive Summary
EpochLex is an open-source, searchable reference work for terminology of the AI era. The project began on August 28, 2026, as a relatively small dictionary concept and developed into a 365-entry public reference work with structured provenance, dedicated term pages, pronunciation, responsive browsing, related-term discovery, a Progressive Web App, Word of the Day, contributor infrastructure, and a documented editorial and architectural model.
The project also became an experiment in AI-assisted development. ChatGPT was used extensively alongside GitHub and repository-based development during the initial phase, assisting with product exploration, implementation, debugging, documentation, research organization, quality assurance, and editorial support. On September 17, Codex was added to the existing workflow as a more repository-oriented implementation agent. The development process remained human-directed and human-reviewed throughout.
The strongest finding in Version 1.0 is that AI materially reduced the distance between product intent and working implementation. That acceleration did not remove the need for planning or engineering discipline. As the project grew, architecture, QA, source control, documentation, validation, editorial standards, and human review became more explicit rather than less important.
The report also treats ambiguity as an experimental variable and distinguishes different classes of failure. It does not interpret repository throughput as a productivity multiplier, labor saving, or proof of superiority over conventional development because no matched control project or reliable historical labor record exists.
Report snapshot
Key Metrics at a Glance
These measures describe different forms of activity at the September 18 cutoff and are not combined into a single productivity score.
| Measure | September 18, 2026 |
|---|---|
| Initial published entries | 27 |
| First corpus milestone | 100 |
| Current published entries | 365 |
| Pull requests in audited history | 98 |
| Merged pull requests | 97 |
| Identified issues | 30 |
| Open issues | 5 |
| Researched provenance records | 183 |
| Pending provenance records | 182 |
| Provenance records completed in Wave 1 | 61 |
| Reader-facing categories | 5 |
| Explicit entry types | 5 |
| Legacy records migrated in PR #131 | 343 |
| URL replacements in PR #133 | 615 |
Part I
Introduction, Scope, and Methodology
- Introduction, Scope, and Methodology
- Purpose of the Case Study
- Questions Examined
- Observation Period and Evidence Base
- Development Environment
- Quantitative Evidence
- What This Report Does Not Claim
- A Note on Ambiguity
The report treats the public repository and current source-controlled project state as the primary record for the reporting cutoff. Development conversations provide supporting context for intent, rejected alternatives, ambiguity, and human feedback. The case study documents one real product rather than a controlled laboratory comparison.
Part II
Reconstructing the Experiment
- From a Term List to a Working Product
- Rapid Expansion and the First Regression Cycle
- Quality Assurance Becomes Part of the Product
- The AILex to EpochLex Migration
- The Taxonomy Expands Beyond Terms
- The PWA and the Boundary of the Static Architecture
- From a Private Project to an Open-Source Operation
- Making the Research Pipeline Persistent
- Scaling the Corpus Changes the Bottleneck
- Word of the Day and the Question of Architectural Cost
- The PWA Becomes an Intentional Product Experience
- Introducing Codex Into an Existing Workflow
- Maintenance Work Becomes More Explicit
- What Changed During the First Three Weeks
This part reconstructs how a dictionary project accumulated software architecture, research infrastructure, contributor workflows, QA, and maintenance concerns. The emphasis is on how the system changed—not merely on counting features.
EpochLex Development Timeline
Major phases during the first observation period, August 28–September 17, 2026.
MVP + goals defined
Logo/brand + wiki
Open-source operation
Candidate inventory
328 entries, pilot tests
Mobile PWA + Word of the Day
Agent-assisted development
Part III
Case Studies and Findings
- Case Study One: From 27 Terms to a Working Reference Product
- Case Study Two: Provenance Changed the Nature of the Project
- Case Study Three: Mobile Development and the Difference Between Functional and Correct
- Case Study Four: The AILex to EpochLex Rename
- Case Study Five: Open Source Required More Than Publishing the Code
- Case Study Six: Rapid Corpus Growth and the Creation of Research Debt
- Case Study Seven: Word of the Day, Push Notifications, and Architectural Restraint
- Case Study Eight: A Stale Pull Request and the Introduction of Codex
- Case Study Nine: Strong Automated Validation Did Not Eliminate Human Testing
- Case Study Ten: Ambiguity as Part of the Experiment
- Cross-Case Findings
- A Developing Interpretation of “Vibe Coding”
- The Role of Human Judgment
- The Emerging Development Model
- Interim Finding
Version 1.0’s interim interpretation is that AI changed the speed and cost of iteration more clearly than it changed the need for judgment. Working software became part of the thinking process, while the value of that acceleration increasingly depended on the surrounding system’s ability to distinguish useful output from plausible but incomplete output.
Part IV
Quantitative Analysis and Experimental Measures
- Why Quantitative Measures Matter
- Repository Activity During the Observation Period
- Development Was Highly Concentrated in Bursts
- Corpus Growth
- Provenance as a Quantifiable Bottleneck
- Pull Requests as a Measure of Iteration, Not Productivity
- Rework and Follow-Up Work
- Human-Detected Versus Automated Findings
- The Toolchain Timeline
- Model Changes Are Part of the Experiment
- Token Utilization
- Token Counts Are Not Productivity Scores
- Human Effort Is the Largest Missing Quantitative Measure
- Measuring the Next Phase Beginning With Codex
- Tracking Ambiguity as Data
- Candidate Metrics for the Continuing Experiment
- What Can Be Quantified Now
- What the Numbers Tell Us
The quantitative section deliberately separates direct measurements from reconstructed estimates and prospective measures. It does not convert pull-request counts, tokens, or corpus growth into unsupported productivity claims.
Corpus growth and provenance consolidation
Published entries grew rapidly; deeper provenance research became the next visible constraint.
Published entries over time
Provenance records before and after consolidation
Classifying an unexpected outcome
An unexpected result is the starting point for diagnosis—not a verdict that the AI failed.
Part V
Discussion, Lessons, and Implications
- The Experiment Was Not Really About Whether AI Could Write Code
- AI Reduced the Cost of Trying an Idea
- Faster Implementation Changes the Economics of Iteration
- The Hammer and the Nail Gun
- Established Development Practices Did Not Disappear
- Repository Context Became a Form of Organizational Memory
- Documentation Is Part of the AI Control System
- AI Can Accelerate Technical Debt as Easily as Features
- Human Judgment Became the Scarcer Resource
- Human Review Is More Than Error Checking
- Ambiguity Is Shared Between the Human and the AI
- The Ability to Surface Ambiguity May Become a Model Capability Worth Measuring
- Product Responsibility Limits Experimental Freedom
- Architecture Became a Decision Framework
- Simplicity Has Ongoing Value in AI-Assisted Systems
- AI-Assisted Research Has Different Risks From AI-Assisted Coding
- The Meaning of “AI-Built” Requires Precision
- Tool Changes Complicate Cause and Effect
- The Work Is Shifting Rather Than Disappearing
- Implications for Professional Practice
- Process Knowledge May Outlast Tool Knowledge
- Vibe Coding and Professional Practice Are Not Necessarily Opposites
- What the Experiment Suggests So Far
- A More Mature Statement of the Experiment
- The Central Lesson
Across these sections, the report argues for process principles that remain useful even as tools change: current repository state over stale planning material, claim-specific evidence, deliberate handling of high-risk ambiguity, explicit invariants for large changes, and validation that states both what was tested and what was not.
Production capacity and review pressure
Interpretive model derived from the EpochLex case; curves are conceptual, not measured throughput.
Part VI
Conclusion, Limitations, and the Continuing Experiment
- The September 18 Snapshot
- What the First Phase Established
- Limitations of the First Report
- Limits on Generalization
- Codex Marks a New Observation Period
- Measurement Plan for the Next Phase
- Token Utilization Status
- Model Timeline Status
- Contributors and the Expanding Experimental Environment
- Ambiguity Should Continue to Be Observed Deliberately
- EpochLex as a Living Experiment
- Conclusion
The first phase demonstrates AI participation across a broad product-development lifecycle while also documenting consequential human direction. Faster implementation did not remove conventional development practice; as the project grew, architecture, source control, QA, documentation, validation, and human review became more explicit.
Limits carried forward
- No matched control project.
- No systematic historical human-labor tracking.
- No defensible lifetime token total can be reconstructed from the retained evidence set.
- Exact historical model/configuration is left unspecified where it cannot be verified.
- Repository and conversation records are substantial but not forensically complete.
- Results should not automatically be generalized to projects with substantially different risk profiles, architectures, or teams.
Appendices
Evidence and measurement layers
- Appendix A — Evidence Register: claim-to-evidence traceability across repository artifacts, PRs, issues, development conversations, measurements, and analytics.
- Appendix B — Repository Classification Framework: completed PR classification and secondary tags.
- Appendix C — Model and Toolchain Timeline: verified tool phases and interpretive boundaries.
- Appendix D — Token Utilization Reconstruction: staged reconstruction that separates visible counts, modeled context, and direct analytics.
- Appendix E — Next-Phase Measurement Framework: a more deliberate measurement model for the continuing experiment.
- Appendix F — Report Terminology: consistent definitions for experiment-specific language.
- Appendix G — Source Notes and Methodology Details: source hierarchy, evidence handling, citation convention, and measurement labels used in Version 1.0.
Publication
Version 1.0 · September 2026
The finalized report is a 75-page designed research case study covering the August 28–September 17, 2026 observation period with a September 18 repository snapshot.
- The PDF is the authoritative complete Version 1.0 publication.
- This web companion summarizes and navigates the report without strengthening claims beyond the published evidence.
- Later observation periods should be published as new phases or editions rather than silently rewriting this historical baseline.

