EpochLex · Experiment report

The complete record.

A web companion to the finalized Version 1.0 report, preserving its structure, executive material, metrics, case-study map, limitations, and evidence framework alongside the definitive 75-page PDF.

Observation · August 28–September 17, 2026Snapshot · September 18, 2026Publication · Version 1.0 · September 2026 · 75 pages

01 · Experiment report

Executive Summary

EpochLex is an open-source, searchable reference work for terminology of the AI era. The project began on August 28, 2026, as a relatively small dictionary concept and developed into a 365-entry public reference work with structured provenance, dedicated term pages, pronunciation, responsive browsing, related-term discovery, a Progressive Web App, Word of the Day, contributor infrastructure, and a documented editorial and architectural model.

The project also became an experiment in AI-assisted development. ChatGPT was used extensively alongside GitHub and repository-based development during the initial phase, assisting with product exploration, implementation, debugging, documentation, research organization, quality assurance, and editorial support. On September 17, Codex was added to the existing workflow as a more repository-oriented implementation agent. The development process remained human-directed and human-reviewed throughout.

The strongest finding in Version 1.0 is that AI materially reduced the distance between product intent and working implementation. That acceleration did not remove the need for planning or engineering discipline. As the project grew, architecture, QA, source control, documentation, validation, editorial standards, and human review became more explicit rather than less important.

The report also treats ambiguity as an experimental variable and distinguishes different classes of failure. It does not interpret repository throughput as a productivity multiplier, labor saving, or proof of superiority over conventional development because no matched control project or reliable historical labor record exists.

Report snapshot

Key Metrics at a Glance

These measures describe different forms of activity at the September 18 cutoff and are not combined into a single productivity score.

MeasureSeptember 18, 2026
Initial published entries27
First corpus milestone100
Current published entries365
Pull requests in audited history98
Merged pull requests97
Identified issues30
Open issues5
Researched provenance records183
Pending provenance records182
Provenance records completed in Wave 161
Reader-facing categories5
Explicit entry types5
Legacy records migrated in PR #131343
URL replacements in PR #133615

Part I

Introduction, Scope, and Methodology

  1. Introduction, Scope, and Methodology
  2. Purpose of the Case Study
  3. Questions Examined
  4. Observation Period and Evidence Base
  5. Development Environment
  6. Quantitative Evidence
  7. What This Report Does Not Claim
  8. A Note on Ambiguity

The report treats the public repository and current source-controlled project state as the primary record for the reporting cutoff. Development conversations provide supporting context for intent, rejected alternatives, ambiguity, and human feedback. The case study documents one real product rather than a controlled laboratory comparison.

Part II

Reconstructing the Experiment

  1. From a Term List to a Working Product
  2. Rapid Expansion and the First Regression Cycle
  3. Quality Assurance Becomes Part of the Product
  4. The AILex to EpochLex Migration
  5. The Taxonomy Expands Beyond Terms
  6. The PWA and the Boundary of the Static Architecture
  7. From a Private Project to an Open-Source Operation
  8. Making the Research Pipeline Persistent
  9. Scaling the Corpus Changes the Bottleneck
  10. Word of the Day and the Question of Architectural Cost
  11. The PWA Becomes an Intentional Product Experience
  12. Introducing Codex Into an Existing Workflow
  13. Maintenance Work Becomes More Explicit
  14. What Changed During the First Three Weeks

This part reconstructs how a dictionary project accumulated software architecture, research infrastructure, contributor workflows, QA, and maintenance concerns. The emphasis is on how the system changed—not merely on counting features.

Figure 1

EpochLex Development Timeline

Major phases during the first observation period, August 28–September 17, 2026.

Figure 1. Major development phases during the first EpochLex observation period.

Part III

Case Studies and Findings

  1. Case Study One: From 27 Terms to a Working Reference Product
  2. Case Study Two: Provenance Changed the Nature of the Project
  3. Case Study Three: Mobile Development and the Difference Between Functional and Correct
  4. Case Study Four: The AILex to EpochLex Rename
  5. Case Study Five: Open Source Required More Than Publishing the Code
  6. Case Study Six: Rapid Corpus Growth and the Creation of Research Debt
  7. Case Study Seven: Word of the Day, Push Notifications, and Architectural Restraint
  8. Case Study Eight: A Stale Pull Request and the Introduction of Codex
  9. Case Study Nine: Strong Automated Validation Did Not Eliminate Human Testing
  10. Case Study Ten: Ambiguity as Part of the Experiment
  11. Cross-Case Findings
  12. A Developing Interpretation of “Vibe Coding”
  13. The Role of Human Judgment
  14. The Emerging Development Model
  15. Interim Finding

Version 1.0’s interim interpretation is that AI changed the speed and cost of iteration more clearly than it changed the need for judgment. Working software became part of the thinking process, while the value of that acceleration increasingly depended on the surrounding system’s ability to distinguish useful output from plausible but incomplete output.

Part IV

Quantitative Analysis and Experimental Measures

  1. Why Quantitative Measures Matter
  2. Repository Activity During the Observation Period
  3. Development Was Highly Concentrated in Bursts
  4. Corpus Growth
  5. Provenance as a Quantifiable Bottleneck
  6. Pull Requests as a Measure of Iteration, Not Productivity
  7. Rework and Follow-Up Work
  8. Human-Detected Versus Automated Findings
  9. The Toolchain Timeline
  10. Model Changes Are Part of the Experiment
  11. Token Utilization
  12. Token Counts Are Not Productivity Scores
  13. Human Effort Is the Largest Missing Quantitative Measure
  14. Measuring the Next Phase Beginning With Codex
  15. Tracking Ambiguity as Data
  16. Candidate Metrics for the Continuing Experiment
  17. What Can Be Quantified Now
  18. What the Numbers Tell Us

The quantitative section deliberately separates direct measurements from reconstructed estimates and prospective measures. It does not convert pull-request counts, tokens, or corpus growth into unsupported productivity claims.

Figure 5

Corpus growth and provenance consolidation

Published entries grew rapidly; deeper provenance research became the next visible constraint.

Published entries over time

27Initial MVP 100First milestone 122Pre-expansion 365Post-expansion

Provenance records before and after consolidation

Key takeawayPublished entries increased from 27 to 365 while provenance research became a larger focus.
Figure 5. Corpus growth and the shift from publication throughput to provenance-research pressure.
Figure 6

Classifying an unexpected outcome

An unexpected result is the starting point for diagnosis—not a verdict that the AI failed.

Key takeawayOnly one branch is a straightforward AI implementation error. The other branches locate the unexpected result in context, human intent, requirements, environment, or deliberate ambiguity.
Figure 6. Classification model for unexpected AI-assisted development outcomes.

Part V

Discussion, Lessons, and Implications

  1. The Experiment Was Not Really About Whether AI Could Write Code
  2. AI Reduced the Cost of Trying an Idea
  3. Faster Implementation Changes the Economics of Iteration
  4. The Hammer and the Nail Gun
  5. Established Development Practices Did Not Disappear
  6. Repository Context Became a Form of Organizational Memory
  7. Documentation Is Part of the AI Control System
  8. AI Can Accelerate Technical Debt as Easily as Features
  9. Human Judgment Became the Scarcer Resource
  10. Human Review Is More Than Error Checking
  11. Ambiguity Is Shared Between the Human and the AI
  12. The Ability to Surface Ambiguity May Become a Model Capability Worth Measuring
  13. Product Responsibility Limits Experimental Freedom
  14. Architecture Became a Decision Framework
  15. Simplicity Has Ongoing Value in AI-Assisted Systems
  16. AI-Assisted Research Has Different Risks From AI-Assisted Coding
  17. The Meaning of “AI-Built” Requires Precision
  18. Tool Changes Complicate Cause and Effect
  19. The Work Is Shifting Rather Than Disappearing
  20. Implications for Professional Practice
  21. Process Knowledge May Outlast Tool Knowledge
  22. Vibe Coding and Professional Practice Are Not Necessarily Opposites
  23. What the Experiment Suggests So Far
  24. A More Mature Statement of the Experiment
  25. The Central Lesson

Across these sections, the report argues for process principles that remain useful even as tools change: current repository state over stale planning material, claim-specific evidence, deliberate handling of high-risk ambiguity, explicit invariants for large changes, and validation that states both what was tested and what was not.

Figure 7

Production capacity and review pressure

Interpretive model derived from the EpochLex case; curves are conceptual, not measured throughput.

Production capacity Review / research capacity Growing review pressure + downstream backlog Increasing AI-assisted development capacity
Figure 7. Interpretive model of increased production capacity and the resulting pressure on review and research.

Part VI

Conclusion, Limitations, and the Continuing Experiment

  1. The September 18 Snapshot
  2. What the First Phase Established
  3. Limitations of the First Report
  4. Limits on Generalization
  5. Codex Marks a New Observation Period
  6. Measurement Plan for the Next Phase
  7. Token Utilization Status
  8. Model Timeline Status
  9. Contributors and the Expanding Experimental Environment
  10. Ambiguity Should Continue to Be Observed Deliberately
  11. EpochLex as a Living Experiment
  12. Conclusion

The first phase demonstrates AI participation across a broad product-development lifecycle while also documenting consequential human direction. Faster implementation did not remove conventional development practice; as the project grew, architecture, source control, QA, documentation, validation, and human review became more explicit.

Limits carried forward

  • No matched control project.
  • No systematic historical human-labor tracking.
  • No defensible lifetime token total can be reconstructed from the retained evidence set.
  • Exact historical model/configuration is left unspecified where it cannot be verified.
  • Repository and conversation records are substantial but not forensically complete.
  • Results should not automatically be generalized to projects with substantially different risk profiles, architectures, or teams.

Appendices

Evidence and measurement layers

  • Appendix A — Evidence Register: claim-to-evidence traceability across repository artifacts, PRs, issues, development conversations, measurements, and analytics.
  • Appendix B — Repository Classification Framework: completed PR classification and secondary tags.
  • Appendix C — Model and Toolchain Timeline: verified tool phases and interpretive boundaries.
  • Appendix D — Token Utilization Reconstruction: staged reconstruction that separates visible counts, modeled context, and direct analytics.
  • Appendix E — Next-Phase Measurement Framework: a more deliberate measurement model for the continuing experiment.
  • Appendix F — Report Terminology: consistent definitions for experiment-specific language.
  • Appendix G — Source Notes and Methodology Details: source hierarchy, evidence handling, citation convention, and measurement labels used in Version 1.0.

Publication

Version 1.0 · September 2026

The finalized report is a 75-page designed research case study covering the August 28–September 17, 2026 observation period with a September 18 repository snapshot.

  • The PDF is the authoritative complete Version 1.0 publication.
  • This web companion summarizes and navigates the report without strengthening claims beyond the published evidence.
  • Later observation periods should be published as new phases or editions rather than silently rewriting this historical baseline.