← Back to timeline
LLM Era2018demo planned

BERT

Pretrain understanding

Bidirectional pretraining changed NLP from task-specific models to one large reusable foundation.

Roadmap node · demo on the way

Read the wiki entry for BERT

The interactive demo for this model is on the build list — the live linear regression demo is the template the rest will follow. The wiki entry already has the full concept, history, and where this fits in the chain.