Glossary Definition

Pre-training

Term Definition

The initial unsupervised training phase where a neural network ingests massive text corpuses to master syntax, structure, and baseline world knowledge.

We use cookies

We use cookies to improve your experience and analyze our traffic. By clicking "Accept", you consent to our use of cookies. Privacy Policy