+41 544 36 40
  • en
  • de
  • en
  • de
    • Public Offering
    +41 544 36 40 +49 221 77 268 261

    Lexicon

    A C D E G L M N O P R S T
    Prep Pret

    preprocessing

    Before a corpus can be passed to AI for training, some preprocessing steps have to be performed. Unwanted content, for example, is removed, normalizations are performed, and texts are adapted to model specifics. If for instance a model has only learned one type of quotation marks in pretraining, these quotation marks should be the same in the training corpus for finetuning, so that they are recognized correctly right away.