cursus.processing.text.bert_tokenize_processor¶

class BertTokenizeProcessor(tokenizer, add_special_tokens=True, max_length=None, truncation=True, padding='longest', input_ids_key='input_ids', attention_mask_key='attention_mask')[source]¶