Homec4science
Diffusion ADDI 73ab19ec174f

transformer updated
73ab19ec174f
Actions

Authored by gantenbein on Jun 10 2021, 14:29.

Description

transformer updated

Details

Committed
gantenbeinJun 10 2021, 14:29
Pushed
gantenbeinJun 10 2021, 14:29
Parents
R11484:b6934ff9f381: added noisy dataset
Branches
Unknown
Tags
Unknown

Changes (904)

Path
Amain.pdf
Dsource_code/transformers
Dsource_code/transformers/.circleci
Dsource_code/transformers/.circleci/config.yml
Dsource_code/transformers/.circleci/deploy.sh
Dsource_code/transformers/.coveragerc
Dsource_code/transformers/.gitattributes
Dsource_code/transformers/.github
Dsource_code/transformers/.github/ISSUE_TEMPLATE
Dsource_code/transformers/.github/ISSUE_TEMPLATE/---new-benchmark.md
Dsource_code/transformers/.github/ISSUE_TEMPLATE/--new-model-addition.md
Dsource_code/transformers/.github/ISSUE_TEMPLATE/bug-report.md
Dsource_code/transformers/.github/ISSUE_TEMPLATE/feature-request.md
Dsource_code/transformers/.github/ISSUE_TEMPLATE/migration.md
Dsource_code/transformers/.github/ISSUE_TEMPLATE/question-help.md
Dsource_code/transformers/.github/PULL_REQUEST_TEMPLATE.md
Dsource_code/transformers/.github/conda
Dsource_code/transformers/.github/conda/build.sh
Dsource_code/transformers/.github/conda/meta.yaml
Dsource_code/transformers/.github/workflows
Dsource_code/transformers/.github/workflows/github-torch-hub.yml
Dsource_code/transformers/.github/workflows/model-templates.yml
Dsource_code/transformers/.github/workflows/release-conda.yml
Dsource_code/transformers/.github/workflows/self-push.yml
Dsource_code/transformers/.github/workflows/self-scheduled.yml
Dsource_code/transformers/.github/workflows/stale.yml
Dsource_code/transformers/.gitignore
Dsource_code/transformers/CODE_OF_CONDUCT.md
Dsource_code/transformers/CONTRIBUTING.md
Dsource_code/transformers/ISSUES.md
Dsource_code/transformers/LICENSE
Dsource_code/transformers/MANIFEST.in
Dsource_code/transformers/Makefile
Dsource_code/transformers/README.md
Dsource_code/transformers/docker
Dsource_code/transformers/docker/transformers-cpu
Dsource_code/transformers/docker/transformers-cpu/Dockerfile
Dsource_code/transformers/docker/transformers-gpu
Dsource_code/transformers/docker/transformers-gpu/Dockerfile
Dsource_code/transformers/docker/transformers-pytorch-cpu
Dsource_code/transformers/docker/transformers-pytorch-cpu/Dockerfile
Dsource_code/transformers/docker/transformers-pytorch-gpu
Dsource_code/transformers/docker/transformers-pytorch-gpu/Dockerfile
Dsource_code/transformers/docker/transformers-pytorch-tpu
Dsource_code/transformers/docker/transformers-pytorch-tpu/Dockerfile
Dsource_code/transformers/docker/transformers-pytorch-tpu/bert-base-cased.jsonnet
Dsource_code/transformers/docker/transformers-pytorch-tpu/dataset.yaml
Dsource_code/transformers/docker/transformers-pytorch-tpu/docker-entrypoint.sh
Dsource_code/transformers/docker/transformers-tensorflow-cpu
Dsource_code/transformers/docker/transformers-tensorflow-cpu/Dockerfile
Dsource_code/transformers/docker/transformers-tensorflow-gpu
Dsource_code/transformers/docker/transformers-tensorflow-gpu/Dockerfile
Dsource_code/transformers/docs
Dsource_code/transformers/docs/Makefile
Dsource_code/transformers/docs/README.md
Dsource_code/transformers/docs/source
Dsource_code/transformers/docs/source/_static
Dsource_code/transformers/docs/source/_static/css
Dsource_code/transformers/docs/source/_static/css/Calibre-Light.ttf
Dsource_code/transformers/docs/source/_static/css/Calibre-Medium.otf
Dsource_code/transformers/docs/source/_static/css/Calibre-Regular.otf
Dsource_code/transformers/docs/source/_static/css/Calibre-Thin.otf
Dsource_code/transformers/docs/source/_static/css/code-snippets.css
Dsource_code/transformers/docs/source/_static/css/huggingface.css
Dsource_code/transformers/docs/source/_static/js
Dsource_code/transformers/docs/source/_static/js/custom.js
Dsource_code/transformers/docs/source/_static/js/huggingface_logo.svg
Dsource_code/transformers/docs/source/add_new_model.rst
Dsource_code/transformers/docs/source/benchmarks.rst
Dsource_code/transformers/docs/source/bertology.rst
Dsource_code/transformers/docs/source/community.md
Dsource_code/transformers/docs/source/conf.py
Dsource_code/transformers/docs/source/contributing.md
Dsource_code/transformers/docs/source/converting_tensorflow_models.rst
Dsource_code/transformers/docs/source/custom_datasets.rst
Dsource_code/transformers/docs/source/examples.md
Dsource_code/transformers/docs/source/favicon.ico
Dsource_code/transformers/docs/source/glossary.rst
Dsource_code/transformers/docs/source/imgs
Dsource_code/transformers/docs/source/imgs/local_attention_mask.png
Dsource_code/transformers/docs/source/imgs/ppl_chunked.gif
Dsource_code/transformers/docs/source/imgs/ppl_full.gif
Dsource_code/transformers/docs/source/imgs/ppl_sliding.gif
Dsource_code/transformers/docs/source/imgs/transformers_logo_name.png
Dsource_code/transformers/docs/source/imgs/transformers_overview.png
Dsource_code/transformers/docs/source/imgs/warmup_constant_schedule.png
Dsource_code/transformers/docs/source/imgs/warmup_cosine_hard_restarts_schedule.png
Dsource_code/transformers/docs/source/imgs/warmup_cosine_schedule.png
Dsource_code/transformers/docs/source/imgs/warmup_cosine_warm_restarts_schedule.png
Dsource_code/transformers/docs/source/imgs/warmup_linear_schedule.png
Dsource_code/transformers/docs/source/index.rst
Dsource_code/transformers/docs/source/installation.md
Dsource_code/transformers/docs/source/internal
Dsource_code/transformers/docs/source/internal/file_utils.rst
Dsource_code/transformers/docs/source/internal/generation_utils.rst
Dsource_code/transformers/docs/source/internal/modeling_utils.rst
Dsource_code/transformers/docs/source/internal/pipelines_utils.rst
Dsource_code/transformers/docs/source/internal/tokenization_utils.rst
Dsource_code/transformers/docs/source/internal/trainer_utils.rst
Dsource_code/transformers/docs/source/main_classes
Dsource_code/transformers/docs/source/main_classes/callback.rst
Dsource_code/transformers/docs/source/main_classes/configuration.rst
Dsource_code/transformers/docs/source/main_classes/feature_extractor.rst
Dsource_code/transformers/docs/source/main_classes/logging.rst
Dsource_code/transformers/docs/source/main_classes/model.rst
Dsource_code/transformers/docs/source/main_classes/optimizer_schedules.rst
Dsource_code/transformers/docs/source/main_classes/output.rst
Dsource_code/transformers/docs/source/main_classes/pipelines.rst
Dsource_code/transformers/docs/source/main_classes/processors.rst
Dsource_code/transformers/docs/source/main_classes/tokenizer.rst
Dsource_code/transformers/docs/source/main_classes/trainer.rst
Dsource_code/transformers/docs/source/migration.md
Dsource_code/transformers/docs/source/model_doc
Dsource_code/transformers/docs/source/model_doc/albert.rst
Dsource_code/transformers/docs/source/model_doc/auto.rst
Dsource_code/transformers/docs/source/model_doc/bart.rst
Dsource_code/transformers/docs/source/model_doc/barthez.rst
Dsource_code/transformers/docs/source/model_doc/bert.rst
Dsource_code/transformers/docs/source/model_doc/bertgeneration.rst
Dsource_code/transformers/docs/source/model_doc/bertweet.rst
Dsource_code/transformers/docs/source/model_doc/blenderbot.rst
Dsource_code/transformers/docs/source/model_doc/blenderbot_small.rst
Dsource_code/transformers/docs/source/model_doc/bort.rst
Dsource_code/transformers/docs/source/model_doc/camembert.rst
Dsource_code/transformers/docs/source/model_doc/convbert.rst
Dsource_code/transformers/docs/source/model_doc/ctrl.rst
Dsource_code/transformers/docs/source/model_doc/deberta.rst
Dsource_code/transformers/docs/source/model_doc/deberta_v2.rst
Dsource_code/transformers/docs/source/model_doc/dialogpt.rst
Dsource_code/transformers/docs/source/model_doc/distilbert.rst
Dsource_code/transformers/docs/source/model_doc/dpr.rst
Dsource_code/transformers/docs/source/model_doc/electra.rst
Dsource_code/transformers/docs/source/model_doc/encoderdecoder.rst
Dsource_code/transformers/docs/source/model_doc/flaubert.rst
Dsource_code/transformers/docs/source/model_doc/fsmt.rst
Dsource_code/transformers/docs/source/model_doc/funnel.rst
Dsource_code/transformers/docs/source/model_doc/gpt.rst
Dsource_code/transformers/docs/source/model_doc/gpt2.rst
Dsource_code/transformers/docs/source/model_doc/herbert.rst
Dsource_code/transformers/docs/source/model_doc/ibert.rst
Dsource_code/transformers/docs/source/model_doc/layoutlm.rst
Dsource_code/transformers/docs/source/model_doc/led.rst
Dsource_code/transformers/docs/source/model_doc/longformer.rst
Dsource_code/transformers/docs/source/model_doc/lxmert.rst
Dsource_code/transformers/docs/source/model_doc/m2m_100.rst
Dsource_code/transformers/docs/source/model_doc/marian.rst
Dsource_code/transformers/docs/source/model_doc/mbart.rst
Dsource_code/transformers/docs/source/model_doc/mobilebert.rst
Dsource_code/transformers/docs/source/model_doc/mpnet.rst
Dsource_code/transformers/docs/source/model_doc/mt5.rst
Dsource_code/transformers/docs/source/model_doc/pegasus.rst
Dsource_code/transformers/docs/source/model_doc/phobert.rst
Dsource_code/transformers/docs/source/model_doc/prophetnet.rst
Dsource_code/transformers/docs/source/model_doc/rag.rst
Dsource_code/transformers/docs/source/model_doc/reformer.rst
Dsource_code/transformers/docs/source/model_doc/retribert.rst
Dsource_code/transformers/docs/source/model_doc/roberta.rst
Dsource_code/transformers/docs/source/model_doc/speech_to_text.rst
Dsource_code/transformers/docs/source/model_doc/squeezebert.rst
Dsource_code/transformers/docs/source/model_doc/t5.rst
Dsource_code/transformers/docs/source/model_doc/tapas.rst
Dsource_code/transformers/docs/source/model_doc/transformerxl.rst
Dsource_code/transformers/docs/source/model_doc/wav2vec2.rst
Dsource_code/transformers/docs/source/model_doc/xlm.rst
Dsource_code/transformers/docs/source/model_doc/xlmprophetnet.rst
Dsource_code/transformers/docs/source/model_doc/xlmroberta.rst
Dsource_code/transformers/docs/source/model_doc/xlnet.rst
Dsource_code/transformers/docs/source/model_doc/xlsr_wav2vec2.rst
Dsource_code/transformers/docs/source/model_sharing.rst
Dsource_code/transformers/docs/source/model_summary.rst
Dsource_code/transformers/docs/source/multilingual.rst
Dsource_code/transformers/docs/source/notebooks.md
Dsource_code/transformers/docs/source/perplexity.rst
Dsource_code/transformers/docs/source/philosophy.rst
Dsource_code/transformers/docs/source/preprocessing.rst
Dsource_code/transformers/docs/source/pretrained_models.rst
Dsource_code/transformers/docs/source/quicktour.rst
Dsource_code/transformers/docs/source/serialization.rst
Dsource_code/transformers/docs/source/task_summary.rst
Dsource_code/transformers/docs/source/testing.rst
Dsource_code/transformers/docs/source/tokenizer_summary.rst
Dsource_code/transformers/docs/source/training.rst
Dsource_code/transformers/examples
Dsource_code/transformers/examples/README.md
Dsource_code/transformers/examples/_tests_requirements.txt
Dsource_code/transformers/examples/benchmarking
Dsource_code/transformers/examples/benchmarking/README.md
Dsource_code/transformers/examples/benchmarking/plot_csv_file.py
Dsource_code/transformers/examples/benchmarking/requirements.txt
Dsource_code/transformers/examples/benchmarking/run_benchmark.py
Dsource_code/transformers/examples/benchmarking/run_benchmark_tf.py
Dsource_code/transformers/examples/conftest.py
Dsource_code/transformers/examples/language-modeling
Dsource_code/transformers/examples/language-modeling/README.md
Dsource_code/transformers/examples/language-modeling/requirements.txt
Dsource_code/transformers/examples/language-modeling/run_clm.py
Dsource_code/transformers/examples/language-modeling/run_mlm.py
Dsource_code/transformers/examples/language-modeling/run_mlm_flax.py
Dsource_code/transformers/examples/language-modeling/run_plm.py
Dsource_code/transformers/examples/language-modeling/train.txt
Dsource_code/transformers/examples/legacy
Dsource_code/transformers/examples/legacy/README.md
Dsource_code/transformers/examples/legacy/multiple_choice
Dsource_code/transformers/examples/legacy/multiple_choice/run_multiple_choice.py
Dsource_code/transformers/examples/legacy/multiple_choice/utils_multiple_choice.py
Dsource_code/transformers/examples/legacy/pytorch-lightning
Dsource_code/transformers/examples/legacy/pytorch-lightning/lightning_base.py
Dsource_code/transformers/examples/legacy/pytorch-lightning/requirements.txt
Dsource_code/transformers/examples/legacy/pytorch-lightning/run_glue.py
Dsource_code/transformers/examples/legacy/pytorch-lightning/run_glue.sh
Dsource_code/transformers/examples/legacy/pytorch-lightning/run_ner.py
Dsource_code/transformers/examples/legacy/pytorch-lightning/run_ner.sh
Dsource_code/transformers/examples/legacy/pytorch-lightning/run_pos.sh
Dsource_code/transformers/examples/legacy/question-answering
Dsource_code/transformers/examples/legacy/question-answering/run_squad.py
Dsource_code/transformers/examples/legacy/question-answering/run_squad_trainer.py
Dsource_code/transformers/examples/legacy/run_camembert.py
Dsource_code/transformers/examples/legacy/run_chinese_ref.py
Dsource_code/transformers/examples/legacy/run_language_modeling.py
Dsource_code/transformers/examples/legacy/run_openai_gpt.py
Dsource_code/transformers/examples/legacy/run_swag.py
Dsource_code/transformers/examples/legacy/run_transfo_xl.py
Dsource_code/transformers/examples/legacy/seq2seq
Dsource_code/transformers/examples/legacy/seq2seq/README.md
Dsource_code/transformers/examples/legacy/seq2seq/__init__.py
Dsource_code/transformers/examples/legacy/seq2seq/convert_model_to_fp16.py
Dsource_code/transformers/examples/legacy/seq2seq/download_wmt.py
Dsource_code/transformers/examples/legacy/seq2seq/finetune.sh
Dsource_code/transformers/examples/legacy/seq2seq/finetune_tpu.sh
Dsource_code/transformers/examples/legacy/seq2seq/finetune_trainer.py
Dsource_code/transformers/examples/legacy/seq2seq/minify_dataset.py
Dsource_code/transformers/examples/legacy/seq2seq/old_test_calculate_rouge.py
Dsource_code/transformers/examples/legacy/seq2seq/old_test_datasets.py
Dsource_code/transformers/examples/legacy/seq2seq/old_test_fsmt_bleu_score.py
Dsource_code/transformers/examples/legacy/seq2seq/old_test_seq2seq_examples.py
Dsource_code/transformers/examples/legacy/seq2seq/old_test_seq2seq_examples_multi_gpu.py
Dsource_code/transformers/examples/legacy/seq2seq/old_test_tatoeba_conversion.py
Dsource_code/transformers/examples/legacy/seq2seq/pack_dataset.py
Dsource_code/transformers/examples/legacy/seq2seq/requirements.txt
Dsource_code/transformers/examples/legacy/seq2seq/romanian_postprocessing.md
Dsource_code/transformers/examples/legacy/seq2seq/rouge_cli.py
Dsource_code/transformers/examples/legacy/seq2seq/run_distributed_eval.py
Dsource_code/transformers/examples/legacy/seq2seq/run_eval.py
Dsource_code/transformers/examples/legacy/seq2seq/run_eval_search.py
Dsource_code/transformers/examples/legacy/seq2seq/save_len_file.py
Dsource_code/transformers/examples/legacy/seq2seq/save_randomly_initialized_model.py
Dsource_code/transformers/examples/legacy/seq2seq/sentence_splitter.py
Dsource_code/transformers/examples/legacy/seq2seq/seq2seq_trainer.py
Dsource_code/transformers/examples/legacy/seq2seq/seq2seq_training_args.py
Dsource_code/transformers/examples/legacy/seq2seq/test_data
Dsource_code/transformers/examples/legacy/seq2seq/test_data/fsmt
Dsource_code/transformers/examples/legacy/seq2seq/test_data/fsmt/build-eval-data.py
Dsource_code/transformers/examples/legacy/seq2seq/test_data/fsmt/fsmt_val_data.json
Dsource_code/transformers/examples/legacy/seq2seq/test_data/test_data
Dsource_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro
Dsource_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro/test.source
Dsource_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro/test.target
Dsource_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro/train.len
Dsource_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro/train.source
Dsource_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro/train.target
Dsource_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro/val.len
Dsource_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro/val.source
Dsource_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro/val.target
Dsource_code/transformers/examples/legacy/seq2seq/train_distil_marian_enro.sh
Dsource_code/transformers/examples/legacy/seq2seq/train_distil_marian_enro_tpu.sh
Dsource_code/transformers/examples/legacy/seq2seq/train_distilbart_cnn.sh
Dsource_code/transformers/examples/legacy/seq2seq/train_mbart_cc25_enro.sh
Dsource_code/transformers/examples/legacy/seq2seq/utils.py
Dsource_code/transformers/examples/legacy/seq2seq/xla_spawn.py
Dsource_code/transformers/examples/legacy/token-classification
Dsource_code/transformers/examples/legacy/token-classification/README.md
Dsource_code/transformers/examples/legacy/token-classification/run.sh
Dsource_code/transformers/examples/legacy/token-classification/run_chunk.sh
Dsource_code/transformers/examples/legacy/token-classification/run_ner.py
Dsource_code/transformers/examples/legacy/token-classification/run_pos.sh
Dsource_code/transformers/examples/legacy/token-classification/run_tf_ner.py
Dsource_code/transformers/examples/legacy/token-classification/scripts
Dsource_code/transformers/examples/legacy/token-classification/scripts/preprocess.py
Dsource_code/transformers/examples/legacy/token-classification/tasks.py
Dsource_code/transformers/examples/legacy/token-classification/utils_ner.py
Dsource_code/transformers/examples/multiple-choice
Dsource_code/transformers/examples/multiple-choice/README.md
Dsource_code/transformers/examples/multiple-choice/requirements.txt
Dsource_code/transformers/examples/multiple-choice/run_swag.py
Dsource_code/transformers/examples/multiple-choice/run_tf_multiple_choice.py
Dsource_code/transformers/examples/multiple-choice/utils_multiple_choice.py
Dsource_code/transformers/examples/question-answering
Dsource_code/transformers/examples/question-answering/README.md
Dsource_code/transformers/examples/question-answering/requirements.txt
Dsource_code/transformers/examples/question-answering/run_qa.py
Dsource_code/transformers/examples/question-answering/run_qa_beam_search.py
Dsource_code/transformers/examples/question-answering/run_tf_squad.py
Dsource_code/transformers/examples/question-answering/trainer_qa.py
Dsource_code/transformers/examples/question-answering/utils_qa.py
Dsource_code/transformers/examples/research_projects
Dsource_code/transformers/examples/research_projects/README.md
Dsource_code/transformers/examples/research_projects/adversarial
Dsource_code/transformers/examples/research_projects/adversarial/README.md
Dsource_code/transformers/examples/research_projects/adversarial/requirements.txt
Dsource_code/transformers/examples/research_projects/adversarial/run_hans.py
Dsource_code/transformers/examples/research_projects/adversarial/utils_hans.py
Dsource_code/transformers/examples/research_projects/bert-loses-patience
Dsource_code/transformers/examples/research_projects/bert-loses-patience/README.md
Dsource_code/transformers/examples/research_projects/bert-loses-patience/pabee
Dsource_code/transformers/examples/research_projects/bert-loses-patience/pabee/__init__.py
Dsource_code/transformers/examples/research_projects/bert-loses-patience/pabee/modeling_pabee_albert.py
Dsource_code/transformers/examples/research_projects/bert-loses-patience/pabee/modeling_pabee_bert.py
Dsource_code/transformers/examples/research_projects/bert-loses-patience/requirements.txt
Dsource_code/transformers/examples/research_projects/bert-loses-patience/run_glue_with_pabee.py
Dsource_code/transformers/examples/research_projects/bert-loses-patience/test_run_glue_with_pabee.py
Dsource_code/transformers/examples/research_projects/bertabs
Dsource_code/transformers/examples/research_projects/bertabs/README.md
Dsource_code/transformers/examples/research_projects/bertabs/__init__.py
Dsource_code/transformers/examples/research_projects/bertabs/configuration_bertabs.py
Dsource_code/transformers/examples/research_projects/bertabs/convert_bertabs_original_pytorch_checkpoint.py
Dsource_code/transformers/examples/research_projects/bertabs/modeling_bertabs.py
Dsource_code/transformers/examples/research_projects/bertabs/requirements.txt
Dsource_code/transformers/examples/research_projects/bertabs/run_summarization.py
Dsource_code/transformers/examples/research_projects/bertabs/test_utils_summarization.py
Dsource_code/transformers/examples/research_projects/bertabs/utils_summarization.py
Dsource_code/transformers/examples/research_projects/bertology
Dsource_code/transformers/examples/research_projects/bertology/requirements.txt
Dsource_code/transformers/examples/research_projects/bertology/run_bertology.py
Dsource_code/transformers/examples/research_projects/bertology/run_prune_gpt.py
Dsource_code/transformers/examples/research_projects/deebert
Dsource_code/transformers/examples/research_projects/deebert/README.md
Dsource_code/transformers/examples/research_projects/deebert/entropy_eval.sh
Dsource_code/transformers/examples/research_projects/deebert/eval_deebert.sh
Dsource_code/transformers/examples/research_projects/deebert/requirements.txt
Dsource_code/transformers/examples/research_projects/deebert/run_glue_deebert.py
Dsource_code/transformers/examples/research_projects/deebert/src
Dsource_code/transformers/examples/research_projects/deebert/src/__init__.py
Dsource_code/transformers/examples/research_projects/deebert/src/modeling_highway_bert.py
Dsource_code/transformers/examples/research_projects/deebert/src/modeling_highway_roberta.py
Dsource_code/transformers/examples/research_projects/deebert/test_glue_deebert.py
Dsource_code/transformers/examples/research_projects/deebert/train_deebert.sh
Dsource_code/transformers/examples/research_projects/distillation
Dsource_code/transformers/examples/research_projects/distillation/README.md
Dsource_code/transformers/examples/research_projects/distillation/distiller.py
Dsource_code/transformers/examples/research_projects/distillation/grouped_batch_sampler.py
Dsource_code/transformers/examples/research_projects/distillation/lm_seqs_dataset.py
Dsource_code/transformers/examples/research_projects/distillation/requirements.txt
Dsource_code/transformers/examples/research_projects/distillation/run_squad_w_distillation.py
Dsource_code/transformers/examples/research_projects/distillation/scripts
Dsource_code/transformers/examples/research_projects/distillation/scripts/binarized_data.py
Dsource_code/transformers/examples/research_projects/distillation/scripts/extract.py
Dsource_code/transformers/examples/research_projects/distillation/scripts/extract_distilbert.py
Dsource_code/transformers/examples/research_projects/distillation/scripts/token_counts.py
Dsource_code/transformers/examples/research_projects/distillation/train.py
Dsource_code/transformers/examples/research_projects/distillation/training_configs
Dsource_code/transformers/examples/research_projects/distillation/training_configs/distilbert-base-cased.json
Dsource_code/transformers/examples/research_projects/distillation/training_configs/distilbert-base-multilingual-cased.json
Dsource_code/transformers/examples/research_projects/distillation/training_configs/distilbert-base-uncased.json
Dsource_code/transformers/examples/research_projects/distillation/training_configs/distilgpt2.json
Dsource_code/transformers/examples/research_projects/distillation/training_configs/distilroberta-base.json
Dsource_code/transformers/examples/research_projects/distillation/utils.py
Dsource_code/transformers/examples/research_projects/longform-qa
Dsource_code/transformers/examples/research_projects/longform-qa/README.md
Dsource_code/transformers/examples/research_projects/longform-qa/eli5_app.py
Dsource_code/transformers/examples/research_projects/longform-qa/eli5_utils.py
Dsource_code/transformers/examples/research_projects/longform-qa/requirements.txt
Dsource_code/transformers/examples/research_projects/lxmert
Dsource_code/transformers/examples/research_projects/lxmert/README.md
Dsource_code/transformers/examples/research_projects/lxmert/demo.ipynb
Dsource_code/transformers/examples/research_projects/lxmert/extracting_data.py
Dsource_code/transformers/examples/research_projects/lxmert/modeling_frcnn.py
Dsource_code/transformers/examples/research_projects/lxmert/processing_image.py
Dsource_code/transformers/examples/research_projects/lxmert/requirements.txt
Dsource_code/transformers/examples/research_projects/lxmert/utils.py
Dsource_code/transformers/examples/research_projects/lxmert/visualizing_image.py
Dsource_code/transformers/examples/research_projects/mlm_wwm
Dsource_code/transformers/examples/research_projects/mlm_wwm/README.md
Dsource_code/transformers/examples/research_projects/mlm_wwm/requirements.txt
Dsource_code/transformers/examples/research_projects/mlm_wwm/run_chinese_ref.py
Dsource_code/transformers/examples/research_projects/mlm_wwm/run_mlm_wwm.py
Dsource_code/transformers/examples/research_projects/mm-imdb
Dsource_code/transformers/examples/research_projects/mm-imdb/README.md
Dsource_code/transformers/examples/research_projects/mm-imdb/run_mmimdb.py
Dsource_code/transformers/examples/research_projects/mm-imdb/utils_mmimdb.py
Dsource_code/transformers/examples/research_projects/movement-pruning
Dsource_code/transformers/examples/research_projects/movement-pruning/README.md
Dsource_code/transformers/examples/research_projects/movement-pruning/Saving_PruneBERT.ipynb
Dsource_code/transformers/examples/research_projects/movement-pruning/bertarize.py
Dsource_code/transformers/examples/research_projects/movement-pruning/counts_parameters.py
Dsource_code/transformers/examples/research_projects/movement-pruning/emmental
Dsource_code/transformers/examples/research_projects/movement-pruning/emmental/__init__.py
Dsource_code/transformers/examples/research_projects/movement-pruning/emmental/configuration_bert_masked.py
Dsource_code/transformers/examples/research_projects/movement-pruning/emmental/modeling_bert_masked.py
Dsource_code/transformers/examples/research_projects/movement-pruning/emmental/modules
Dsource_code/transformers/examples/research_projects/movement-pruning/emmental/modules/__init__.py
Dsource_code/transformers/examples/research_projects/movement-pruning/emmental/modules/binarizer.py
Dsource_code/transformers/examples/research_projects/movement-pruning/emmental/modules/masked_nn.py
Dsource_code/transformers/examples/research_projects/movement-pruning/masked_run_glue.py
Dsource_code/transformers/examples/research_projects/movement-pruning/masked_run_squad.py
Dsource_code/transformers/examples/research_projects/movement-pruning/requirements.txt
Dsource_code/transformers/examples/research_projects/performer
Dsource_code/transformers/examples/research_projects/performer/README.md
Dsource_code/transformers/examples/research_projects/performer/full_script.sh
Dsource_code/transformers/examples/research_projects/performer/modeling_flax_performer.py
Dsource_code/transformers/examples/research_projects/performer/modeling_flax_performer_utils.py
Dsource_code/transformers/examples/research_projects/performer/run_mlm_performer.py
Dsource_code/transformers/examples/research_projects/performer/sanity_script.sh
Dsource_code/transformers/examples/research_projects/pplm
Dsource_code/transformers/examples/research_projects/pplm/README.md
Dsource_code/transformers/examples/research_projects/pplm/imgs
Dsource_code/transformers/examples/research_projects/pplm/imgs/headfigure.png
Dsource_code/transformers/examples/research_projects/pplm/imgs/wooly.png
Dsource_code/transformers/examples/research_projects/pplm/pplm_classification_head.py
Dsource_code/transformers/examples/research_projects/pplm/requirements.txt
Dsource_code/transformers/examples/research_projects/pplm/run_pplm.py
Dsource_code/transformers/examples/research_projects/pplm/run_pplm_discrim_train.py
Dsource_code/transformers/examples/research_projects/rag
Dsource_code/transformers/examples/research_projects/rag/README.md
Dsource_code/transformers/examples/research_projects/rag/__init__.py
Dsource_code/transformers/examples/research_projects/rag/_test_finetune_rag.py
Dsource_code/transformers/examples/research_projects/rag/callbacks_rag.py
Dsource_code/transformers/examples/research_projects/rag/consolidate_rag_checkpoint.py
Dsource_code/transformers/examples/research_projects/rag/distributed_pytorch_retriever.py
Dsource_code/transformers/examples/research_projects/rag/distributed_ray_retriever.py
Dsource_code/transformers/examples/research_projects/rag/eval_rag.py
Dsource_code/transformers/examples/research_projects/rag/finetune_rag.py
Dsource_code/transformers/examples/research_projects/rag/finetune_rag.sh
Dsource_code/transformers/examples/research_projects/rag/finetune_rag_ray.sh
Dsource_code/transformers/examples/research_projects/rag/lightning_base.py
Dsource_code/transformers/examples/research_projects/rag/parse_dpr_relevance_data.py
Dsource_code/transformers/examples/research_projects/rag/requirements.txt
Dsource_code/transformers/examples/research_projects/rag/test_data
Dsource_code/transformers/examples/research_projects/rag/test_data/my_knowledge_dataset.csv
Dsource_code/transformers/examples/research_projects/rag/test_distributed_retriever.py
Dsource_code/transformers/examples/research_projects/rag/use_own_knowledge_dataset.py
Dsource_code/transformers/examples/research_projects/rag/utils_rag.py
Dsource_code/transformers/examples/research_projects/seq2seq-distillation
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/README.md
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/_test_bash_script.py
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/_test_make_student.py
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/_test_seq2seq_examples.py
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/_test_seq2seq_examples_multi_gpu.py
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/callbacks.py
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/convert_pl_checkpoint_to_hf.py
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/distil_marian_enro_teacher.sh
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/distil_marian_no_teacher.sh
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/distillation.py
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/dynamic_bs_example.sh
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/finetune.py
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/finetune.sh
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/finetune_bart_tiny.sh
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/finetune_pegasus_xsum.sh
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/finetune_t5.sh
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/lightning_base.py
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/make_student.py
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/precomputed_pseudo_labels.md
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/requirements.txt
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/run_eval.py
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/sentence_splitter.py
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/train_distilbart_cnn.sh
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/train_distilbart_xsum.sh
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/train_mbart_cc25_enro.sh
Dsource_code/transformers/examples/research_projects/seq2seq-distillation/utils.py
Dsource_code/transformers/examples/research_projects/wav2vec2
Dsource_code/transformers/examples/research_projects/wav2vec2/README.md
Dsource_code/transformers/examples/research_projects/wav2vec2/finetune_base_100.sh
Dsource_code/transformers/examples/research_projects/wav2vec2/finetune_large_lv60_100.sh
Dsource_code/transformers/examples/research_projects/wav2vec2/requirements.txt
Dsource_code/transformers/examples/research_projects/wav2vec2/run_asr.py
Dsource_code/transformers/examples/research_projects/zero-shot-distillation
Dsource_code/transformers/examples/research_projects/zero-shot-distillation/README.md
Dsource_code/transformers/examples/research_projects/zero-shot-distillation/distill_classifier.py
Dsource_code/transformers/examples/seq2seq
Dsource_code/transformers/examples/seq2seq/README.md
Dsource_code/transformers/examples/seq2seq/requirements.txt
Dsource_code/transformers/examples/seq2seq/run_seq2seq.py
Dsource_code/transformers/examples/test_data
Dsource_code/transformers/examples/test_data/wmt_en_ro
Dsource_code/transformers/examples/test_data/wmt_en_ro/test.json
Dsource_code/transformers/examples/test_data/wmt_en_ro/train.json
Dsource_code/transformers/examples/test_data/wmt_en_ro/val.json
Dsource_code/transformers/examples/test_examples.py
Dsource_code/transformers/examples/test_xla_examples.py
Dsource_code/transformers/examples/tests
Dsource_code/transformers/examples/tests/deepspeed
Dsource_code/transformers/examples/tests/deepspeed/ds_config.json
Dsource_code/transformers/examples/tests/deepspeed/test_deepspeed.py
Dsource_code/transformers/examples/tests/trainer
Dsource_code/transformers/examples/tests/trainer/test_trainer_ext.py
Dsource_code/transformers/examples/text-classification
Dsource_code/transformers/examples/text-classification/README.md
Dsource_code/transformers/examples/text-classification/requirements.txt
Dsource_code/transformers/examples/text-classification/run_glue.py
Dsource_code/transformers/examples/text-classification/run_glue_no_trainer.py
Dsource_code/transformers/examples/text-classification/run_tf_glue.py
Dsource_code/transformers/examples/text-classification/run_tf_text_classification.py
Dsource_code/transformers/examples/text-classification/run_xnli.py
Dsource_code/transformers/examples/text-generation
Dsource_code/transformers/examples/text-generation/README.md
Dsource_code/transformers/examples/text-generation/requirements.txt
Dsource_code/transformers/examples/text-generation/run_generation.py
Dsource_code/transformers/examples/token-classification
Dsource_code/transformers/examples/token-classification/README.md
Dsource_code/transformers/examples/token-classification/requirements.txt
Dsource_code/transformers/examples/token-classification/run.sh
Dsource_code/transformers/examples/token-classification/run_ner.py
Dsource_code/transformers/examples/xla_spawn.py
Dsource_code/transformers/hubconf.py
Dsource_code/transformers/model_cards
Dsource_code/transformers/model_cards/README.md
Dsource_code/transformers/model_cards/google
Dsource_code/transformers/model_cards/google/tapas-base
Dsource_code/transformers/model_cards/google/tapas-base/README.md
Dsource_code/transformers/notebooks
Dsource_code/transformers/notebooks/01-training-tokenizers.ipynb
Dsource_code/transformers/notebooks/02-transformers.ipynb
Dsource_code/transformers/notebooks/03-pipelines.ipynb
Dsource_code/transformers/notebooks/04-onnx-export.ipynb
Dsource_code/transformers/notebooks/05-benchmark.ipynb
Dsource_code/transformers/notebooks/README.md
Dsource_code/transformers/pyproject.toml
Dsource_code/transformers/scripts
Dsource_code/transformers/scripts/check_tokenizers.py
Dsource_code/transformers/scripts/fsmt
Dsource_code/transformers/scripts/fsmt/convert-allenai-wmt16.sh
Dsource_code/transformers/scripts/fsmt/convert-allenai-wmt19.sh
Dsource_code/transformers/scripts/fsmt/convert-facebook-wmt19.sh
Dsource_code/transformers/scripts/fsmt/eval-allenai-wmt16.sh
Dsource_code/transformers/scripts/fsmt/eval-allenai-wmt19.sh
Dsource_code/transformers/scripts/fsmt/eval-facebook-wmt19.sh
Dsource_code/transformers/scripts/fsmt/fsmt-make-super-tiny-model.py
Dsource_code/transformers/scripts/fsmt/fsmt-make-tiny-model.py
Dsource_code/transformers/scripts/fsmt/gen-card-allenai-wmt16.py
Dsource_code/transformers/scripts/fsmt/gen-card-allenai-wmt19.py
Dsource_code/transformers/scripts/fsmt/gen-card-facebook-wmt19.py
Dsource_code/transformers/scripts/fsmt/s3-move.sh
Dsource_code/transformers/scripts/fsmt/tests-to-run.sh
Dsource_code/transformers/scripts/pegasus
Dsource_code/transformers/scripts/pegasus/build_test_sample_spm_no_bos.py
Dsource_code/transformers/scripts/stale.py
Dsource_code/transformers/scripts/tatoeba
Dsource_code/transformers/scripts/tatoeba/README.md
Dsource_code/transformers/scripts/tatoeba/upload_models.sh
Dsource_code/transformers/setup.cfg
Dsource_code/transformers/setup.py
Dsource_code/transformers/src
Dsource_code/transformers/src/transformers
Dsource_code/transformers/src/transformers/__init__.py
Dsource_code/transformers/src/transformers/activations.py
Dsource_code/transformers/src/transformers/activations_tf.py
Dsource_code/transformers/src/transformers/benchmark
Dsource_code/transformers/src/transformers/benchmark/__init__.py
Dsource_code/transformers/src/transformers/benchmark/benchmark.py
Dsource_code/transformers/src/transformers/benchmark/benchmark_args.py
Dsource_code/transformers/src/transformers/benchmark/benchmark_args_tf.py
Dsource_code/transformers/src/transformers/benchmark/benchmark_args_utils.py
Dsource_code/transformers/src/transformers/benchmark/benchmark_tf.py
Dsource_code/transformers/src/transformers/benchmark/benchmark_utils.py
Dsource_code/transformers/src/transformers/commands
Dsource_code/transformers/src/transformers/commands/__init__.py
Dsource_code/transformers/src/transformers/commands/add_new_model.py
Dsource_code/transformers/src/transformers/commands/convert.py
Dsource_code/transformers/src/transformers/commands/download.py
Dsource_code/transformers/src/transformers/commands/env.py
Dsource_code/transformers/src/transformers/commands/lfs.py
Dsource_code/transformers/src/transformers/commands/run.py
Dsource_code/transformers/src/transformers/commands/serving.py
Dsource_code/transformers/src/transformers/commands/train.py
Dsource_code/transformers/src/transformers/commands/transformers_cli.py
Dsource_code/transformers/src/transformers/commands/user.py
Dsource_code/transformers/src/transformers/configuration_utils.py
Dsource_code/transformers/src/transformers/convert_graph_to_onnx.py
Dsource_code/transformers/src/transformers/convert_pytorch_checkpoint_to_tf2.py
Dsource_code/transformers/src/transformers/convert_slow_tokenizer.py
Dsource_code/transformers/src/transformers/convert_slow_tokenizers_checkpoints_to_fast.py
Dsource_code/transformers/src/transformers/convert_tf_hub_seq_to_seq_bert_to_pytorch.py
Dsource_code/transformers/src/transformers/data
Dsource_code/transformers/src/transformers/data/__init__.py
Dsource_code/transformers/src/transformers/data/data_collator.py
Dsource_code/transformers/src/transformers/data/datasets
Dsource_code/transformers/src/transformers/data/datasets/__init__.py
Dsource_code/transformers/src/transformers/data/datasets/glue.py
Dsource_code/transformers/src/transformers/data/datasets/language_modeling.py
Dsource_code/transformers/src/transformers/data/datasets/squad.py
Dsource_code/transformers/src/transformers/data/metrics
Dsource_code/transformers/src/transformers/data/metrics/__init__.py
Dsource_code/transformers/src/transformers/data/metrics/squad_metrics.py
Dsource_code/transformers/src/transformers/data/processors
Dsource_code/transformers/src/transformers/data/processors/__init__.py
Dsource_code/transformers/src/transformers/data/processors/glue.py
Dsource_code/transformers/src/transformers/data/processors/squad.py
Dsource_code/transformers/src/transformers/data/processors/utils.py
Dsource_code/transformers/src/transformers/data/processors/xnli.py
Dsource_code/transformers/src/transformers/data/test_generation_utils.py
Dsource_code/transformers/src/transformers/dependency_versions_check.py
Dsource_code/transformers/src/transformers/dependency_versions_table.py
Dsource_code/transformers/src/transformers/feature_extraction_sequence_utils.py
Dsource_code/transformers/src/transformers/feature_extraction_utils.py
Dsource_code/transformers/src/transformers/file_utils.py
Dsource_code/transformers/src/transformers/generation_beam_search.py
Dsource_code/transformers/src/transformers/generation_logits_process.py
Dsource_code/transformers/src/transformers/generation_stopping_criteria.py
Dsource_code/transformers/src/transformers/generation_tf_utils.py
Dsource_code/transformers/src/transformers/generation_utils.py
Dsource_code/transformers/src/transformers/hf_api.py
Dsource_code/transformers/src/transformers/hf_argparser.py
Dsource_code/transformers/src/transformers/integrations.py
Dsource_code/transformers/src/transformers/modelcard.py
Dsource_code/transformers/src/transformers/modeling_flax_utils.py
Dsource_code/transformers/src/transformers/modeling_outputs.py
Dsource_code/transformers/src/transformers/modeling_tf_outputs.py
Dsource_code/transformers/src/transformers/modeling_tf_pytorch_utils.py
Dsource_code/transformers/src/transformers/modeling_tf_utils.py
Dsource_code/transformers/src/transformers/modeling_utils.py
Dsource_code/transformers/src/transformers/models
Dsource_code/transformers/src/transformers/models/__init__.py
Dsource_code/transformers/src/transformers/models/albert
Dsource_code/transformers/src/transformers/models/albert/__init__.py
Dsource_code/transformers/src/transformers/models/albert/configuration_albert.py
Dsource_code/transformers/src/transformers/models/albert/convert_albert_original_tf_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/albert/modeling_albert.py
Dsource_code/transformers/src/transformers/models/albert/modeling_tf_albert.py
Dsource_code/transformers/src/transformers/models/albert/tokenization_albert.py
Dsource_code/transformers/src/transformers/models/albert/tokenization_albert_fast.py
Dsource_code/transformers/src/transformers/models/auto
Dsource_code/transformers/src/transformers/models/auto/__init__.py
Dsource_code/transformers/src/transformers/models/auto/configuration_auto.py
Dsource_code/transformers/src/transformers/models/auto/modeling_auto.py
Dsource_code/transformers/src/transformers/models/auto/modeling_flax_auto.py
Dsource_code/transformers/src/transformers/models/auto/modeling_tf_auto.py
Dsource_code/transformers/src/transformers/models/auto/tokenization_auto.py
Dsource_code/transformers/src/transformers/models/bart
Dsource_code/transformers/src/transformers/models/bart/__init__.py
Dsource_code/transformers/src/transformers/models/bart/configuration_bart.py
Dsource_code/transformers/src/transformers/models/bart/convert_bart_original_pytorch_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/bart/modeling_bart.py
Dsource_code/transformers/src/transformers/models/bart/modeling_tf_bart.py
Dsource_code/transformers/src/transformers/models/bart/tokenization_bart.py
Dsource_code/transformers/src/transformers/models/bart/tokenization_bart_fast.py
Dsource_code/transformers/src/transformers/models/barthez
Dsource_code/transformers/src/transformers/models/barthez/__init__.py
Dsource_code/transformers/src/transformers/models/barthez/tokenization_barthez.py
Dsource_code/transformers/src/transformers/models/barthez/tokenization_barthez_fast.py
Dsource_code/transformers/src/transformers/models/bert
Dsource_code/transformers/src/transformers/models/bert/__init__.py
Dsource_code/transformers/src/transformers/models/bert/configuration_bert.py
Dsource_code/transformers/src/transformers/models/bert/convert_bert_original_tf2_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/bert/convert_bert_original_tf_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/bert/convert_bert_pytorch_checkpoint_to_original_tf.py
Dsource_code/transformers/src/transformers/models/bert/modeling_bert.py
Dsource_code/transformers/src/transformers/models/bert/modeling_flax_bert.py
Dsource_code/transformers/src/transformers/models/bert/modeling_tf_bert.py
Dsource_code/transformers/src/transformers/models/bert/tokenization_bert.py
Dsource_code/transformers/src/transformers/models/bert/tokenization_bert_fast.py
Dsource_code/transformers/src/transformers/models/bert_generation
Dsource_code/transformers/src/transformers/models/bert_generation/__init__.py
Dsource_code/transformers/src/transformers/models/bert_generation/configuration_bert_generation.py
Dsource_code/transformers/src/transformers/models/bert_generation/modeling_bert_generation.py
Dsource_code/transformers/src/transformers/models/bert_generation/tokenization_bert_generation.py
Dsource_code/transformers/src/transformers/models/bert_japanese
Dsource_code/transformers/src/transformers/models/bert_japanese/__init__.py
Dsource_code/transformers/src/transformers/models/bert_japanese/tokenization_bert_japanese.py
Dsource_code/transformers/src/transformers/models/bertweet
Dsource_code/transformers/src/transformers/models/bertweet/__init__.py
Dsource_code/transformers/src/transformers/models/bertweet/tokenization_bertweet.py
Dsource_code/transformers/src/transformers/models/blenderbot
Dsource_code/transformers/src/transformers/models/blenderbot/__init__.py
Dsource_code/transformers/src/transformers/models/blenderbot/configuration_blenderbot.py
Dsource_code/transformers/src/transformers/models/blenderbot/convert_blenderbot_original_pytorch_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/blenderbot/modeling_blenderbot.py
Dsource_code/transformers/src/transformers/models/blenderbot/modeling_tf_blenderbot.py
Dsource_code/transformers/src/transformers/models/blenderbot/tokenization_blenderbot.py
Dsource_code/transformers/src/transformers/models/blenderbot_small
Dsource_code/transformers/src/transformers/models/blenderbot_small/__init__.py
Dsource_code/transformers/src/transformers/models/blenderbot_small/configuration_blenderbot_small.py
Dsource_code/transformers/src/transformers/models/blenderbot_small/modeling_blenderbot_small.py
Dsource_code/transformers/src/transformers/models/blenderbot_small/modeling_tf_blenderbot_small.py
Dsource_code/transformers/src/transformers/models/blenderbot_small/tokenization_blenderbot_small.py
Dsource_code/transformers/src/transformers/models/blenderbot_small/tokenization_blenderbot_small_fast.py
Dsource_code/transformers/src/transformers/models/bort
Dsource_code/transformers/src/transformers/models/bort/convert_bort_original_gluonnlp_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/camembert
Dsource_code/transformers/src/transformers/models/camembert/__init__.py
Dsource_code/transformers/src/transformers/models/camembert/configuration_camembert.py
Dsource_code/transformers/src/transformers/models/camembert/modeling_camembert.py
Dsource_code/transformers/src/transformers/models/camembert/modeling_tf_camembert.py
Dsource_code/transformers/src/transformers/models/camembert/tokenization_camembert.py
Dsource_code/transformers/src/transformers/models/camembert/tokenization_camembert_fast.py
Dsource_code/transformers/src/transformers/models/convbert
Dsource_code/transformers/src/transformers/models/convbert/__init__.py
Dsource_code/transformers/src/transformers/models/convbert/configuration_convbert.py
Dsource_code/transformers/src/transformers/models/convbert/convert_convbert_original_tf1_checkpoint_to_pytorch_and_tf2.py
Dsource_code/transformers/src/transformers/models/convbert/modeling_convbert.py
Dsource_code/transformers/src/transformers/models/convbert/modeling_tf_convbert.py
Dsource_code/transformers/src/transformers/models/convbert/tokenization_convbert.py
Dsource_code/transformers/src/transformers/models/convbert/tokenization_convbert_fast.py
Dsource_code/transformers/src/transformers/models/ctrl
Dsource_code/transformers/src/transformers/models/ctrl/__init__.py
Dsource_code/transformers/src/transformers/models/ctrl/configuration_ctrl.py
Dsource_code/transformers/src/transformers/models/ctrl/modeling_ctrl.py
Dsource_code/transformers/src/transformers/models/ctrl/modeling_tf_ctrl.py
Dsource_code/transformers/src/transformers/models/ctrl/tokenization_ctrl.py
Dsource_code/transformers/src/transformers/models/deberta
Dsource_code/transformers/src/transformers/models/deberta/__init__.py
Dsource_code/transformers/src/transformers/models/deberta/configuration_deberta.py
Dsource_code/transformers/src/transformers/models/deberta/modeling_deberta.py
Dsource_code/transformers/src/transformers/models/deberta/tokenization_deberta.py
Dsource_code/transformers/src/transformers/models/deberta_v2
Dsource_code/transformers/src/transformers/models/deberta_v2/__init__.py
Dsource_code/transformers/src/transformers/models/deberta_v2/configuration_deberta_v2.py
Dsource_code/transformers/src/transformers/models/deberta_v2/modeling_deberta_v2.py
Dsource_code/transformers/src/transformers/models/deberta_v2/tokenization_deberta_v2.py
Dsource_code/transformers/src/transformers/models/dialogpt
Dsource_code/transformers/src/transformers/models/dialogpt/__init__.py
Dsource_code/transformers/src/transformers/models/dialogpt/convert_dialogpt_original_pytorch_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/distilbert
Dsource_code/transformers/src/transformers/models/distilbert/__init__.py
Dsource_code/transformers/src/transformers/models/distilbert/configuration_distilbert.py
Dsource_code/transformers/src/transformers/models/distilbert/modeling_distilbert.py
Dsource_code/transformers/src/transformers/models/distilbert/modeling_tf_distilbert.py
Dsource_code/transformers/src/transformers/models/distilbert/tokenization_distilbert.py
Dsource_code/transformers/src/transformers/models/distilbert/tokenization_distilbert_fast.py
Dsource_code/transformers/src/transformers/models/dpr
Dsource_code/transformers/src/transformers/models/dpr/__init__.py
Dsource_code/transformers/src/transformers/models/dpr/configuration_dpr.py
Dsource_code/transformers/src/transformers/models/dpr/convert_dpr_original_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/dpr/modeling_dpr.py
Dsource_code/transformers/src/transformers/models/dpr/modeling_tf_dpr.py
Dsource_code/transformers/src/transformers/models/dpr/tokenization_dpr.py
Dsource_code/transformers/src/transformers/models/dpr/tokenization_dpr_fast.py
Dsource_code/transformers/src/transformers/models/electra
Dsource_code/transformers/src/transformers/models/electra/__init__.py
Dsource_code/transformers/src/transformers/models/electra/configuration_electra.py
Dsource_code/transformers/src/transformers/models/electra/convert_electra_original_tf_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/electra/modeling_electra.py
Dsource_code/transformers/src/transformers/models/electra/modeling_tf_electra.py
Dsource_code/transformers/src/transformers/models/electra/tokenization_electra.py
Dsource_code/transformers/src/transformers/models/electra/tokenization_electra_fast.py
Dsource_code/transformers/src/transformers/models/encoder_decoder
Dsource_code/transformers/src/transformers/models/encoder_decoder/__init__.py
Dsource_code/transformers/src/transformers/models/encoder_decoder/configuration_encoder_decoder.py
Dsource_code/transformers/src/transformers/models/encoder_decoder/modeling_encoder_decoder.py
Dsource_code/transformers/src/transformers/models/flaubert
Dsource_code/transformers/src/transformers/models/flaubert/__init__.py
Dsource_code/transformers/src/transformers/models/flaubert/configuration_flaubert.py
Dsource_code/transformers/src/transformers/models/flaubert/modeling_flaubert.py
Dsource_code/transformers/src/transformers/models/flaubert/modeling_tf_flaubert.py
Dsource_code/transformers/src/transformers/models/flaubert/tokenization_flaubert.py
Dsource_code/transformers/src/transformers/models/fsmt
Dsource_code/transformers/src/transformers/models/fsmt/__init__.py
Dsource_code/transformers/src/transformers/models/fsmt/configuration_fsmt.py
Dsource_code/transformers/src/transformers/models/fsmt/convert_fsmt_original_pytorch_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/fsmt/modeling_fsmt.py
Dsource_code/transformers/src/transformers/models/fsmt/tokenization_fsmt.py
Dsource_code/transformers/src/transformers/models/funnel
Dsource_code/transformers/src/transformers/models/funnel/__init__.py
Dsource_code/transformers/src/transformers/models/funnel/configuration_funnel.py
Dsource_code/transformers/src/transformers/models/funnel/convert_funnel_original_tf_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/funnel/modeling_funnel.py
Dsource_code/transformers/src/transformers/models/funnel/modeling_tf_funnel.py
Dsource_code/transformers/src/transformers/models/funnel/tokenization_funnel.py
Dsource_code/transformers/src/transformers/models/funnel/tokenization_funnel_fast.py
Dsource_code/transformers/src/transformers/models/gpt2
Dsource_code/transformers/src/transformers/models/gpt2/__init__.py
Dsource_code/transformers/src/transformers/models/gpt2/configuration_gpt2.py
Dsource_code/transformers/src/transformers/models/gpt2/convert_gpt2_original_tf_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/gpt2/modeling_gpt2.py
Dsource_code/transformers/src/transformers/models/gpt2/modeling_tf_gpt2.py
Dsource_code/transformers/src/transformers/models/gpt2/tokenization_gpt2.py
Dsource_code/transformers/src/transformers/models/gpt2/tokenization_gpt2_fast.py
Dsource_code/transformers/src/transformers/models/herbert
Dsource_code/transformers/src/transformers/models/herbert/__init__.py
Dsource_code/transformers/src/transformers/models/herbert/tokenization_herbert.py
Dsource_code/transformers/src/transformers/models/herbert/tokenization_herbert_fast.py
Dsource_code/transformers/src/transformers/models/ibert
Dsource_code/transformers/src/transformers/models/ibert/__init__.py
Dsource_code/transformers/src/transformers/models/ibert/configuration_ibert.py
Dsource_code/transformers/src/transformers/models/ibert/modeling_ibert.py
Dsource_code/transformers/src/transformers/models/ibert/quant_modules.py
Dsource_code/transformers/src/transformers/models/layoutlm
Dsource_code/transformers/src/transformers/models/layoutlm/__init__.py
Dsource_code/transformers/src/transformers/models/layoutlm/configuration_layoutlm.py
Dsource_code/transformers/src/transformers/models/layoutlm/modeling_layoutlm.py
Dsource_code/transformers/src/transformers/models/layoutlm/tokenization_layoutlm.py
Dsource_code/transformers/src/transformers/models/layoutlm/tokenization_layoutlm_fast.py
Dsource_code/transformers/src/transformers/models/led
Dsource_code/transformers/src/transformers/models/led/__init__.py
Dsource_code/transformers/src/transformers/models/led/configuration_led.py
Dsource_code/transformers/src/transformers/models/led/modeling_led.py
Dsource_code/transformers/src/transformers/models/led/modeling_tf_led.py
Dsource_code/transformers/src/transformers/models/led/tokenization_led.py
Dsource_code/transformers/src/transformers/models/led/tokenization_led_fast.py
Dsource_code/transformers/src/transformers/models/longformer
Dsource_code/transformers/src/transformers/models/longformer/__init__.py
Dsource_code/transformers/src/transformers/models/longformer/configuration_longformer.py
Dsource_code/transformers/src/transformers/models/longformer/convert_longformer_original_pytorch_lightning_to_pytorch.py
Dsource_code/transformers/src/transformers/models/longformer/modeling_longformer.py
Dsource_code/transformers/src/transformers/models/longformer/modeling_tf_longformer.py
Dsource_code/transformers/src/transformers/models/longformer/tokenization_longformer.py
Dsource_code/transformers/src/transformers/models/longformer/tokenization_longformer_fast.py
Dsource_code/transformers/src/transformers/models/lxmert
Dsource_code/transformers/src/transformers/models/lxmert/__init__.py
Dsource_code/transformers/src/transformers/models/lxmert/configuration_lxmert.py
Dsource_code/transformers/src/transformers/models/lxmert/convert_lxmert_original_tf_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/lxmert/modeling_lxmert.py
Dsource_code/transformers/src/transformers/models/lxmert/modeling_tf_lxmert.py
Dsource_code/transformers/src/transformers/models/lxmert/tokenization_lxmert.py
Dsource_code/transformers/src/transformers/models/lxmert/tokenization_lxmert_fast.py
Dsource_code/transformers/src/transformers/models/m2m_100
Dsource_code/transformers/src/transformers/models/m2m_100/__init__.py
Dsource_code/transformers/src/transformers/models/m2m_100/configuration_m2m_100.py
Dsource_code/transformers/src/transformers/models/m2m_100/convert_m2m100_original_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/m2m_100/modeling_m2m_100.py
Dsource_code/transformers/src/transformers/models/m2m_100/tokenization_m2m_100.py
Dsource_code/transformers/src/transformers/models/marian
Dsource_code/transformers/src/transformers/models/marian/__init__.py
Dsource_code/transformers/src/transformers/models/marian/configuration_marian.py
Dsource_code/transformers/src/transformers/models/marian/convert_marian_tatoeba_to_pytorch.py
Dsource_code/transformers/src/transformers/models/marian/convert_marian_to_pytorch.py
Dsource_code/transformers/src/transformers/models/marian/modeling_marian.py
Dsource_code/transformers/src/transformers/models/marian/modeling_tf_marian.py
Dsource_code/transformers/src/transformers/models/marian/tokenization_marian.py
Dsource_code/transformers/src/transformers/models/mbart
Dsource_code/transformers/src/transformers/models/mbart/__init__.py
Dsource_code/transformers/src/transformers/models/mbart/configuration_mbart.py
Dsource_code/transformers/src/transformers/models/mbart/convert_mbart_original_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/mbart/modeling_mbart.py
Dsource_code/transformers/src/transformers/models/mbart/modeling_tf_mbart.py
Dsource_code/transformers/src/transformers/models/mbart/tokenization_mbart.py
Dsource_code/transformers/src/transformers/models/mbart/tokenization_mbart50.py
Dsource_code/transformers/src/transformers/models/mbart/tokenization_mbart50_fast.py
Dsource_code/transformers/src/transformers/models/mbart/tokenization_mbart_fast.py
Dsource_code/transformers/src/transformers/models/mmbt
Dsource_code/transformers/src/transformers/models/mmbt/__init__.py
Dsource_code/transformers/src/transformers/models/mmbt/configuration_mmbt.py
Dsource_code/transformers/src/transformers/models/mmbt/modeling_mmbt.py
Dsource_code/transformers/src/transformers/models/mobilebert
Dsource_code/transformers/src/transformers/models/mobilebert/__init__.py
Dsource_code/transformers/src/transformers/models/mobilebert/configuration_mobilebert.py
Dsource_code/transformers/src/transformers/models/mobilebert/convert_mobilebert_original_tf_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/mobilebert/modeling_mobilebert.py
Dsource_code/transformers/src/transformers/models/mobilebert/modeling_tf_mobilebert.py
Dsource_code/transformers/src/transformers/models/mobilebert/tokenization_mobilebert.py
Dsource_code/transformers/src/transformers/models/mobilebert/tokenization_mobilebert_fast.py
Dsource_code/transformers/src/transformers/models/mpnet
Dsource_code/transformers/src/transformers/models/mpnet/__init__.py
Dsource_code/transformers/src/transformers/models/mpnet/configuration_mpnet.py
Dsource_code/transformers/src/transformers/models/mpnet/modeling_mpnet.py
Dsource_code/transformers/src/transformers/models/mpnet/modeling_tf_mpnet.py
Dsource_code/transformers/src/transformers/models/mpnet/tokenization_mpnet.py
Dsource_code/transformers/src/transformers/models/mpnet/tokenization_mpnet_fast.py
Dsource_code/transformers/src/transformers/models/mt5
Dsource_code/transformers/src/transformers/models/mt5/__init__.py
Dsource_code/transformers/src/transformers/models/mt5/configuration_mt5.py
Dsource_code/transformers/src/transformers/models/mt5/modeling_mt5.py
Dsource_code/transformers/src/transformers/models/mt5/modeling_tf_mt5.py
Dsource_code/transformers/src/transformers/models/openai
Dsource_code/transformers/src/transformers/models/openai/__init__.py
Dsource_code/transformers/src/transformers/models/openai/configuration_openai.py
Dsource_code/transformers/src/transformers/models/openai/convert_openai_original_tf_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/openai/modeling_openai.py
Dsource_code/transformers/src/transformers/models/openai/modeling_tf_openai.py
Dsource_code/transformers/src/transformers/models/openai/tokenization_openai.py
Dsource_code/transformers/src/transformers/models/openai/tokenization_openai_fast.py
Dsource_code/transformers/src/transformers/models/pegasus
Dsource_code/transformers/src/transformers/models/pegasus/__init__.py
Dsource_code/transformers/src/transformers/models/pegasus/configuration_pegasus.py
Dsource_code/transformers/src/transformers/models/pegasus/convert_pegasus_tf_to_pytorch.py
Dsource_code/transformers/src/transformers/models/pegasus/modeling_pegasus.py
Dsource_code/transformers/src/transformers/models/pegasus/modeling_tf_pegasus.py
Dsource_code/transformers/src/transformers/models/pegasus/tokenization_pegasus.py
Dsource_code/transformers/src/transformers/models/pegasus/tokenization_pegasus_fast.py
Dsource_code/transformers/src/transformers/models/phobert
Dsource_code/transformers/src/transformers/models/phobert/__init__.py
Dsource_code/transformers/src/transformers/models/phobert/tokenization_phobert.py
Dsource_code/transformers/src/transformers/models/prophetnet
Dsource_code/transformers/src/transformers/models/prophetnet/__init__.py
Dsource_code/transformers/src/transformers/models/prophetnet/configuration_prophetnet.py
Dsource_code/transformers/src/transformers/models/prophetnet/convert_prophetnet_original_pytorch_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/prophetnet/modeling_prophetnet.py
Dsource_code/transformers/src/transformers/models/prophetnet/tokenization_prophetnet.py
Dsource_code/transformers/src/transformers/models/rag
Dsource_code/transformers/src/transformers/models/rag/__init__.py
Dsource_code/transformers/src/transformers/models/rag/configuration_rag.py
Dsource_code/transformers/src/transformers/models/rag/modeling_rag.py
Dsource_code/transformers/src/transformers/models/rag/modeling_tf_rag.py
Dsource_code/transformers/src/transformers/models/rag/retrieval_rag.py
Dsource_code/transformers/src/transformers/models/rag/tokenization_rag.py
Dsource_code/transformers/src/transformers/models/reformer
Dsource_code/transformers/src/transformers/models/reformer/configuration_reformer.py
Dsource_code/transformers/src/transformers/models/reformer/convert_reformer_trax_checkpoint_to_pytorch.py
Dsource_code/transformers/src/transformers/models/reformer/modeling_reformer.py
Dsource_code/transformers/src/transformers/models/reformer/tokenization_reformer.py
Dsource_code/transformers/src/transformers/optimization.py
Dsource_code/transformers/src/transformers/optimization_tf.py
Dsource_code/transformers/src/transformers/testing_utils.py
Dsource_code/transformers/src/transformers/tokenization_utils.py
Dsource_code/transformers/src/transformers/tokenization_utils_base.py
Dsource_code/transformers/src/transformers/tokenization_utils_fast.py
Dsource_code/transformers/src/transformers/trainer.py
Dsource_code/transformers/src/transformers/trainer_callback.py
Dsource_code/transformers/src/transformers/trainer_pt_utils.py
Dsource_code/transformers/src/transformers/trainer_seq2seq.py
Dsource_code/transformers/src/transformers/trainer_tf.py
Dsource_code/transformers/src/transformers/trainer_utils.py
Dsource_code/transformers/src/transformers/training_args.py
Dsource_code/transformers/src/transformers/training_args_seq2seq.py
Dsource_code/transformers/src/transformers/training_args_tf.py
Dsource_code/transformers/valohai.yaml

R11484:73ab19ec174f

View Options

main.pdf

Loading...
View Options

source_code/transformers

Loading...
View Options

source_code/transformers/.circleci

Loading...
View Options

source_code/transformers/.circleci/config.yml

Loading...
View Options

source_code/transformers/.circleci/deploy.sh

Loading...
View Options

source_code/transformers/.coveragerc

Loading...
View Options

source_code/transformers/.gitattributes

Loading...
View Options

source_code/transformers/.github

Loading...
View Options

source_code/transformers/.github/ISSUE_TEMPLATE

Loading...
View Options

source_code/transformers/.github/ISSUE_TEMPLATE/---new-benchmark.md

Loading...
View Options

source_code/transformers/.github/ISSUE_TEMPLATE/--new-model-addition.md

Loading...
View Options

source_code/transformers/.github/ISSUE_TEMPLATE/bug-report.md

Loading...
View Options

source_code/transformers/.github/ISSUE_TEMPLATE/feature-request.md

Loading...
View Options

source_code/transformers/.github/ISSUE_TEMPLATE/migration.md

Loading...
View Options

source_code/transformers/.github/ISSUE_TEMPLATE/question-help.md

Loading...
View Options

source_code/transformers/.github/PULL_REQUEST_TEMPLATE.md

Loading...
View Options

source_code/transformers/.github/conda

Loading...
View Options

source_code/transformers/.github/conda/build.sh

Loading...
View Options

source_code/transformers/.github/conda/meta.yaml

Loading...
View Options

source_code/transformers/.github/workflows

Loading...
View Options

source_code/transformers/.github/workflows/github-torch-hub.yml

Loading...
View Options

source_code/transformers/.github/workflows/model-templates.yml

Loading...
View Options

source_code/transformers/.github/workflows/release-conda.yml

Loading...
View Options

source_code/transformers/.github/workflows/self-push.yml

Loading...
View Options

source_code/transformers/.github/workflows/self-scheduled.yml

Loading...
View Options

source_code/transformers/.github/workflows/stale.yml

Loading...
View Options

source_code/transformers/.gitignore

Loading...
View Options

source_code/transformers/CODE_OF_CONDUCT.md

Loading...
View Options

source_code/transformers/CONTRIBUTING.md

Loading...
View Options

source_code/transformers/ISSUES.md

Loading...
View Options

source_code/transformers/LICENSE

Loading...
View Options

source_code/transformers/MANIFEST.in

Loading...
View Options

source_code/transformers/Makefile

Loading...
View Options

source_code/transformers/README.md

Loading...
View Options

source_code/transformers/docker

Loading...
View Options

source_code/transformers/docker/transformers-cpu

Loading...
View Options

source_code/transformers/docker/transformers-cpu/Dockerfile

Loading...
View Options

source_code/transformers/docker/transformers-gpu

Loading...
View Options

source_code/transformers/docker/transformers-gpu/Dockerfile

Loading...
View Options

source_code/transformers/docker/transformers-pytorch-cpu

Loading...
View Options

source_code/transformers/docker/transformers-pytorch-cpu/Dockerfile

Loading...
View Options

source_code/transformers/docker/transformers-pytorch-gpu

Loading...
View Options

source_code/transformers/docker/transformers-pytorch-gpu/Dockerfile

Loading...
View Options

source_code/transformers/docker/transformers-pytorch-tpu

Loading...
View Options

source_code/transformers/docker/transformers-pytorch-tpu/Dockerfile

Loading...
View Options

source_code/transformers/docker/transformers-pytorch-tpu/bert-base-cased.jsonnet

Loading...
View Options

source_code/transformers/docker/transformers-pytorch-tpu/dataset.yaml

Loading...
View Options

source_code/transformers/docker/transformers-pytorch-tpu/docker-entrypoint.sh

Loading...
View Options

source_code/transformers/docker/transformers-tensorflow-cpu

Loading...
View Options

source_code/transformers/docker/transformers-tensorflow-cpu/Dockerfile

Loading...
View Options

source_code/transformers/docker/transformers-tensorflow-gpu

Loading...
View Options

source_code/transformers/docker/transformers-tensorflow-gpu/Dockerfile

Loading...
View Options

source_code/transformers/docs

Loading...
View Options

source_code/transformers/docs/Makefile

Loading...
View Options

source_code/transformers/docs/README.md

Loading...
View Options

source_code/transformers/docs/source

Loading...
View Options

source_code/transformers/docs/source/_static

Loading...
View Options

source_code/transformers/docs/source/_static/css

Loading...
View Options

source_code/transformers/docs/source/_static/css/Calibre-Light.ttf

Loading...
View Options

source_code/transformers/docs/source/_static/css/Calibre-Medium.otf

Loading...
View Options

source_code/transformers/docs/source/_static/css/Calibre-Regular.otf

Loading...
View Options

source_code/transformers/docs/source/_static/css/Calibre-Thin.otf

Loading...
View Options

source_code/transformers/docs/source/_static/css/code-snippets.css

Loading...
View Options

source_code/transformers/docs/source/_static/css/huggingface.css

Loading...
View Options

source_code/transformers/docs/source/_static/js

Loading...
View Options

source_code/transformers/docs/source/_static/js/custom.js

Loading...
View Options

source_code/transformers/docs/source/_static/js/huggingface_logo.svg

Loading...
View Options

source_code/transformers/docs/source/add_new_model.rst

Loading...
View Options

source_code/transformers/docs/source/benchmarks.rst

Loading...
View Options

source_code/transformers/docs/source/bertology.rst

Loading...
View Options

source_code/transformers/docs/source/community.md

Loading...
View Options

source_code/transformers/docs/source/conf.py

Loading...
View Options

source_code/transformers/docs/source/contributing.md

Loading...
View Options

source_code/transformers/docs/source/converting_tensorflow_models.rst

Loading...
View Options

source_code/transformers/docs/source/custom_datasets.rst

Loading...
View Options

source_code/transformers/docs/source/examples.md

Loading...
View Options

source_code/transformers/docs/source/favicon.ico

Loading...
View Options

source_code/transformers/docs/source/glossary.rst

Loading...
View Options

source_code/transformers/docs/source/imgs

Loading...
View Options

source_code/transformers/docs/source/imgs/local_attention_mask.png

Loading...
View Options

source_code/transformers/docs/source/imgs/ppl_chunked.gif

Loading...
View Options

source_code/transformers/docs/source/imgs/ppl_full.gif

Loading...
View Options

source_code/transformers/docs/source/imgs/ppl_sliding.gif

Loading...
View Options

source_code/transformers/docs/source/imgs/transformers_logo_name.png

Loading...
View Options

source_code/transformers/docs/source/imgs/transformers_overview.png

Loading...
View Options

source_code/transformers/docs/source/imgs/warmup_constant_schedule.png

Loading...
View Options

source_code/transformers/docs/source/imgs/warmup_cosine_hard_restarts_schedule.png

Loading...
View Options

source_code/transformers/docs/source/imgs/warmup_cosine_schedule.png

Loading...
View Options

source_code/transformers/docs/source/imgs/warmup_cosine_warm_restarts_schedule.png

Loading...
View Options

source_code/transformers/docs/source/imgs/warmup_linear_schedule.png

Loading...
View Options

source_code/transformers/docs/source/index.rst

Loading...
View Options

source_code/transformers/docs/source/installation.md

Loading...
View Options

source_code/transformers/docs/source/internal

Loading...
View Options

source_code/transformers/docs/source/internal/file_utils.rst

Loading...
View Options

source_code/transformers/docs/source/internal/generation_utils.rst

Loading...
View Options

source_code/transformers/docs/source/internal/modeling_utils.rst

Loading...
View Options

source_code/transformers/docs/source/internal/pipelines_utils.rst

Loading...
View Options

source_code/transformers/docs/source/internal/tokenization_utils.rst

Loading...
View Options

source_code/transformers/docs/source/internal/trainer_utils.rst

Loading...
View Options

source_code/transformers/docs/source/main_classes

Loading...
View Options

source_code/transformers/docs/source/main_classes/callback.rst

Loading...
View Options

source_code/transformers/docs/source/main_classes/configuration.rst

Loading...
View Options

source_code/transformers/docs/source/main_classes/feature_extractor.rst

Loading...
View Options

source_code/transformers/docs/source/main_classes/logging.rst

Loading...
View Options

source_code/transformers/docs/source/main_classes/model.rst

Loading...
View Options

source_code/transformers/docs/source/main_classes/optimizer_schedules.rst

Loading...
View Options

source_code/transformers/docs/source/main_classes/output.rst

Loading...
View Options

source_code/transformers/docs/source/main_classes/pipelines.rst

Loading...
View Options

source_code/transformers/docs/source/main_classes/processors.rst

Loading...
View Options

source_code/transformers/docs/source/main_classes/tokenizer.rst

Loading...
View Options

source_code/transformers/docs/source/main_classes/trainer.rst

Loading...
View Options

source_code/transformers/docs/source/migration.md

Loading...
View Options

source_code/transformers/docs/source/model_doc

Loading...
View Options

source_code/transformers/docs/source/model_doc/albert.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/auto.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/bart.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/barthez.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/bert.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/bertgeneration.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/bertweet.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/blenderbot.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/blenderbot_small.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/bort.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/camembert.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/convbert.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/ctrl.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/deberta.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/deberta_v2.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/dialogpt.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/distilbert.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/dpr.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/electra.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/encoderdecoder.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/flaubert.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/fsmt.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/funnel.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/gpt.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/gpt2.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/herbert.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/ibert.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/layoutlm.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/led.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/longformer.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/lxmert.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/m2m_100.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/marian.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/mbart.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/mobilebert.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/mpnet.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/mt5.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/pegasus.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/phobert.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/prophetnet.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/rag.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/reformer.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/retribert.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/roberta.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/speech_to_text.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/squeezebert.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/t5.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/tapas.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/transformerxl.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/wav2vec2.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/xlm.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/xlmprophetnet.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/xlmroberta.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/xlnet.rst

Loading...
View Options

source_code/transformers/docs/source/model_doc/xlsr_wav2vec2.rst

Loading...
View Options

source_code/transformers/docs/source/model_sharing.rst

Loading...
View Options

source_code/transformers/docs/source/model_summary.rst

Loading...
View Options

source_code/transformers/docs/source/multilingual.rst

Loading...
View Options

source_code/transformers/docs/source/notebooks.md

Loading...
View Options

source_code/transformers/docs/source/perplexity.rst

Loading...
View Options

source_code/transformers/docs/source/philosophy.rst

Loading...
View Options

source_code/transformers/docs/source/preprocessing.rst

Loading...
View Options

source_code/transformers/docs/source/pretrained_models.rst

Loading...
View Options

source_code/transformers/docs/source/quicktour.rst

Loading...
View Options

source_code/transformers/docs/source/serialization.rst

Loading...
View Options

source_code/transformers/docs/source/task_summary.rst

Loading...
View Options

source_code/transformers/docs/source/testing.rst

Loading...
View Options

source_code/transformers/docs/source/tokenizer_summary.rst

Loading...
View Options

source_code/transformers/docs/source/training.rst

Loading...
View Options

source_code/transformers/examples

Loading...
View Options

source_code/transformers/examples/README.md

Loading...
View Options

source_code/transformers/examples/_tests_requirements.txt

Loading...
View Options

source_code/transformers/examples/benchmarking

Loading...
View Options

source_code/transformers/examples/benchmarking/README.md

Loading...
View Options

source_code/transformers/examples/benchmarking/plot_csv_file.py

Loading...
View Options

source_code/transformers/examples/benchmarking/requirements.txt

Loading...
View Options

source_code/transformers/examples/benchmarking/run_benchmark.py

Loading...
View Options

source_code/transformers/examples/benchmarking/run_benchmark_tf.py

Loading...
View Options

source_code/transformers/examples/conftest.py

Loading...
View Options

source_code/transformers/examples/language-modeling

Loading...
View Options

source_code/transformers/examples/language-modeling/README.md

Loading...
View Options

source_code/transformers/examples/language-modeling/requirements.txt

Loading...
View Options

source_code/transformers/examples/language-modeling/run_clm.py

Loading...
View Options

source_code/transformers/examples/language-modeling/run_mlm.py

Loading...
View Options

source_code/transformers/examples/language-modeling/run_mlm_flax.py

Loading...
View Options

source_code/transformers/examples/language-modeling/run_plm.py

Loading...
View Options

source_code/transformers/examples/language-modeling/train.txt

Loading...
View Options

source_code/transformers/examples/legacy

Loading...
View Options

source_code/transformers/examples/legacy/README.md

Loading...
View Options

source_code/transformers/examples/legacy/multiple_choice

Loading...
View Options

source_code/transformers/examples/legacy/multiple_choice/run_multiple_choice.py

Loading...
View Options

source_code/transformers/examples/legacy/multiple_choice/utils_multiple_choice.py

Loading...
View Options

source_code/transformers/examples/legacy/pytorch-lightning

Loading...
View Options

source_code/transformers/examples/legacy/pytorch-lightning/lightning_base.py

Loading...
View Options

source_code/transformers/examples/legacy/pytorch-lightning/requirements.txt

Loading...
View Options

source_code/transformers/examples/legacy/pytorch-lightning/run_glue.py

Loading...
View Options

source_code/transformers/examples/legacy/pytorch-lightning/run_glue.sh

Loading...
View Options

source_code/transformers/examples/legacy/pytorch-lightning/run_ner.py

Loading...
View Options

source_code/transformers/examples/legacy/pytorch-lightning/run_ner.sh

Loading...
View Options

source_code/transformers/examples/legacy/pytorch-lightning/run_pos.sh

Loading...
View Options

source_code/transformers/examples/legacy/question-answering

Loading...
View Options

source_code/transformers/examples/legacy/question-answering/run_squad.py

Loading...
View Options

source_code/transformers/examples/legacy/question-answering/run_squad_trainer.py

Loading...
View Options

source_code/transformers/examples/legacy/run_camembert.py

Loading...
View Options

source_code/transformers/examples/legacy/run_chinese_ref.py

Loading...
View Options

source_code/transformers/examples/legacy/run_language_modeling.py

Loading...
View Options

source_code/transformers/examples/legacy/run_openai_gpt.py

Loading...
View Options

source_code/transformers/examples/legacy/run_swag.py

Loading...
View Options

source_code/transformers/examples/legacy/run_transfo_xl.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/README.md

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/__init__.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/convert_model_to_fp16.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/download_wmt.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/finetune.sh

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/finetune_tpu.sh

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/finetune_trainer.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/minify_dataset.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/old_test_calculate_rouge.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/old_test_datasets.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/old_test_fsmt_bleu_score.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/old_test_seq2seq_examples.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/old_test_seq2seq_examples_multi_gpu.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/old_test_tatoeba_conversion.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/pack_dataset.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/requirements.txt

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/romanian_postprocessing.md

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/rouge_cli.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/run_distributed_eval.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/run_eval.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/run_eval_search.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/save_len_file.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/save_randomly_initialized_model.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/sentence_splitter.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/seq2seq_trainer.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/seq2seq_training_args.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/test_data

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/test_data/fsmt

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/test_data/fsmt/build-eval-data.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/test_data/fsmt/fsmt_val_data.json

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/test_data/test_data

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro/test.source

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro/test.target

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro/train.len

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro/train.source

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro/train.target

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro/val.len

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro/val.source

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/test_data/wmt_en_ro/val.target

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/train_distil_marian_enro.sh

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/train_distil_marian_enro_tpu.sh

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/train_distilbart_cnn.sh

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/train_mbart_cc25_enro.sh

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/utils.py

Loading...
View Options

source_code/transformers/examples/legacy/seq2seq/xla_spawn.py

Loading...
View Options

source_code/transformers/examples/legacy/token-classification

Loading...
View Options

source_code/transformers/examples/legacy/token-classification/README.md

Loading...
View Options

source_code/transformers/examples/legacy/token-classification/run.sh

Loading...
View Options

source_code/transformers/examples/legacy/token-classification/run_chunk.sh

Loading...
View Options

source_code/transformers/examples/legacy/token-classification/run_ner.py

Loading...
View Options

source_code/transformers/examples/legacy/token-classification/run_pos.sh

Loading...
View Options

source_code/transformers/examples/legacy/token-classification/run_tf_ner.py

Loading...
View Options

source_code/transformers/examples/legacy/token-classification/scripts

Loading...
View Options

source_code/transformers/examples/legacy/token-classification/scripts/preprocess.py

Loading...
View Options

source_code/transformers/examples/legacy/token-classification/tasks.py

Loading...
View Options

source_code/transformers/examples/legacy/token-classification/utils_ner.py

Loading...
View Options

source_code/transformers/examples/multiple-choice

Loading...
View Options

source_code/transformers/examples/multiple-choice/README.md

Loading...
View Options

source_code/transformers/examples/multiple-choice/requirements.txt

Loading...
View Options

source_code/transformers/examples/multiple-choice/run_swag.py

Loading...
View Options

source_code/transformers/examples/multiple-choice/run_tf_multiple_choice.py

Loading...
View Options

source_code/transformers/examples/multiple-choice/utils_multiple_choice.py

Loading...
View Options

source_code/transformers/examples/question-answering

Loading...
View Options

source_code/transformers/examples/question-answering/README.md

Loading...
View Options

source_code/transformers/examples/question-answering/requirements.txt

Loading...
View Options

source_code/transformers/examples/question-answering/run_qa.py

Loading...
View Options

source_code/transformers/examples/question-answering/run_qa_beam_search.py

Loading...
View Options

source_code/transformers/examples/question-answering/run_tf_squad.py

Loading...
View Options

source_code/transformers/examples/question-answering/trainer_qa.py

Loading...
View Options

source_code/transformers/examples/question-answering/utils_qa.py

Loading...
View Options

source_code/transformers/examples/research_projects

Loading...
View Options

source_code/transformers/examples/research_projects/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/adversarial

Loading...
View Options

source_code/transformers/examples/research_projects/adversarial/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/adversarial/requirements.txt

Loading...
View Options

source_code/transformers/examples/research_projects/adversarial/run_hans.py

Loading...
View Options

source_code/transformers/examples/research_projects/adversarial/utils_hans.py

Loading...
View Options

source_code/transformers/examples/research_projects/bert-loses-patience

Loading...
View Options

source_code/transformers/examples/research_projects/bert-loses-patience/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/bert-loses-patience/pabee

Loading...
View Options

source_code/transformers/examples/research_projects/bert-loses-patience/pabee/__init__.py

Loading...
View Options

source_code/transformers/examples/research_projects/bert-loses-patience/pabee/modeling_pabee_albert.py

Loading...
View Options

source_code/transformers/examples/research_projects/bert-loses-patience/pabee/modeling_pabee_bert.py

Loading...
View Options

source_code/transformers/examples/research_projects/bert-loses-patience/requirements.txt

Loading...
View Options

source_code/transformers/examples/research_projects/bert-loses-patience/run_glue_with_pabee.py

Loading...
View Options

source_code/transformers/examples/research_projects/bert-loses-patience/test_run_glue_with_pabee.py

Loading...
View Options

source_code/transformers/examples/research_projects/bertabs

Loading...
View Options

source_code/transformers/examples/research_projects/bertabs/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/bertabs/__init__.py

Loading...
View Options

source_code/transformers/examples/research_projects/bertabs/configuration_bertabs.py

Loading...
View Options

source_code/transformers/examples/research_projects/bertabs/convert_bertabs_original_pytorch_checkpoint.py

Loading...
View Options

source_code/transformers/examples/research_projects/bertabs/modeling_bertabs.py

Loading...
View Options

source_code/transformers/examples/research_projects/bertabs/requirements.txt

Loading...
View Options

source_code/transformers/examples/research_projects/bertabs/run_summarization.py

Loading...
View Options

source_code/transformers/examples/research_projects/bertabs/test_utils_summarization.py

Loading...
View Options

source_code/transformers/examples/research_projects/bertabs/utils_summarization.py

Loading...
View Options

source_code/transformers/examples/research_projects/bertology

Loading...
View Options

source_code/transformers/examples/research_projects/bertology/requirements.txt

Loading...
View Options

source_code/transformers/examples/research_projects/bertology/run_bertology.py

Loading...
View Options

source_code/transformers/examples/research_projects/bertology/run_prune_gpt.py

Loading...
View Options

source_code/transformers/examples/research_projects/deebert

Loading...
View Options

source_code/transformers/examples/research_projects/deebert/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/deebert/entropy_eval.sh

Loading...
View Options

source_code/transformers/examples/research_projects/deebert/eval_deebert.sh

Loading...
View Options

source_code/transformers/examples/research_projects/deebert/requirements.txt

Loading...
View Options

source_code/transformers/examples/research_projects/deebert/run_glue_deebert.py

Loading...
View Options

source_code/transformers/examples/research_projects/deebert/src

Loading...
View Options

source_code/transformers/examples/research_projects/deebert/src/__init__.py

Loading...
View Options

source_code/transformers/examples/research_projects/deebert/src/modeling_highway_bert.py

Loading...
View Options

source_code/transformers/examples/research_projects/deebert/src/modeling_highway_roberta.py

Loading...
View Options

source_code/transformers/examples/research_projects/deebert/test_glue_deebert.py

Loading...
View Options

source_code/transformers/examples/research_projects/deebert/train_deebert.sh

Loading...
View Options

source_code/transformers/examples/research_projects/distillation

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/distiller.py

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/grouped_batch_sampler.py

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/lm_seqs_dataset.py

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/requirements.txt

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/run_squad_w_distillation.py

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/scripts

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/scripts/binarized_data.py

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/scripts/extract.py

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/scripts/extract_distilbert.py

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/scripts/token_counts.py

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/train.py

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/training_configs

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/training_configs/distilbert-base-cased.json

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/training_configs/distilbert-base-multilingual-cased.json

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/training_configs/distilbert-base-uncased.json

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/training_configs/distilgpt2.json

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/training_configs/distilroberta-base.json

Loading...
View Options

source_code/transformers/examples/research_projects/distillation/utils.py

Loading...
View Options

source_code/transformers/examples/research_projects/longform-qa

Loading...
View Options

source_code/transformers/examples/research_projects/longform-qa/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/longform-qa/eli5_app.py

Loading...
View Options

source_code/transformers/examples/research_projects/longform-qa/eli5_utils.py

Loading...
View Options

source_code/transformers/examples/research_projects/longform-qa/requirements.txt

Loading...
View Options

source_code/transformers/examples/research_projects/lxmert

Loading...
View Options

source_code/transformers/examples/research_projects/lxmert/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/lxmert/demo.ipynb

Loading...
View Options

source_code/transformers/examples/research_projects/lxmert/extracting_data.py

Loading...
View Options

source_code/transformers/examples/research_projects/lxmert/modeling_frcnn.py

Loading...
View Options

source_code/transformers/examples/research_projects/lxmert/processing_image.py

Loading...
View Options

source_code/transformers/examples/research_projects/lxmert/requirements.txt

Loading...
View Options

source_code/transformers/examples/research_projects/lxmert/utils.py

Loading...
View Options

source_code/transformers/examples/research_projects/lxmert/visualizing_image.py

Loading...
View Options

source_code/transformers/examples/research_projects/mlm_wwm

Loading...
View Options

source_code/transformers/examples/research_projects/mlm_wwm/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/mlm_wwm/requirements.txt

Loading...
View Options

source_code/transformers/examples/research_projects/mlm_wwm/run_chinese_ref.py

Loading...
View Options

source_code/transformers/examples/research_projects/mlm_wwm/run_mlm_wwm.py

Loading...
View Options

source_code/transformers/examples/research_projects/mm-imdb

Loading...
View Options

source_code/transformers/examples/research_projects/mm-imdb/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/mm-imdb/run_mmimdb.py

Loading...
View Options

source_code/transformers/examples/research_projects/mm-imdb/utils_mmimdb.py

Loading...
View Options

source_code/transformers/examples/research_projects/movement-pruning

Loading...
View Options

source_code/transformers/examples/research_projects/movement-pruning/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/movement-pruning/Saving_PruneBERT.ipynb

Loading...
View Options

source_code/transformers/examples/research_projects/movement-pruning/bertarize.py

Loading...
View Options

source_code/transformers/examples/research_projects/movement-pruning/counts_parameters.py

Loading...
View Options

source_code/transformers/examples/research_projects/movement-pruning/emmental

Loading...
View Options

source_code/transformers/examples/research_projects/movement-pruning/emmental/__init__.py

Loading...
View Options

source_code/transformers/examples/research_projects/movement-pruning/emmental/configuration_bert_masked.py

Loading...
View Options

source_code/transformers/examples/research_projects/movement-pruning/emmental/modeling_bert_masked.py

Loading...
View Options

source_code/transformers/examples/research_projects/movement-pruning/emmental/modules

Loading...
View Options

source_code/transformers/examples/research_projects/movement-pruning/emmental/modules/__init__.py

Loading...
View Options

source_code/transformers/examples/research_projects/movement-pruning/emmental/modules/binarizer.py

Loading...
View Options

source_code/transformers/examples/research_projects/movement-pruning/emmental/modules/masked_nn.py

Loading...
View Options

source_code/transformers/examples/research_projects/movement-pruning/masked_run_glue.py

Loading...
View Options

source_code/transformers/examples/research_projects/movement-pruning/masked_run_squad.py

Loading...
View Options

source_code/transformers/examples/research_projects/movement-pruning/requirements.txt

Loading...
View Options

source_code/transformers/examples/research_projects/performer

Loading...
View Options

source_code/transformers/examples/research_projects/performer/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/performer/full_script.sh

Loading...
View Options

source_code/transformers/examples/research_projects/performer/modeling_flax_performer.py

Loading...
View Options

source_code/transformers/examples/research_projects/performer/modeling_flax_performer_utils.py

Loading...
View Options

source_code/transformers/examples/research_projects/performer/run_mlm_performer.py

Loading...
View Options

source_code/transformers/examples/research_projects/performer/sanity_script.sh

Loading...
View Options

source_code/transformers/examples/research_projects/pplm

Loading...
View Options

source_code/transformers/examples/research_projects/pplm/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/pplm/imgs

Loading...
View Options

source_code/transformers/examples/research_projects/pplm/imgs/headfigure.png

Loading...
View Options

source_code/transformers/examples/research_projects/pplm/imgs/wooly.png

Loading...
View Options

source_code/transformers/examples/research_projects/pplm/pplm_classification_head.py

Loading...
View Options

source_code/transformers/examples/research_projects/pplm/requirements.txt

Loading...
View Options

source_code/transformers/examples/research_projects/pplm/run_pplm.py

Loading...
View Options

source_code/transformers/examples/research_projects/pplm/run_pplm_discrim_train.py

Loading...
View Options

source_code/transformers/examples/research_projects/rag

Loading...
View Options

source_code/transformers/examples/research_projects/rag/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/rag/__init__.py

Loading...
View Options

source_code/transformers/examples/research_projects/rag/_test_finetune_rag.py

Loading...
View Options

source_code/transformers/examples/research_projects/rag/callbacks_rag.py

Loading...
View Options

source_code/transformers/examples/research_projects/rag/consolidate_rag_checkpoint.py

Loading...
View Options

source_code/transformers/examples/research_projects/rag/distributed_pytorch_retriever.py

Loading...
View Options

source_code/transformers/examples/research_projects/rag/distributed_ray_retriever.py

Loading...
View Options

source_code/transformers/examples/research_projects/rag/eval_rag.py

Loading...
View Options

source_code/transformers/examples/research_projects/rag/finetune_rag.py

Loading...
View Options

source_code/transformers/examples/research_projects/rag/finetune_rag.sh

Loading...
View Options

source_code/transformers/examples/research_projects/rag/finetune_rag_ray.sh

Loading...
View Options

source_code/transformers/examples/research_projects/rag/lightning_base.py

Loading...
View Options

source_code/transformers/examples/research_projects/rag/parse_dpr_relevance_data.py

Loading...
View Options

source_code/transformers/examples/research_projects/rag/requirements.txt

Loading...
View Options

source_code/transformers/examples/research_projects/rag/test_data

Loading...
View Options

source_code/transformers/examples/research_projects/rag/test_data/my_knowledge_dataset.csv

Loading...
View Options

source_code/transformers/examples/research_projects/rag/test_distributed_retriever.py

Loading...
View Options

source_code/transformers/examples/research_projects/rag/use_own_knowledge_dataset.py

Loading...
View Options

source_code/transformers/examples/research_projects/rag/utils_rag.py

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/_test_bash_script.py

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/_test_make_student.py

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/_test_seq2seq_examples.py

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/_test_seq2seq_examples_multi_gpu.py

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/callbacks.py

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/convert_pl_checkpoint_to_hf.py

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/distil_marian_enro_teacher.sh

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/distil_marian_no_teacher.sh

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/distillation.py

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/dynamic_bs_example.sh

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/finetune.py

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/finetune.sh

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/finetune_bart_tiny.sh

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/finetune_pegasus_xsum.sh

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/finetune_t5.sh

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/lightning_base.py

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/make_student.py

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/precomputed_pseudo_labels.md

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/requirements.txt

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/run_eval.py

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/sentence_splitter.py

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/train_distilbart_cnn.sh

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/train_distilbart_xsum.sh

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/train_mbart_cc25_enro.sh

Loading...
View Options

source_code/transformers/examples/research_projects/seq2seq-distillation/utils.py

Loading...
View Options

source_code/transformers/examples/research_projects/wav2vec2

Loading...
View Options

source_code/transformers/examples/research_projects/wav2vec2/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/wav2vec2/finetune_base_100.sh

Loading...
View Options

source_code/transformers/examples/research_projects/wav2vec2/finetune_large_lv60_100.sh

Loading...
View Options

source_code/transformers/examples/research_projects/wav2vec2/requirements.txt

Loading...
View Options

source_code/transformers/examples/research_projects/wav2vec2/run_asr.py

Loading...
View Options

source_code/transformers/examples/research_projects/zero-shot-distillation

Loading...
View Options

source_code/transformers/examples/research_projects/zero-shot-distillation/README.md

Loading...
View Options

source_code/transformers/examples/research_projects/zero-shot-distillation/distill_classifier.py

Loading...
View Options

source_code/transformers/examples/seq2seq

Loading...
View Options

source_code/transformers/examples/seq2seq/README.md

Loading...
View Options

source_code/transformers/examples/seq2seq/requirements.txt

Loading...
View Options

source_code/transformers/examples/seq2seq/run_seq2seq.py

Loading...
View Options

source_code/transformers/examples/test_data

Loading...
View Options

source_code/transformers/examples/test_data/wmt_en_ro

Loading...
View Options

source_code/transformers/examples/test_data/wmt_en_ro/test.json

Loading...
View Options

source_code/transformers/examples/test_data/wmt_en_ro/train.json

Loading...
View Options

source_code/transformers/examples/test_data/wmt_en_ro/val.json

Loading...
View Options

source_code/transformers/examples/test_examples.py

Loading...
View Options

source_code/transformers/examples/test_xla_examples.py

Loading...
View Options

source_code/transformers/examples/tests

Loading...
View Options

source_code/transformers/examples/tests/deepspeed

Loading...
View Options

source_code/transformers/examples/tests/deepspeed/ds_config.json

Loading...
View Options

source_code/transformers/examples/tests/deepspeed/test_deepspeed.py

Loading...
View Options

source_code/transformers/examples/tests/trainer

Loading...
View Options

source_code/transformers/examples/tests/trainer/test_trainer_ext.py

Loading...
View Options

source_code/transformers/examples/text-classification

Loading...
View Options

source_code/transformers/examples/text-classification/README.md

Loading...
View Options

source_code/transformers/examples/text-classification/requirements.txt

Loading...
View Options

source_code/transformers/examples/text-classification/run_glue.py

Loading...
View Options

source_code/transformers/examples/text-classification/run_glue_no_trainer.py

Loading...
View Options

source_code/transformers/examples/text-classification/run_tf_glue.py

Loading...
View Options

source_code/transformers/examples/text-classification/run_tf_text_classification.py

Loading...
View Options

source_code/transformers/examples/text-classification/run_xnli.py

Loading...
View Options

source_code/transformers/examples/text-generation

Loading...
View Options

source_code/transformers/examples/text-generation/README.md

Loading...
View Options

source_code/transformers/examples/text-generation/requirements.txt

Loading...
View Options

source_code/transformers/examples/text-generation/run_generation.py

Loading...
View Options

source_code/transformers/examples/token-classification

Loading...
View Options

source_code/transformers/examples/token-classification/README.md

Loading...
View Options

source_code/transformers/examples/token-classification/requirements.txt

Loading...
View Options

source_code/transformers/examples/token-classification/run.sh

Loading...
View Options

source_code/transformers/examples/token-classification/run_ner.py

Loading...
View Options

source_code/transformers/examples/xla_spawn.py

Loading...
View Options

source_code/transformers/hubconf.py

Loading...
View Options

source_code/transformers/model_cards

Loading...
View Options

source_code/transformers/model_cards/README.md

Loading...
View Options

source_code/transformers/model_cards/google

Loading...
View Options

source_code/transformers/model_cards/google/tapas-base

Loading...
View Options

source_code/transformers/model_cards/google/tapas-base/README.md

Loading...
View Options

source_code/transformers/notebooks

Loading...
View Options

source_code/transformers/notebooks/01-training-tokenizers.ipynb

Loading...
View Options

source_code/transformers/notebooks/02-transformers.ipynb

Loading...
View Options

source_code/transformers/notebooks/03-pipelines.ipynb

Loading...
View Options

source_code/transformers/notebooks/04-onnx-export.ipynb

Loading...
View Options

source_code/transformers/notebooks/05-benchmark.ipynb

Loading...
View Options

source_code/transformers/notebooks/README.md

Loading...
View Options

source_code/transformers/pyproject.toml

Loading...
View Options

source_code/transformers/scripts

Loading...
View Options

source_code/transformers/scripts/check_tokenizers.py

Loading...
View Options

source_code/transformers/scripts/fsmt

Loading...
View Options

source_code/transformers/scripts/fsmt/convert-allenai-wmt16.sh

Loading...
View Options

source_code/transformers/scripts/fsmt/convert-allenai-wmt19.sh

Loading...
View Options

source_code/transformers/scripts/fsmt/convert-facebook-wmt19.sh

Loading...
View Options

source_code/transformers/scripts/fsmt/eval-allenai-wmt16.sh

Loading...
View Options

source_code/transformers/scripts/fsmt/eval-allenai-wmt19.sh

Loading...
View Options

source_code/transformers/scripts/fsmt/eval-facebook-wmt19.sh

Loading...
View Options

source_code/transformers/scripts/fsmt/fsmt-make-super-tiny-model.py

Loading...
View Options

source_code/transformers/scripts/fsmt/fsmt-make-tiny-model.py

Loading...
View Options

source_code/transformers/scripts/fsmt/gen-card-allenai-wmt16.py

Loading...
View Options

source_code/transformers/scripts/fsmt/gen-card-allenai-wmt19.py

Loading...
View Options

source_code/transformers/scripts/fsmt/gen-card-facebook-wmt19.py

Loading...
View Options

source_code/transformers/scripts/fsmt/s3-move.sh

Loading...
View Options

source_code/transformers/scripts/fsmt/tests-to-run.sh

Loading...
View Options

source_code/transformers/scripts/pegasus

Loading...
View Options

source_code/transformers/scripts/pegasus/build_test_sample_spm_no_bos.py

Loading...
View Options

source_code/transformers/scripts/stale.py

Loading...
View Options

source_code/transformers/scripts/tatoeba

Loading...
View Options

source_code/transformers/scripts/tatoeba/README.md

Loading...
View Options

source_code/transformers/scripts/tatoeba/upload_models.sh

Loading...
View Options

source_code/transformers/setup.cfg

Loading...
View Options

source_code/transformers/setup.py

Loading...
View Options

source_code/transformers/src

Loading...
View Options

source_code/transformers/src/transformers

Loading...
View Options

source_code/transformers/src/transformers/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/activations.py

Loading...
View Options

source_code/transformers/src/transformers/activations_tf.py

Loading...
View Options

source_code/transformers/src/transformers/benchmark

Loading...
View Options

source_code/transformers/src/transformers/benchmark/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/benchmark/benchmark.py

Loading...
View Options

source_code/transformers/src/transformers/benchmark/benchmark_args.py

Loading...
View Options

source_code/transformers/src/transformers/benchmark/benchmark_args_tf.py

Loading...
View Options

source_code/transformers/src/transformers/benchmark/benchmark_args_utils.py

Loading...
View Options

source_code/transformers/src/transformers/benchmark/benchmark_tf.py

Loading...
View Options

source_code/transformers/src/transformers/benchmark/benchmark_utils.py

Loading...
View Options

source_code/transformers/src/transformers/commands

Loading...
View Options

source_code/transformers/src/transformers/commands/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/commands/add_new_model.py

Loading...
View Options

source_code/transformers/src/transformers/commands/convert.py

Loading...
View Options

source_code/transformers/src/transformers/commands/download.py

Loading...
View Options

source_code/transformers/src/transformers/commands/env.py

Loading...
View Options

source_code/transformers/src/transformers/commands/lfs.py

Loading...
View Options

source_code/transformers/src/transformers/commands/run.py

Loading...
View Options

source_code/transformers/src/transformers/commands/serving.py

Loading...
View Options

source_code/transformers/src/transformers/commands/train.py

Loading...
View Options

source_code/transformers/src/transformers/commands/transformers_cli.py

Loading...
View Options

source_code/transformers/src/transformers/commands/user.py

Loading...
View Options

source_code/transformers/src/transformers/configuration_utils.py

Loading...
View Options

source_code/transformers/src/transformers/convert_graph_to_onnx.py

Loading...
View Options

source_code/transformers/src/transformers/convert_pytorch_checkpoint_to_tf2.py

Loading...
View Options

source_code/transformers/src/transformers/convert_slow_tokenizer.py

Loading...
View Options

source_code/transformers/src/transformers/convert_slow_tokenizers_checkpoints_to_fast.py

Loading...
View Options

source_code/transformers/src/transformers/convert_tf_hub_seq_to_seq_bert_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/data

Loading...
View Options

source_code/transformers/src/transformers/data/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/data/data_collator.py

Loading...
View Options

source_code/transformers/src/transformers/data/datasets

Loading...
View Options

source_code/transformers/src/transformers/data/datasets/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/data/datasets/glue.py

Loading...
View Options

source_code/transformers/src/transformers/data/datasets/language_modeling.py

Loading...
View Options

source_code/transformers/src/transformers/data/datasets/squad.py

Loading...
View Options

source_code/transformers/src/transformers/data/metrics

Loading...
View Options

source_code/transformers/src/transformers/data/metrics/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/data/metrics/squad_metrics.py

Loading...
View Options

source_code/transformers/src/transformers/data/processors

Loading...
View Options

source_code/transformers/src/transformers/data/processors/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/data/processors/glue.py

Loading...
View Options

source_code/transformers/src/transformers/data/processors/squad.py

Loading...
View Options

source_code/transformers/src/transformers/data/processors/utils.py

Loading...
View Options

source_code/transformers/src/transformers/data/processors/xnli.py

Loading...
View Options

source_code/transformers/src/transformers/data/test_generation_utils.py

Loading...
View Options

source_code/transformers/src/transformers/dependency_versions_check.py

Loading...
View Options

source_code/transformers/src/transformers/dependency_versions_table.py

Loading...
View Options

source_code/transformers/src/transformers/feature_extraction_sequence_utils.py

Loading...
View Options

source_code/transformers/src/transformers/feature_extraction_utils.py

Loading...
View Options

source_code/transformers/src/transformers/file_utils.py

Loading...
View Options

source_code/transformers/src/transformers/generation_beam_search.py

Loading...
View Options

source_code/transformers/src/transformers/generation_logits_process.py

Loading...
View Options

source_code/transformers/src/transformers/generation_stopping_criteria.py

Loading...
View Options

source_code/transformers/src/transformers/generation_tf_utils.py

Loading...
View Options

source_code/transformers/src/transformers/generation_utils.py

Loading...
View Options

source_code/transformers/src/transformers/hf_api.py

Loading...
View Options

source_code/transformers/src/transformers/hf_argparser.py

Loading...
View Options

source_code/transformers/src/transformers/integrations.py

Loading...
View Options

source_code/transformers/src/transformers/modelcard.py

Loading...
View Options

source_code/transformers/src/transformers/modeling_flax_utils.py

Loading...
View Options

source_code/transformers/src/transformers/modeling_outputs.py

Loading...
View Options

source_code/transformers/src/transformers/modeling_tf_outputs.py

Loading...
View Options

source_code/transformers/src/transformers/modeling_tf_pytorch_utils.py

Loading...
View Options

source_code/transformers/src/transformers/modeling_tf_utils.py

Loading...
View Options

source_code/transformers/src/transformers/modeling_utils.py

Loading...
View Options

source_code/transformers/src/transformers/models

Loading...
View Options

source_code/transformers/src/transformers/models/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/albert

Loading...
View Options

source_code/transformers/src/transformers/models/albert/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/albert/configuration_albert.py

Loading...
View Options

source_code/transformers/src/transformers/models/albert/convert_albert_original_tf_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/albert/modeling_albert.py

Loading...
View Options

source_code/transformers/src/transformers/models/albert/modeling_tf_albert.py

Loading...
View Options

source_code/transformers/src/transformers/models/albert/tokenization_albert.py

Loading...
View Options

source_code/transformers/src/transformers/models/albert/tokenization_albert_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/auto

Loading...
View Options

source_code/transformers/src/transformers/models/auto/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/auto/configuration_auto.py

Loading...
View Options

source_code/transformers/src/transformers/models/auto/modeling_auto.py

Loading...
View Options

source_code/transformers/src/transformers/models/auto/modeling_flax_auto.py

Loading...
View Options

source_code/transformers/src/transformers/models/auto/modeling_tf_auto.py

Loading...
View Options

source_code/transformers/src/transformers/models/auto/tokenization_auto.py

Loading...
View Options

source_code/transformers/src/transformers/models/bart

Loading...
View Options

source_code/transformers/src/transformers/models/bart/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/bart/configuration_bart.py

Loading...
View Options

source_code/transformers/src/transformers/models/bart/convert_bart_original_pytorch_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/bart/modeling_bart.py

Loading...
View Options

source_code/transformers/src/transformers/models/bart/modeling_tf_bart.py

Loading...
View Options

source_code/transformers/src/transformers/models/bart/tokenization_bart.py

Loading...
View Options

source_code/transformers/src/transformers/models/bart/tokenization_bart_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/barthez

Loading...
View Options

source_code/transformers/src/transformers/models/barthez/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/barthez/tokenization_barthez.py

Loading...
View Options

source_code/transformers/src/transformers/models/barthez/tokenization_barthez_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/bert

Loading...
View Options

source_code/transformers/src/transformers/models/bert/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/bert/configuration_bert.py

Loading...
View Options

source_code/transformers/src/transformers/models/bert/convert_bert_original_tf2_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/bert/convert_bert_original_tf_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/bert/convert_bert_pytorch_checkpoint_to_original_tf.py

Loading...
View Options

source_code/transformers/src/transformers/models/bert/modeling_bert.py

Loading...
View Options

source_code/transformers/src/transformers/models/bert/modeling_flax_bert.py

Loading...
View Options

source_code/transformers/src/transformers/models/bert/modeling_tf_bert.py

Loading...
View Options

source_code/transformers/src/transformers/models/bert/tokenization_bert.py

Loading...
View Options

source_code/transformers/src/transformers/models/bert/tokenization_bert_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/bert_generation

Loading...
View Options

source_code/transformers/src/transformers/models/bert_generation/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/bert_generation/configuration_bert_generation.py

Loading...
View Options

source_code/transformers/src/transformers/models/bert_generation/modeling_bert_generation.py

Loading...
View Options

source_code/transformers/src/transformers/models/bert_generation/tokenization_bert_generation.py

Loading...
View Options

source_code/transformers/src/transformers/models/bert_japanese

Loading...
View Options

source_code/transformers/src/transformers/models/bert_japanese/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/bert_japanese/tokenization_bert_japanese.py

Loading...
View Options

source_code/transformers/src/transformers/models/bertweet

Loading...
View Options

source_code/transformers/src/transformers/models/bertweet/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/bertweet/tokenization_bertweet.py

Loading...
View Options

source_code/transformers/src/transformers/models/blenderbot

Loading...
View Options

source_code/transformers/src/transformers/models/blenderbot/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/blenderbot/configuration_blenderbot.py

Loading...
View Options

source_code/transformers/src/transformers/models/blenderbot/convert_blenderbot_original_pytorch_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/blenderbot/modeling_blenderbot.py

Loading...
View Options

source_code/transformers/src/transformers/models/blenderbot/modeling_tf_blenderbot.py

Loading...
View Options

source_code/transformers/src/transformers/models/blenderbot/tokenization_blenderbot.py

Loading...
View Options

source_code/transformers/src/transformers/models/blenderbot_small

Loading...
View Options

source_code/transformers/src/transformers/models/blenderbot_small/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/blenderbot_small/configuration_blenderbot_small.py

Loading...
View Options

source_code/transformers/src/transformers/models/blenderbot_small/modeling_blenderbot_small.py

Loading...
View Options

source_code/transformers/src/transformers/models/blenderbot_small/modeling_tf_blenderbot_small.py

Loading...
View Options

source_code/transformers/src/transformers/models/blenderbot_small/tokenization_blenderbot_small.py

Loading...
View Options

source_code/transformers/src/transformers/models/blenderbot_small/tokenization_blenderbot_small_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/bort

Loading...
View Options

source_code/transformers/src/transformers/models/bort/convert_bort_original_gluonnlp_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/camembert

Loading...
View Options

source_code/transformers/src/transformers/models/camembert/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/camembert/configuration_camembert.py

Loading...
View Options

source_code/transformers/src/transformers/models/camembert/modeling_camembert.py

Loading...
View Options

source_code/transformers/src/transformers/models/camembert/modeling_tf_camembert.py

Loading...
View Options

source_code/transformers/src/transformers/models/camembert/tokenization_camembert.py

Loading...
View Options

source_code/transformers/src/transformers/models/camembert/tokenization_camembert_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/convbert

Loading...
View Options

source_code/transformers/src/transformers/models/convbert/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/convbert/configuration_convbert.py

Loading...
View Options

source_code/transformers/src/transformers/models/convbert/convert_convbert_original_tf1_checkpoint_to_pytorch_and_tf2.py

Loading...
View Options

source_code/transformers/src/transformers/models/convbert/modeling_convbert.py

Loading...
View Options

source_code/transformers/src/transformers/models/convbert/modeling_tf_convbert.py

Loading...
View Options

source_code/transformers/src/transformers/models/convbert/tokenization_convbert.py

Loading...
View Options

source_code/transformers/src/transformers/models/convbert/tokenization_convbert_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/ctrl

Loading...
View Options

source_code/transformers/src/transformers/models/ctrl/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/ctrl/configuration_ctrl.py

Loading...
View Options

source_code/transformers/src/transformers/models/ctrl/modeling_ctrl.py

Loading...
View Options

source_code/transformers/src/transformers/models/ctrl/modeling_tf_ctrl.py

Loading...
View Options

source_code/transformers/src/transformers/models/ctrl/tokenization_ctrl.py

Loading...
View Options

source_code/transformers/src/transformers/models/deberta

Loading...
View Options

source_code/transformers/src/transformers/models/deberta/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/deberta/configuration_deberta.py

Loading...
View Options

source_code/transformers/src/transformers/models/deberta/modeling_deberta.py

Loading...
View Options

source_code/transformers/src/transformers/models/deberta/tokenization_deberta.py

Loading...
View Options

source_code/transformers/src/transformers/models/deberta_v2

Loading...
View Options

source_code/transformers/src/transformers/models/deberta_v2/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/deberta_v2/configuration_deberta_v2.py

Loading...
View Options

source_code/transformers/src/transformers/models/deberta_v2/modeling_deberta_v2.py

Loading...
View Options

source_code/transformers/src/transformers/models/deberta_v2/tokenization_deberta_v2.py

Loading...
View Options

source_code/transformers/src/transformers/models/dialogpt

Loading...
View Options

source_code/transformers/src/transformers/models/dialogpt/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/dialogpt/convert_dialogpt_original_pytorch_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/distilbert

Loading...
View Options

source_code/transformers/src/transformers/models/distilbert/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/distilbert/configuration_distilbert.py

Loading...
View Options

source_code/transformers/src/transformers/models/distilbert/modeling_distilbert.py

Loading...
View Options

source_code/transformers/src/transformers/models/distilbert/modeling_tf_distilbert.py

Loading...
View Options

source_code/transformers/src/transformers/models/distilbert/tokenization_distilbert.py

Loading...
View Options

source_code/transformers/src/transformers/models/distilbert/tokenization_distilbert_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/dpr

Loading...
View Options

source_code/transformers/src/transformers/models/dpr/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/dpr/configuration_dpr.py

Loading...
View Options

source_code/transformers/src/transformers/models/dpr/convert_dpr_original_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/dpr/modeling_dpr.py

Loading...
View Options

source_code/transformers/src/transformers/models/dpr/modeling_tf_dpr.py

Loading...
View Options

source_code/transformers/src/transformers/models/dpr/tokenization_dpr.py

Loading...
View Options

source_code/transformers/src/transformers/models/dpr/tokenization_dpr_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/electra

Loading...
View Options

source_code/transformers/src/transformers/models/electra/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/electra/configuration_electra.py

Loading...
View Options

source_code/transformers/src/transformers/models/electra/convert_electra_original_tf_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/electra/modeling_electra.py

Loading...
View Options

source_code/transformers/src/transformers/models/electra/modeling_tf_electra.py

Loading...
View Options

source_code/transformers/src/transformers/models/electra/tokenization_electra.py

Loading...
View Options

source_code/transformers/src/transformers/models/electra/tokenization_electra_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/encoder_decoder

Loading...
View Options

source_code/transformers/src/transformers/models/encoder_decoder/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/encoder_decoder/configuration_encoder_decoder.py

Loading...
View Options

source_code/transformers/src/transformers/models/encoder_decoder/modeling_encoder_decoder.py

Loading...
View Options

source_code/transformers/src/transformers/models/flaubert

Loading...
View Options

source_code/transformers/src/transformers/models/flaubert/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/flaubert/configuration_flaubert.py

Loading...
View Options

source_code/transformers/src/transformers/models/flaubert/modeling_flaubert.py

Loading...
View Options

source_code/transformers/src/transformers/models/flaubert/modeling_tf_flaubert.py

Loading...
View Options

source_code/transformers/src/transformers/models/flaubert/tokenization_flaubert.py

Loading...
View Options

source_code/transformers/src/transformers/models/fsmt

Loading...
View Options

source_code/transformers/src/transformers/models/fsmt/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/fsmt/configuration_fsmt.py

Loading...
View Options

source_code/transformers/src/transformers/models/fsmt/convert_fsmt_original_pytorch_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/fsmt/modeling_fsmt.py

Loading...
View Options

source_code/transformers/src/transformers/models/fsmt/tokenization_fsmt.py

Loading...
View Options

source_code/transformers/src/transformers/models/funnel

Loading...
View Options

source_code/transformers/src/transformers/models/funnel/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/funnel/configuration_funnel.py

Loading...
View Options

source_code/transformers/src/transformers/models/funnel/convert_funnel_original_tf_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/funnel/modeling_funnel.py

Loading...
View Options

source_code/transformers/src/transformers/models/funnel/modeling_tf_funnel.py

Loading...
View Options

source_code/transformers/src/transformers/models/funnel/tokenization_funnel.py

Loading...
View Options

source_code/transformers/src/transformers/models/funnel/tokenization_funnel_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/gpt2

Loading...
View Options

source_code/transformers/src/transformers/models/gpt2/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/gpt2/configuration_gpt2.py

Loading...
View Options

source_code/transformers/src/transformers/models/gpt2/convert_gpt2_original_tf_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/gpt2/modeling_gpt2.py

Loading...
View Options

source_code/transformers/src/transformers/models/gpt2/modeling_tf_gpt2.py

Loading...
View Options

source_code/transformers/src/transformers/models/gpt2/tokenization_gpt2.py

Loading...
View Options

source_code/transformers/src/transformers/models/gpt2/tokenization_gpt2_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/herbert

Loading...
View Options

source_code/transformers/src/transformers/models/herbert/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/herbert/tokenization_herbert.py

Loading...
View Options

source_code/transformers/src/transformers/models/herbert/tokenization_herbert_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/ibert

Loading...
View Options

source_code/transformers/src/transformers/models/ibert/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/ibert/configuration_ibert.py

Loading...
View Options

source_code/transformers/src/transformers/models/ibert/modeling_ibert.py

Loading...
View Options

source_code/transformers/src/transformers/models/ibert/quant_modules.py

Loading...
View Options

source_code/transformers/src/transformers/models/layoutlm

Loading...
View Options

source_code/transformers/src/transformers/models/layoutlm/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/layoutlm/configuration_layoutlm.py

Loading...
View Options

source_code/transformers/src/transformers/models/layoutlm/modeling_layoutlm.py

Loading...
View Options

source_code/transformers/src/transformers/models/layoutlm/tokenization_layoutlm.py

Loading...
View Options

source_code/transformers/src/transformers/models/layoutlm/tokenization_layoutlm_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/led

Loading...
View Options

source_code/transformers/src/transformers/models/led/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/led/configuration_led.py

Loading...
View Options

source_code/transformers/src/transformers/models/led/modeling_led.py

Loading...
View Options

source_code/transformers/src/transformers/models/led/modeling_tf_led.py

Loading...
View Options

source_code/transformers/src/transformers/models/led/tokenization_led.py

Loading...
View Options

source_code/transformers/src/transformers/models/led/tokenization_led_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/longformer

Loading...
View Options

source_code/transformers/src/transformers/models/longformer/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/longformer/configuration_longformer.py

Loading...
View Options

source_code/transformers/src/transformers/models/longformer/convert_longformer_original_pytorch_lightning_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/longformer/modeling_longformer.py

Loading...
View Options

source_code/transformers/src/transformers/models/longformer/modeling_tf_longformer.py

Loading...
View Options

source_code/transformers/src/transformers/models/longformer/tokenization_longformer.py

Loading...
View Options

source_code/transformers/src/transformers/models/longformer/tokenization_longformer_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/lxmert

Loading...
View Options

source_code/transformers/src/transformers/models/lxmert/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/lxmert/configuration_lxmert.py

Loading...
View Options

source_code/transformers/src/transformers/models/lxmert/convert_lxmert_original_tf_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/lxmert/modeling_lxmert.py

Loading...
View Options

source_code/transformers/src/transformers/models/lxmert/modeling_tf_lxmert.py

Loading...
View Options

source_code/transformers/src/transformers/models/lxmert/tokenization_lxmert.py

Loading...
View Options

source_code/transformers/src/transformers/models/lxmert/tokenization_lxmert_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/m2m_100

Loading...
View Options

source_code/transformers/src/transformers/models/m2m_100/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/m2m_100/configuration_m2m_100.py

Loading...
View Options

source_code/transformers/src/transformers/models/m2m_100/convert_m2m100_original_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/m2m_100/modeling_m2m_100.py

Loading...
View Options

source_code/transformers/src/transformers/models/m2m_100/tokenization_m2m_100.py

Loading...
View Options

source_code/transformers/src/transformers/models/marian

Loading...
View Options

source_code/transformers/src/transformers/models/marian/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/marian/configuration_marian.py

Loading...
View Options

source_code/transformers/src/transformers/models/marian/convert_marian_tatoeba_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/marian/convert_marian_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/marian/modeling_marian.py

Loading...
View Options

source_code/transformers/src/transformers/models/marian/modeling_tf_marian.py

Loading...
View Options

source_code/transformers/src/transformers/models/marian/tokenization_marian.py

Loading...
View Options

source_code/transformers/src/transformers/models/mbart

Loading...
View Options

source_code/transformers/src/transformers/models/mbart/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/mbart/configuration_mbart.py

Loading...
View Options

source_code/transformers/src/transformers/models/mbart/convert_mbart_original_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/mbart/modeling_mbart.py

Loading...
View Options

source_code/transformers/src/transformers/models/mbart/modeling_tf_mbart.py

Loading...
View Options

source_code/transformers/src/transformers/models/mbart/tokenization_mbart.py

Loading...
View Options

source_code/transformers/src/transformers/models/mbart/tokenization_mbart50.py

Loading...
View Options

source_code/transformers/src/transformers/models/mbart/tokenization_mbart50_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/mbart/tokenization_mbart_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/mmbt

Loading...
View Options

source_code/transformers/src/transformers/models/mmbt/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/mmbt/configuration_mmbt.py

Loading...
View Options

source_code/transformers/src/transformers/models/mmbt/modeling_mmbt.py

Loading...
View Options

source_code/transformers/src/transformers/models/mobilebert

Loading...
View Options

source_code/transformers/src/transformers/models/mobilebert/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/mobilebert/configuration_mobilebert.py

Loading...
View Options

source_code/transformers/src/transformers/models/mobilebert/convert_mobilebert_original_tf_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/mobilebert/modeling_mobilebert.py

Loading...
View Options

source_code/transformers/src/transformers/models/mobilebert/modeling_tf_mobilebert.py

Loading...
View Options

source_code/transformers/src/transformers/models/mobilebert/tokenization_mobilebert.py

Loading...
View Options

source_code/transformers/src/transformers/models/mobilebert/tokenization_mobilebert_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/mpnet

Loading...
View Options

source_code/transformers/src/transformers/models/mpnet/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/mpnet/configuration_mpnet.py

Loading...
View Options

source_code/transformers/src/transformers/models/mpnet/modeling_mpnet.py

Loading...
View Options

source_code/transformers/src/transformers/models/mpnet/modeling_tf_mpnet.py

Loading...
View Options

source_code/transformers/src/transformers/models/mpnet/tokenization_mpnet.py

Loading...
View Options

source_code/transformers/src/transformers/models/mpnet/tokenization_mpnet_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/mt5

Loading...
View Options

source_code/transformers/src/transformers/models/mt5/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/mt5/configuration_mt5.py

Loading...
View Options

source_code/transformers/src/transformers/models/mt5/modeling_mt5.py

Loading...
View Options

source_code/transformers/src/transformers/models/mt5/modeling_tf_mt5.py

Loading...
View Options

source_code/transformers/src/transformers/models/openai

Loading...
View Options

source_code/transformers/src/transformers/models/openai/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/openai/configuration_openai.py

Loading...
View Options

source_code/transformers/src/transformers/models/openai/convert_openai_original_tf_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/openai/modeling_openai.py

Loading...
View Options

source_code/transformers/src/transformers/models/openai/modeling_tf_openai.py

Loading...
View Options

source_code/transformers/src/transformers/models/openai/tokenization_openai.py

Loading...
View Options

source_code/transformers/src/transformers/models/openai/tokenization_openai_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/pegasus

Loading...
View Options

source_code/transformers/src/transformers/models/pegasus/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/pegasus/configuration_pegasus.py

Loading...
View Options

source_code/transformers/src/transformers/models/pegasus/convert_pegasus_tf_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/pegasus/modeling_pegasus.py

Loading...
View Options

source_code/transformers/src/transformers/models/pegasus/modeling_tf_pegasus.py

Loading...
View Options

source_code/transformers/src/transformers/models/pegasus/tokenization_pegasus.py

Loading...
View Options

source_code/transformers/src/transformers/models/pegasus/tokenization_pegasus_fast.py

Loading...
View Options

source_code/transformers/src/transformers/models/phobert

Loading...
View Options

source_code/transformers/src/transformers/models/phobert/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/phobert/tokenization_phobert.py

Loading...
View Options

source_code/transformers/src/transformers/models/prophetnet

Loading...
View Options

source_code/transformers/src/transformers/models/prophetnet/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/prophetnet/configuration_prophetnet.py

Loading...
View Options

source_code/transformers/src/transformers/models/prophetnet/convert_prophetnet_original_pytorch_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/prophetnet/modeling_prophetnet.py

Loading...
View Options

source_code/transformers/src/transformers/models/prophetnet/tokenization_prophetnet.py

Loading...
View Options

source_code/transformers/src/transformers/models/rag

Loading...
View Options

source_code/transformers/src/transformers/models/rag/__init__.py

Loading...
View Options

source_code/transformers/src/transformers/models/rag/configuration_rag.py

Loading...
View Options

source_code/transformers/src/transformers/models/rag/modeling_rag.py

Loading...
View Options

source_code/transformers/src/transformers/models/rag/modeling_tf_rag.py

Loading...
View Options

source_code/transformers/src/transformers/models/rag/retrieval_rag.py

Loading...
View Options

source_code/transformers/src/transformers/models/rag/tokenization_rag.py

Loading...
View Options

source_code/transformers/src/transformers/models/reformer

Loading...
View Options

source_code/transformers/src/transformers/models/reformer/configuration_reformer.py

Loading...
View Options

source_code/transformers/src/transformers/models/reformer/convert_reformer_trax_checkpoint_to_pytorch.py

Loading...
View Options

source_code/transformers/src/transformers/models/reformer/modeling_reformer.py

Loading...
View Options

source_code/transformers/src/transformers/models/reformer/tokenization_reformer.py

Loading...
View Options

source_code/transformers/src/transformers/optimization.py

Loading...
View Options

source_code/transformers/src/transformers/optimization_tf.py

Loading...
View Options

source_code/transformers/src/transformers/testing_utils.py

Loading...
View Options

source_code/transformers/src/transformers/tokenization_utils.py

Loading...
View Options

source_code/transformers/src/transformers/tokenization_utils_base.py

Loading...
View Options

source_code/transformers/src/transformers/tokenization_utils_fast.py

Loading...
View Options

source_code/transformers/src/transformers/trainer.py

Loading...
View Options

source_code/transformers/src/transformers/trainer_callback.py

Loading...
View Options

source_code/transformers/src/transformers/trainer_pt_utils.py

Loading...
View Options

source_code/transformers/src/transformers/trainer_seq2seq.py

Loading...
View Options

source_code/transformers/src/transformers/trainer_tf.py

Loading...
View Options

source_code/transformers/src/transformers/trainer_utils.py

Loading...
View Options

source_code/transformers/src/transformers/training_args.py

Loading...
View Options

source_code/transformers/src/transformers/training_args_seq2seq.py

Loading...
View Options

source_code/transformers/src/transformers/training_args_tf.py

Loading...
View Options

source_code/transformers/valohai.yaml

Loading...
c4science · Help