zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-06-26 02:33:23 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge pull request #33 from tensojka/patch-1

Browse Source 
Fix link in docstring in wikitext function
This commit is contained in:
Awni Hannun 2023-12-07 08:07:11 -08:00 committed by GitHub
commit 12ef61915a
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 3 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
transformer_lm/datasets.py
View File

@ -40,7 +40,9 @@ def _load(save_dir, filenames):
def wikitext(dataset="2", save_dir="/tmp"):
"""
Load the WikiText-* language modeling dataset:
https://paperswithcode.com/dataset/penn-treebank
https://paperswithcode.com/dataset/wikitext-2
https://paperswithcode.com/dataset/wikitext-103
"""
if dataset not in ("2", "103"):
raise ValueError(f'Dataset must be either "2" or "103", got {dataset}')