Skip to content

Commit

Permalink
Filter bin files to include only model weights
Browse files Browse the repository at this point in the history
  • Loading branch information
Andrei-Aksionov committed Dec 8, 2024
1 parent 5491153 commit a8f06da
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion litgpt/scripts/download.py
Original file line number Diff line number Diff line change
Expand Up @@ -131,7 +131,7 @@ def find_weight_files(repo_id: str, access_token: Optional[str]) -> Tuple[List[s
with gated_repo_catcher(repo_id, access_token):
info = repo_info(repo_id, token=access_token)
filenames = [f.rfilename for f in info.siblings]
bins = list(filter_repo_objects(items=filenames, allow_patterns=["*.bin*"]))
bins = list(filter_repo_objects(items=filenames, allow_patterns=["*model*.bin*"]))
safetensors = list(filter_repo_objects(items=filenames, allow_patterns=["*.safetensors*"]))
return bins, safetensors

Expand Down

0 comments on commit a8f06da

Please sign in to comment.