Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

multi-GPU support for mine_hard_negatives #2967

Open
wants to merge 8 commits into
base: v3.1-release
Choose a base branch
from

Commits on Sep 26, 2024

  1. [fix] Only save first module in root if "save_in_root" is specified. (

    UKPLab#2957)
    
    Required to avoid issues with loading expecting local files, but the root is kept on the Hub to avoid downloading the entire repository (with multiple model files, etc.)
    tomaarsen authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    80393d0 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2024

  1. multi-GPU support for mine_hard_negatives

    Added support for multi-GPU encoding in sentence embeddings with model.encode_multi_process
    alperctnkaya authored Sep 29, 2024
    Configuration menu
    Copy the full SHA
    44ed026 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. Configuration menu
    Copy the full SHA
    ee79a72 View commit details
    Browse the repository at this point in the history
  2. [feat] Add query prompts to Information Retrieval Evaluator (UKPLab…

    …#2951)
    
    * Added the possibility of masking the prompts if the tokenizer is left-padded.
    
    * Simplify code
    
    * Remove unrelated changes
    
    * Move prompt_mask into the Transformer model
    
    * Added query and corpus prompts to Information Retrieval Evaluator
    
    * Fix for failing test
    
    * Fix for pooling when mask is not passed
    
    * Fix device placement for prompt_mask
    
    * Revert left-padding changes
    
    * Revert left-padding changes
    ArthurCamara authored Sep 30, 2024
    Configuration menu
    Copy the full SHA
    4f43de6 View commit details
    Browse the repository at this point in the history
  3. [model cards] Keep evaluation order in training logs if there's mul…

    …tiple evaluators (UKPLab#2963)
    
    Also rename "loss" to Validation Loss
    tomaarsen authored Sep 30, 2024
    Configuration menu
    Copy the full SHA
    a7cc68f View commit details
    Browse the repository at this point in the history
  4. Add negatives in CachedGISTEmbedLoss (UKPLab#2946)

    * Add negatives in CachedGISTEmbedLoss
    
    * Add multi-negative n-tuples as valid inputs in 3 losses
    
    ---------
    
    Co-authored-by: Tom Aarsen <[email protected]>
    daegonYu and tomaarsen authored Sep 30, 2024
    Configuration menu
    Copy the full SHA
    b6f1142 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. Merge pull request #1 from UKPLab/master

    Master
    alperctnkaya authored Oct 2, 2024
    Configuration menu
    Copy the full SHA
    0aa6b79 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    25f1c08 View commit details
    Browse the repository at this point in the history