FEAT: add support for local model checkpoints and trust_remote_code in HuggingFaceChatTarget

[KutalVolkan]

Overview

This pull request adds support for loading local model checkpoints in the HuggingFaceChatTarget class through the new model_path parameter. It also introduces the trust_remote_code parameter to handle models that require executing custom code during loading.

These enhancements improve the flexibility and usability of the HuggingFaceChatTarget class by enabling users to:

• Load models from local directories using the model_path parameter, supporting local model checkpoints.
• Work with models that include custom code by setting trust_remote_code=True, necessary for models like microsoft/Phi-3-mini-4k-instruct.

Work Completed

• Updated HuggingFaceChatTarget Class:
  • Added model_path Parameter:
    • Modified the __init__ method to include the optional model_path parameter.
    • Adjusted the load_model_and_tokenizer method to load models from a local directory when model_path is provided.
  • Included trust_remote_code Parameter:
    • Added the trust_remote_code parameter with a default value of False to the __init__ method.
    • Passed trust_remote_code to the from_pretrained methods when loading the tokenizer and model.
  • Ensured Backward Compatibility:
    • Preserved existing functionality for loading models using model_id.
    • Maintained default behavior by setting trust_remote_code=False, so models that do not require it are unaffected.

Related Issue

Issue #572

[KutalVolkan]

Hello @romanlutz,

The current demo was just a POC and includes unnecessary elements.
I couldn’t find my old test for HuggingFaceChatTarget to extend the tests—should I write a new one?

Please share your feedback on further enhancements and any other suggestions if needed :)

[romanlutz]

Looks amazing @KutalVolkan ! That was incredibly fast 😅

Tests moved to the targets directory I think. https://github.com/Azure/PyRIT/blob/main/tests/target/test_huggingface_chat_target.py

[KutalVolkan]

Looks amazing @KutalVolkan ! That was incredibly fast 😅

Tests moved to the targets directory I think. https://github.com/Azure/PyRIT/blob/main/tests/target/test_huggingface_chat_target.py

Thank you, Roman! 😊 It might seem fast, but sometimes it’s just the time zone magic at work. I’m glad we’re keeping things efficient, though! Let me know if there’s anything else I should add.