feat: compatibility with transformers 5

[sdiazlor]

Description

This PR includes updates to make pruna compatible with Transformers 5:

• unpin transformers version (not sure if you had a minimum previously) and pin in extras

• update hf command

• add the is_available_algorithm to make the unavailable under certain circumstances (e.g. transformers 5)

• small updates

• Other PRs: fix: update moe tiny model for testing (transformers 5) #684 and fix: patch torchmetrics (transformers 5) #683

• Pinning to 5.10.2 fixes the errors regarding pipelines on the HF side (pipelines do not have modelcard huggingface/transformers#44621). But I don't know the preferred approach.

FAILED tests/algorithms/test_algorithms.py::test_full_integration[TestIFW_whisper_tiny_random-cuda] - AttributeError: 'AutomaticSpeechRecognitionPipeline' object has no attribute 'modelcard'

Related Issue

Fixes #(issue number)

Type of Change

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Refactor (no functional change)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• Documentation update

Testing

• I added or updated tests covering my changes
• Existing tests pass locally (uv run pytest -m "cpu and not slow")

For full setup and testing instructions, see the Contributing Guide.

Checklist

• My code follows the style guidelines of this project
• I have performed a self-review of my code, especially for agent-assisted changes
• I updated the documentation where necessary

---

Thanks for contributing to Pruna! We're excited to review your work.

New to contributing? Check out our Contributing Guide for everything you need to get started.

Note:

• Draft PRs or PRs without a clear and detailed overview may be delayed.
• Please mark your PR as Ready for Review and ensure the sections above are filled out.
• Contributions that are entirely AI-generated without meaningful human review are discouraged.

[cursor]

Cursor Bugbot has reviewed your changes and found 1 potential issue.

^{❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.}

Comment @cursor review or bugbot run to trigger another review on this PR

^{Reviewed by Cursor Bugbot for commit 72de2fe. Configure here.}

[cursor]

Legacy causal pipeline check broken

High Severity

For transformers versions below 5, TextGenerationPipeline is imported from text2text_generation and aliased over the real causal TextGenerationPipeline. is_transformers_pipeline_with_causal_lm and is_transformers_pipeline_with_moe_lm then never match standard text-generation pipelines, so legacy installs misclassify those models.

Additional Locations (2)

• src/pruna/engine/model_checks.py#L175-L190
• src/pruna/engine/model_checks.py#L228-L243

 

^{Reviewed by Cursor Bugbot for commit 72de2fe. Configure here.}

[gsprochette]

This looks important indeed

[begumcig]

Thanks a lot for tackling this Sara! I really like theis_availablecheck, i think we should introduce some optional dependencies and conflicts to make installing pruna easier, but looks super good already!!!!

[gsprochette]

Already super clean and efficient code, great job this will get merged in no time 🫶 I think the unavailability error could be slightly more explicit, but the only big thing is we need to discuss the idea of having a old_transformers or legacy_transformers extra and what that would bring. At the moment I'm not super sure what is the justification for this is and where it is used 🙃

[gsprochette]

This looks important indeed

[begumcig]

Looks amazing thank you so much Sara!!! I added one comment about the uv indexing strategy but looks super good!!! Let's get this to merging

[gsprochette]

Looks great ! One minor thing about a file that's only formatted, and the very important index thing :)

[gsprochette]

Let's remove full and let's gooooooooo

[gsprochette]

full doesn't exist let's remove it