-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathrequirements-paper.txt
More file actions
26 lines (24 loc) · 947 Bytes
/
Copy pathrequirements-paper.txt
File metadata and controls
26 lines (24 loc) · 947 Bytes
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
# Provenance only -- do NOT `pip install -r` this to use the tool. Install the
# package instead: `pip install -e ".[qe,serve,eval]"` (floors-only, tracks
# current releases). This file records the exact environment behind the paper's
# reported numbers.
#
# Hardware: 2x NVIDIA A100 SXM 80 GB, Python 3.11, CUDA 12.x. TPOT is specific
# to this setup; newer vLLM or different GPUs (e.g. H100 with W8A8 FP8) shift
# TPOT and may change the selected lambda*.
#
# Install vllm first (it pulls torch 2.10.0+cu128), then upgrade transformers:
# vLLM 0.19.0 defaults to transformers 4.57.6, which lacks the `gemma4` arch;
# 5.5.3 is needed for the Gemma models and runs fine despite vLLM's `<5` pin.
vllm==0.19.0
torch==2.10.0
transformers==5.5.3
tokenizers==0.22.2
# Clustering and QE pipeline
sentence-transformers
scikit-learn
datasets
kneed
matplotlib
# QE (ModernBERT) training only; the wheel must match your installed torch.
flash-attn==2.8.3