-
Notifications
You must be signed in to change notification settings - Fork 20
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
- Status: Open.#103 In GEM-benchmark/GEM-metrics;
- Status: Open.#102 In GEM-benchmark/GEM-metrics;
- Status: Open.#96 In GEM-benchmark/GEM-metrics;
- Status: Open.#88 In GEM-benchmark/GEM-metrics;
- Status: Open.#87 In GEM-benchmark/GEM-metrics;
- Status: Open.#85 In GEM-benchmark/GEM-metrics;
Add support for docker and add all the metrics from repro
enhancementNew feature or requestNew feature or requestStatus: Open.#74 In GEM-benchmark/GEM-metrics;MAUVE metric for open-ended text generation
new-metric-heavyAdding a new resource intensive metricAdding a new resource intensive metricStatus: Open.#72 In GEM-benchmark/GEM-metrics;MATTR metric
new-metric-lightAdding a lightweight metricAdding a lightweight metricStatus: Open.#71 In GEM-benchmark/GEM-metrics;L'Ambre metric
new-metricAdding a new metric with unknown resource requirements (could be light or heavy)Adding a new metric with unknown resource requirements (could be light or heavy)Status: Open.#66 In GEM-benchmark/GEM-metrics;Add a unique versioning key to each metric
enhancementNew feature or requestNew feature or requestStatus: Open.#59 In GEM-benchmark/GEM-metrics;Change caching to hash of input/output/source instead of filepath based key
enhancementNew feature or requestNew feature or requestStatus: Open.#58 In GEM-benchmark/GEM-metrics;