Skip to main content

HuggingFaceAdapter

Adapter for HuggingFace models.

Supported Models​

Any HuggingFace model, e.g.:

  • microsoft/DialoGPT-medium
  • gpt2
  • facebook/bart-large

Usage​

from benchwise import evaluate

@evaluate("microsoft/DialoGPT-medium")
async def test_hf(model, dataset):
    responses = await model.generate(dataset.prompts)
    return {"responses": responses}

See Also​