nip.utils.types.HuggingFaceDpoDatasetItem

class nip.utils.types.HuggingFaceDpoDatasetItem

A single item in a DPO dataset using the Hugging Face format.

This is similar to DpoDatasetItem, but uses the Hugging Face format for the input chat history.

Attributes

prompt	The input chat history for the DPO dataset item.
chosen	The preferred part of the preference pair.
rejected	The non-preferred part of the preference pair.

Methods