pyterrier/scifact.pisa

--- # pretty_name: "" # Example: "MS MARCO Terrier Index" tags: - pyterrier - pyterrier-artifact - pyterrier-artifact.sparse_index - pyterrier-artifact.sparse_index.pisa task_categories: - text-retrieval viewer: false --- # scifact.pisa ## Description A PISA index for the SciFact dataset ## Usage ```python # Load the artifact import pyterrier as pt index = pt.Artifact.from_hf('pyterrier/scifact.pisa') index.bm25() # returns a BM25 retriever ``` ## Benchmarks | name | nDCG@10 | R@1000 | |:-------|----------:|---------:| | bm25 | 0.6776 | 0.9733 | | dph | 0.6735 | 0.97 | ## Reproduction ```python import pyterrier as pt from tqdm import tqdm import ir_datasets from pyterrier_pisa import PisaIndex index = PisaIndex("scifact.pisa", threads=16) dataset = ir_datasets.load('beir/scifact') docs = ({'docno': d.doc_id, 'text': d.default_text()} for d in tqdm(dataset.docs)) index.index(docs) ``` ## Metadata ``` { "type": "sparse_index", "format": "pisa", "package_hint": "pyterrier-pisa", "stemmer": "porter2" } ```