# Run BGE Reranker v2

Reorders search results so the genuinely best answer comes first. Ready in about 90 seconds on an RTX 3090, from $0.22/hr. No install, no code.

## What it does

A reranker takes the top results from a search and reads each one properly against the question, then reorders them.

Reranking is slow, so you do not run it on the whole archive. You search first, take the top fifty, and rerank those.

The improvement is large. In most systems this single step does more for answer quality than any change to the search itself.

## Your setup

We run BGE Reranker v2 on an RTX 3090 with 24GB of memory, at $0.22 per hour, billed by the minute. It takes about 2 minutes per thousand queries.

At 568 million parameters this needs about 6GB. Reranking is normally run live, inside a search request, where what matters is the delay on a single small batch rather than raw throughput. A cheap card handles that well, and the money saved is better spent on running it against more candidates.

## What it costs

50 thousand queries reranked takes about 1 hour 44 minutes of GPU time, which is about $0.38.

## Two ways to run it

- **Open the app.** Paste a question and a list of candidates, see the reordering and the scores.
- **Run a batch job.** Rerank a stored set of search results in bulk to measure the improvement.

## Model facts

| Field | Value |
|---|---|
| Parameters | 568M |
| License | Apache 2.0 |
| Memory required | 6GB minimum |
| Base model | XLM-RoBERTa large |
| Publisher | Beijing Academy of Artificial Intelligence |
| Recommended hardware | RTX 3090, 24GB |
| Category | [Data processing](https://gpuvault.io/working-on/data-processing/) |

## Questions people ask

### Do I need to install anything to use BGE Reranker v2?

No. We start a machine with BGE Reranker v2 already loaded and hand you a link. Everything runs in your browser, there is nothing to download, and nothing is left on your computer afterwards. It works the same on a Mac, a Windows laptop, or a Chromebook. A workspace is usually ready in about 90 seconds.

### How much does it cost to run 50 thousand queries reranked?

About $0.38. BGE Reranker v2 takes about 2 minutes per thousand queries on the RTX 3090 we recommend, so 50 thousand queries reranked is roughly 1 hour 44 minutes of GPU time at $0.22 per hour. Billing is by the minute, and a batch job shuts the GPU off the moment the last item finishes. The calculator above works this out for your own numbers.

### Can I run BGE Reranker v2 on a cheaper card?

Sometimes, and the calculator will not always make it look worth it. At 568 million parameters this needs about 6GB. Reranking is normally run live, inside a search request, where what matters is the delay on a single small batch rather than raw throughput. A cheap card handles that well, and the money saved is better spent on running it against more candidates. If you want to try a different card anyway, the advanced catalog lets you pick one and shows the estimated time before you commit.

### Can I use BGE Reranker v2 commercially?

Yes. BGE Reranker v2 is released under the Apache 2.0 license, which permits commercial use with no conditions worth worrying about. You can use the output in paid client work and in products you sell.

### What happens to my files after I stop?

Anything you save into your workspace folder stays in your account and is there when you come back. Everything else is destroyed: the machine is terminated and its disk is wiped. Batch job inputs and outputs are deleted from our storage 24 hours after you download them. We do not read your files or use them to train anything.

### What if it fails partway through?

You are not charged for work that did not complete, and failed sessions are refunded automatically. Batch jobs write each output as it finishes rather than at the end, so a failure at item 380 of 400 leaves you 379 usable files and a message saying what broke. Restarting picks up where it stopped rather than redoing the work.

---

*Source: https://gpuvault.io/model/bge-reranker-v2-m3/ — GPUVault, GPU rental by the minute.*
