Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[VitTrack Evaluation] OTB100 Dataset Implementation #245

Open
wants to merge 18 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 17 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
31 changes: 30 additions & 1 deletion tools/eval/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,7 @@ Supported datasets:
- [ICDAR](#icdar2003)
- [IIIT5K](#iiit5k)
- [Mini Supervisely](#mini-supervisely)
- [OTB-100](#otb-100)

## ImageNet

Expand Down Expand Up @@ -211,4 +212,32 @@ Run evaluation on quantized model with the following command :

```shell
python eval.py -m pphumanseg_q -d mini_supervisely -dr /path/to/pphumanseg
```
```

## OTB-100

### Prepare data

1. The official site is http://cvlab.hanyang.ac.kr/.
2. In case it is down, users can download from the alternative [Google Drive Link](https://drive.google.com/drive/folders/1iTwCQAMgzdWWrlwncOjpshuHvipIWPMN?usp=sharing).

Download `OTB100.zip` and unzip it in a directory, the tree structure should appear as follows:

```shell
$ tree -L 2 /path/to/otb100
.
├── Basketball
│   ├── groundtruth_rect.txt
│   └── img
├── ...
└── Woman

```

### Evaluation

Run evaluation with the following command:

```shell
python eval.py -m vittrack -d otb2015 -dr /path/to/otb2015
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
python eval.py -m vittrack -d otb2015 -dr /path/to/otb2015
python eval.py -m vittrack -d otb100 -dr /path/to/otb100

```
2 changes: 2 additions & 0 deletions tools/eval/datasets/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@
from .icdar import ICDAR
from .iiit5k import IIIT5K
from .minisupervisely import MiniSupervisely
from .otb100 import OTB100

class Registery:
def __init__(self, name):
Expand All @@ -23,3 +24,4 @@ def register(self, item):
DATASETS.register(ICDAR)
DATASETS.register(IIIT5K)
DATASETS.register(MiniSupervisely)
DATASETS.register(OTB100)
Loading