WVU MULTI-VIEW ACTION RECOGNITION DATASET

The dataset was collected as part of the research work on real-time human action recognition in a camera network. The dataset was used for designing and evaluating a score-based fusion strategy for combining information from multiple views and performing activity recognition in real-time.  The paper can be downloaded here. To download the data-set click here.

The following is a description of how the data was acquired.

Description:

The multi-camera network system consists of 8 cameras that provide completely overlapping coverage of a rectangular region R (about 50 x 50 feet) from different viewing directions. Also the relative orientations of the cameras are known. The system is show in the following figure.

The subject can be at any location within this region such that each camera is able to capture the complete image of the subject. We define view-angle of a camera with respect to an action being performed as the angle made by the optical axis of the camera with the direction along which the subject performs the action sequence. View-angle is measured in the clockwise direction from the ray originating at the subject location that is parallel to the optical axis of the camera as shown in the following figure.

We divide the view-angle range of 0-360 into 8 different sets by considering that different instances of the same action captured with small view-angle separations are likely to appear similar. The 8 view-angle sets are denoted as Vj, (1 <= j <= 8$) and are illustrated in the following figure for camera C. For example, when the subject is facing the region between rays ZA and ZB, the camera C provides view V2.

The subject performs a set of 12 actions at approximately the same pace. The data was collected at a rate of 20 fps with 640 x 480 resolution. The following is the list of actions.

Action/Event #

Action Description

Event 1

Standing Still

Event 2

Nodding head

Event 3

Clapping

Event 4

Waving 1 hand

Event 5

Waving 2 hands

Event 6

Punching

Event 7

Jogging

Event 8

Jumping Jack

Event 9

Kicking

Event 10

Picking

Event 11

Throwing

Event 12

Bowling

Download:

Each event has 47 training video samples (provided as part 1 and part 2) and each sample consists of approximately a 3 second video (with 71 frames in each video) from 8 different views labeled V1 to V8 as per the definitions provided above. For instance, V1 represents facing the camera and V5 represents facing away from the camera. In the training videos, the subject is always at the center of the room. Each event also has 18 test video samples and each sample consists of 71 frames of video from 8 different videos. In these samples, different test subjects are at different locations in the room.

The data-set can be downloaded from the following links. 

 

1.    Event 1 (Standing Still): This action consists of a subject standing still in a controlled environment.
You can download this action set by clicking here for
Part1.
Part2.
Test Data.

                        Sample Image

 

2.    Event 2 (nodding head): This action consists of a subject nodding his/her head.
You can download this action set by clicking here for
Part1.
Part2.
Test Data.

                        Sample Image

 

3.    Event 3 ( clapping ): This action consists of a subject clapping.
You can download this action set by clicking here for
Part1.
Part2.
Test Data.

                        Sample Image

 

4.    Event 4 ( waving 1 hand ): This action consists of a subject waving his/her hand.
You can download this action set by clicking here for
Part1.
Part2.
Test Data.

                        Sample Image

 

5.    Event 5 ( waving 2 hands ): This action consists of a subject waving both of his/her hands.
You can download this action set by clicking here for
Part1.
Part2.
Test Data.

                        Sample Image

 

6.    Event 6 ( punch ): This action consists of a subject punching with one/both hands.
You can download this action set by clicking here for
Part1.
Part2.
Test Data.

                        Sample Image

 

7.    Event 7 ( jogging ): This action consists of a subject jogging.
You can download this action set by clicking here for
Part1.
Part2.
Test Data.

                        Sample Image

 

8.    Event 8 ( jumping jack ): This action consists of a subject performing jumping jack.
You can download this action set by clicking here for
Part1.
Part2.
Test Data.

                        Sample Image

 

9.    Event 9 ( kicking ): This action consists of a subject kicking with his/her leg.
You can download this action set by clicking here for
Part1.
Part2.
Test Data.

                        Sample Image

 

10.  Event 10 ( pick up ): This action consists of a subject picking up something from the ground.
You can download this action set by clicking here for
Part1.
Part2.
Test Data.

                        Sample Image

 

11. Event 11 ( throwing ): This action consists of a subject performing a throwing action.
You can download this action set by clicking here for
Part1.
Part2.
Test Data.

                        Sample Image

 

12. Event 12 ( bowling ): This action consists of a subject performing bowling action.
You can download this action set by clicking here for
Part1.
Part2.
Test Data.

                        Sample Image

 

Background Videos for each of the 8 views can be found here.

 

 

If you have any questions, comments regarding the data-set please contact: Dr. Vinod Kulathumani