INTERNATIONAL ORGANISATION FOR STANDARDISATION

ORGANISATION INTERNATIONALE DE NORMALISATION

ISO/IEC JTC1/SC29/WG11

CODING OF MOVING PICTURES AND AUDIO

 

ISO/IEC JTC1/SC29/WG11/N2467

MPEG 98

October 1998/Atlantic City, USA

 

Title: Description of MPEG-7 Content Set

Source: Requirements group

Status: Approved

 

 

 

 

The MPEG-7 content set is composed of three main categories: Audio (about 12 hours), Still images (about 7000 images) and Video (about 13 hours). The items in each category are described in the following sections. For further information on how to obtain this content set, please contact: Seungyup Paek (syp@ctr.columbia.edu) until November 1, 1998. Aftewards, please check http://www.cselt.it/mpeg/ for an update.

 

This material is subject to the conditions in the licensing agreement, MPEG document N2466.

 

1 MPEG-7 Audio Content Set

For supplemental content, please refer to the Video Content Set, especially the music and entertainment category. It contains much Audio-visual material. Also of potential interest are items with monologues and dialogues in diverse languages.

 

Category

Item num.

Short description

Source

Duration (min)

Radio

A1

Radio news broadcast

Radio-France 98

600

Music

A2

"Two Ton Shoe" Rock album

Two Ton Shoe

39

 

A3

Bruckner's Te Deum, and Mozart's Requiem

A. Lindsay

72

 

A4

Original composition, a capella. Voice only

S. Lounis

5

Audio

A5

Short sequences of solo instrument and other sounds

SQAM CD

30

 

A6

Pop song based on an A-A-C motif

Juergen Herre

5

 

2 MPEG-7 Still images Content Set

 

Category

Item

num.

Short description

Source

~number of images

Color photo.

S1

Amateur Photos of landscapes, people.

Tristan Savatier

300

 

S2

Photographs

Alejandro Jaimes

300

 

S3

Images of varying scene and color content, many outdoor and indoor images

Department of Water Resources, California

2000

 

S4

Indoor images of people, under varying lighting conditions and angles

Heinrich Hertz Institute

400

Grey-scale photo

S5

Photographs

JPEG 2000

250

 

S6

Collection of print and digitized pictures

National Archives at Maryland

250

 

S7

Photos from the beginning of the century

Portuguese Photo. Center

260

Trademark logo

S8

Trademark images captured by a scanner (B&W images)

Korean Industrial Property Office

3000

Aerial photo.

S9

Aerial photos, monochrome and colored (5000x5000 pixels)

UC Santa Barbara

30

3D Range image

S10

205 range images and 7 complete 3-D colour models

National Research Council

200

 

  1. MPEG-7 Video Content Set

 

All items have been assigned to one of the three possible types: "Program", "Sequence" or "Shot". A "Program" is a piece of material of rather long duration which most of the time includes both the beginning and the end of the program. A "sequence" is a clip of a few minutes that has been extracted from a program. Finally, the "shot" type corresponds to either "program" or "sequences" where the list of editing effects (shot cut, fade, etc.) will be available. Finally, note that all video material is encoded in MPEG-1 format, except item V30.

 

Category

Type

Item

num.

Short description

Source

Duration (min)

News

Shot

V1

Two complete TV news programs

Portuguese TV, RTP & SIC

60

 

Sequence

V2

Universal newsreel collection. B&W video.

National Archives at Maryland

30

 

Program

V3

Daily TV news program

Spanish TV, RTVE

29

   

V4

Weekly TV news program

Spanish TV, RTVE

19

Drama / Movie

Sequence

V5

"Art" movie: Hallo

Christoph Rodatz, GMD

4

   

V6

Movie: "La sombra de un cipres es alargada"

Spanish TV, RTVE

15

   

V7

TV Drama series: "Pepa y Pepe"

Spanish TV, RTVE

15

 

Program

V8

Sitcom (1 and 2)

Portuguese TV, RTP & SIC

60

   

V9

Filmed theater: The playboy of the western world

INA

120

Documentary

Shot

V10

"Science Eye": Bridge construction

NHK

9

 

Sequence

V11

5 clips of scientific documentaries

SFRS

25

   

V12

Documentary about buildings

Lancaster Television

5

 

Program

V13

Basic Ophthalmic Exam

Univ. of Tennessee

26

   

V14

Educational video: "A way with waste" and "Animals have young"

Singapore Ministry of Education

25

   

V15

Documentary about a village: "Santillana del Mar"

Spanish TV, RTVE

30

Sport

Sequence

V16

3 Sport Clips: Soccer, Cycling, Basketball

Spanish TV, RTVE

49

   

V17

2 Sport clips: Basketball, Golf

Korean Broadcasting Station

20

 

Program

V18

Soccer sequence

Samsung

45

Commercial

Sequence

V19

14 items of commercials in Korean

Samsung

7

Music video and games

Sequence

V20

Korea's pop singers' live music Show

Korean Broadcasting Station

10

   

V21

TV quiz program: "Saber y ganar"

Spanish TV, RTVE

15

   

V22

Music program: "Musica si"

Spanish TV, RTVE

15

 

Program

V23

Variety Show. First 30 minutes of complete program

Portuguese TV, SIC

30

Cartoon and animation

Sequence

V24

5 Selected pieces of cartoons

D'Ocon Film Productions

12

 

Program

V25

Harmony

Singapore Ministry of Education

12

   

V26

Cartoon "Don Quijote de la Mancha"

Spanish TV, RTVE

15

Home video

Shots

V27

Edited home video

LGERCA

34

Surveillance

Shots

V28

3 outdoors scenes

ETRI

9

   

V29

5 video sequences taken from a bridge over a speedway

UCL

28

Miscellaneous

 

Shots

V30

MPEG4 test sequence (Bream, Children, Fish)

Matsushita

1

 

 

 

 

Detailed list of items:

 

Audio Items:

 

ITEM A1

Category: Radio broadcast news.

Source: 98 Radio-France.

MPEG contact: R. Ronfard, INA.

Submission Item: 10

Description: One day from a special program broadcast from June 9th to July 13th, 1998. 17 hours a day, from 8:30 AM to 1:30 AM. Includes:

    1. World cup matches
    2. News bulletins in French
    3. News bulletins in English, German, Spanish, Portuguese
    4. Chronicles
    5. Interviews
    6. Magazines

Associated Data: Transmission control lists have been input in an Excel data base.

Size / Duration: 10 hours have been selected from an original material of 17 hours

Format: Audio (mono) compression in MPEG-2, level 2, at 128 kbps, programs are segmented in files of 15 minutes

ITEM A2

Content Category: Music

Source: Two Ton Shoe

MPEG Contact: A. Lindsay, Riverland.

Submission Item: 18

Short Description: "Two Ton Shoe" Rock album.

Associated Data: None.

Size or Duration: 38:18

Format: 44100Hz, 16-bit AIFF

 

ITEM A3

Content Category: Music

Source: A. Lindsay

MPEG contact: A. Lindsay, Riverland.

Submission Item: 19

Short Description: Brussels Choral Society singing Bruckner's Te Deum, and Mozart's Requiem.

Associated Data: None.

Size or Duration: 72:03

Format: 44100Hz, 16-bit AIFF

ITEM A4

Content Category: Music.

Source: S. Lounis

MPEG contact: A. Lindsay, Riverland.

Submission Item: 20

Short Description: Original composition, a capella. Voice only.

Associated Data: French text.

Size or Duration: 5 min

Format: 48000Hz, 16-bit AIFF

 

ITEM A5

Content Category: Audio.

Source: SQAM CD.

MPEG contact: J. Herre, EBU/FhG.

Submission item: 35

Short Description: Short sequences of solo instrument and other sounds

Associated Data: /

Size or Duration: 54 items (some tracks have sub-indices). No sequences are exceeding 640MB in length

ITEM A6

Content Category: Audio.

Source: J. Herre

MPEG contact: J. Herre, EBU/FhG.

Submission item: 52

Short Description: Pop song based on an A-A-C motif

Associated Data: /

Size or Duration: One song (<5 min) in a variety of formats

Format: MIDI, AIFF, MPEG Layer 2 Audio

 

 

 

Still image items:

 

ITEM S1

Content Category: Amateur photographs.

Source: Tristan Savatier.

MPEG contact: R. Ronfard, INA.

Submission item: 24

Short Description: Amateur Photos of landscapes, people. Some nudity.

Associated Data: Keywords May be provided on request for each picture.

Size or Duration: 300 photographs

Format: PhotoCD

ITEM S2

Content Category: Photographs.

Source: Alejandro Jaimes.

MPEG contact: Seungyup Paek, Columbia Univ.

Submission item: 48

Short Description: General.

Associated Data: None

Size or Duration: ~300 images.

Format: JPEG

 

ITEM S3

Content Category: Photographs.

Source: Department of Water Resources, California

MPEG contact: S. Krishnamachari

Submission item: 50

Short Description: Images of varying scene and color content, many outdoor and indoor images. Images of same scene with different viewpoints. Many "similar" images that might come handy during evaluation.

Associated Data: None

Size or Duration: ~ 2000 images

Format: JPEG

ITEM S4

Content Category: Photographs.

Source: Heinrich Hertz Institute

MPEG contact: Sylvie Jeannin, LEP.

Submission item: 53

Short Description: Indoor images of people, under varying lighting conditions and angles

Associated Data: None

 

ITEM S5

Content Category: Photographs.

Source: JPEG 2000.

MPEG contact: M. Zeug, Iterated.

Submission item: 26

Short Description: Test images.

ITEM S6

Content Category: Photographs.

Source: National Archives at Maryland. http://www.nara.gov/nara/menus/audvis.html

MPEG contact: N. Nandhakumar, LG.

Submission item: 28

Short Description: Collection of print and digitized pictures.

ITEM S7

Content Category: Photographs.

Source: Portuguese Photograph Center.

MPEG contact: J. Torres, INESCN.

Submission item: 37

Short Description: Photos by Portuguese photographer from the beginning of the century. One of the pioneers of the cinema in Portugal. Some collections of photos are like a film and describe some sequence.

Size or Duration: 260 images. <300 MB

Format: JPEG

ITEM S8

Content Category: Subset of registered trademark images.

Source: Korean Industrial Property Office.

MPEG contact: M. Kim, ETRI.

Submission number: 34

Short Description: All images are trade marks captured by a scanner.

Size or Duration: 3000 images. 2.6 Mbytes.

Format: TIFF

 

ITEM S9

Content Category: Aerial photographs.

Source:

MPEG contact: B.S. Manjunath, UC Santa Barbara.

Submission item: 25

Short Description: Aerial photos, monochrome and colored.

Associated Data: Associated data available for some of the images

Size or Duration: 30 photos (each 5000x5000 pixels)

Format: tiff

ITEM S10

Content Category: Range images.

Source: National Research Council.

MPEG contact: E. Paquet.

Submission item: 1

Short Description: These images can be used not only as range images but also as generators for 2D images (e.g. same object under different lighting conditions)

Size or Duration : 205 range images and 7 complete 3-D colour models (all scanned)

Format: VRML 1

 

 

 

Video items:

 

ITEM V1

Source: RTP & SIC

MPEG Contact: F. Pereira, IST.

Submission item: 12A

Short Description: Two daily News program

Associated Data: List and timing of shots and semantics.

Size or Duration: 2 * 30 mins

ITEM V2

Source: National Archives at Maryland. http://www.nara.gov/nara/menus/audvis.html

MPEG Contact: N. Nandhakumar, LGERCA

Submission item: 30

Short Description: Universal newsreel collection. B&W video, archive of news.

Size or Duration: 30 mins

ITEM V3

Source: Spanish TV, RTVE.

MPEG contact: P. Salembier, UPC.

Submission item: 39A

Short Description: Clip from daily program "Telediario"

Size or Duration: 29 mins

ITEM V4

Source: Spanish TV, RTVE.

MPEG contact: P. Salembier, UPC.

Submission item: 39B

Short Description: Clip from weekly program "Informe Semanal"

Size or Duration: 19 min

ITEM V5

Source: Christoph Rodatz, GMD.

MPEG Contact: F. Nack.

Submission item: 2B

Short Description: Hallo

Associated Data: German text available, translation possible. Some composition.

Size or Duration: 4 min

ITEM V6

Source: Spanish TV, RTVE.

MPEG contact: P. Salembier, UPC.

Submission item: 41

Short Description: "La sombra de un cipres es alargada".

Associated Data: /

Size or Duration: 15 mins.

ITEM V7

Source: Spanish TV, RTVE.

MPEG Contact: P. Salembier, UPC.

Submission item: 42

Short Description: Drama series titled "Pepa y Pepe".

Size or Duration: 15 mins.

ITEM V8

Source: Portuguese TV, RTP & SIC.

MPEG Contact: F. Pereira, IST.

Submission item: 12B

Short Description: 2 Sitcoms

Associated Data: None.

Size or Duration: 2*30 mins

ITEM V9

Source: INA.

MPEG contact: R. Ronfard, INA.

Submission item: 16

Short Description: The playboy of the western world, filmed for TV. French.

Associated Data: Text available

Size or Duration: Two hours.

ITEM V10

Source: NHK.

MPEG Contact: M. Shibata, NHK.

Submission item: 4

Short Description: "Science Eye" Scientific Video about bridge construction.

Associated Data: Cuts, Japanese text overlays, narration text attached. Text descriptions (English) of cut-content will be attached.

Size or Duration : 9 min

ITEM V11

Source: SFRS.

MPEG Contact: P. Faudemay

Submission item: 5

Short Description: 5 sequences from scientific movies

(1) (1974) Lascaux pictures. French and English; (2) (1990) An island with flamingoes. French, English and Spanish; (3) (1979) Social life of Antelope. French; (4) (1973) Study on the Nyamgatoms tribe. French; (5) (1964) Scientific missions in the Kerguelen islands. French.

Associated Data: 3 page script for each movie.

Size or Duration: 5 * 5 min

ITEM V12

Source: Lancaster Television.

MPEG Contact: E. Hartley, Lancaster Univ.

Submission item: 7

Short Description: Show reel

Associated Data: None.

 

 

ITEM V13

Source: Univ. of Tennessee.

MPEG Contact: S. Jeannin, LEP.

Submission item: 8A

Short Description: Basic Ophthalmic Exam. English.

Associated Data: None.

Size or Duration: 26 min

ITEM V14

Source: Singapore Ministry of Education.

MPEG Contact: V.V. Vinod.

Submission item: 9BC

Short Description: Educational Video. "A way with waste" and "Animals have young"

Size or Duration : 16 min and 9 min

ITEM V15

Source: Spanish TV, RTVE.

MPEG Contact: P. Salembier, UPC.

Submission item: 45

Short Description: Clip of the video titled "Santillana del Mar" included in the TV serial "Los Pueblos. Espana a ras del suelo".

Size or Duration: 30 mins.

ITEM V16

Source: Spanish TV, RTVE.

MPEG Contact: P. Salembier, UPC.

Submission item: 40

Short Description: Three clips of (1) Soccer: Spain vs. Sweden; (2) Cycling: "Vuelta a Espana"; (3) BasketBall: Real Madrid ag. Estudiantes

Size or Duration: (1) 15 mins. (2) 19 min. (3) 15 min

ITEM V17

Source: Korean Broadcating Station (KBS).

MPEG Contact: S. Sull, Korea University.

Submission item: 47A

Short description: (1) Basketball game broadcast, korean comments; (2) Golf tournament broadcast

Size or Duration: (1) 10 minutes; (2) 10 minutes

ITEM V18

Source: Samsung.

MPEG Contact: Y. Choi, Samsung.

Submission item: 15

Short Description: Soccer sequence.

Size or Duration: 45 Min

 

ITEM V19

Source: Samsung.

MPEG Contact: Y. Choi, Samsung.

Submission item: 14

Short Description: 14 items of commercials in Korean

Associated Data: Full transcript may be given. Additional semantics.

Size or Duration: Each 30 sec.

ITEM V20

Source: Korean Broadcasting Station (KBS).

MPEG Contact: S. Sull, Korea University.

Submission item: 47B

Short description: Korea's pop singers' live music Show

Size or Duration: 10 mins

ITEM V21

Source: Spanish TV, RTVE.

MPEG Contact: P. Salembier, UPC.

Submission item: 43

Short Description: TV quiz program called "Saber y ganar"

Size or Duration: 15 mins.

ITEM V22

Source: Spanish TV, RTVE.

MPEG Contact: P. Salembier, UPC.

Submission item: 44

Short Description: "Musica si".

Size or Duration: 15 mins.

Format: MPEG1.

ITEM V23

Source: Portuguese TV, SIC.

MPEG Contact: F. Pereira, IST.

Submission item: 12C

Short Description Variety Show. First 30 minutes of complete program.

Associated Data: None.

Size or Duration: ~30 mins

ITEM V24

Source: D'Ocon Film Productions.

MPEG Contact: P. Salembier, UPC.

Submission item: 32

Short Description: Selected pieces of cartoons. (soundtrack in Spanish and English)

Size or Duration: 5 clips of 1-2 mins: 12 mins.

ITEM V25

Source: Singapore Ministry of Education.

MPEG Contact: V.V. Vinod.

Submission item: 9A

Short Description: Educational Video: "Harmony "

Size or Duration : 12 min

ITEM V26

Source: Spanish TV, RTVE.

MPEG Contact: P. Salembier, UPC.

Submission item: 38

Short Description: Cartoon "Don Quijote de la Mancha"

Size or Duration: 15 mins.

ITEM V27

Source: LGERCA

MPEG Contact: N. Nandhakumar, LGERCA

Submission item: 22

Short Description: Edited home video.

Associated Data: Ground truth information: location of scene cuts, pan, zoom, etc.

Size or Duration: 17 mins each (approx), two files

ITEM V28

Source: ETRI

MPEG Contact: K.W. Lee, ETRI.

Submission item: 33

Short Description: Test material for surveillance. 3 outdoors scenes (different fixed cameras), people appearing / disappearing.

Associated Data: semantic info on what’s happening

Size or Duration: 9 mins

ITEM V29

Source: Universite Catholique de Louvain

MPEG Contact: S. Jeannin, LEP.

Submission item: 49

Short Description: 5 video sequences taken from a bridge over a speedway. The camera watches the vehicles flow. Different luminance conditions are present.

Associated Data: A text file describing the global recording conditions, the description of the events present in the 5 sequences, the translation of pixel coordinates to real world 3D coordinates.

Size or Duration: (1) 0'56"; (2) 8'47"; (3) 9'20"; (4) 4'59"; (5) 4'59"

ITEM V30

Source: Matsushita

MPEG Contact: Taka Senoh, Matsushita.

Submission item: 46

Short Description: Three "video object sequences" used as MPEG-4 test data: (1) Bream; (2) Children; (3) Fish

Associated Data: Each sequence consists of a background still picture, an object with shape information and a caption

Size or Duration : (1) 60MB – 10 secs

(2) 60MB– 10 secs

(3) 30MB. – 10 secs

Format: Raw SIF format