# Nepomuk MultiMedia (NMM): Description of multimedia objects like Music, Video and Images

Authors:
  - Urho Konttori <urho.konttori@nokia.com>
Editors:
  - Ivan Frade <ivan.frade@nokia.com>
  - Urho Konttori <urho.konttori@nokia.com>
Upstream:

  Not available

ChangeLog:

  Tracker changes

Copyright:

  © 2009, 2010 Nokia

## Overview

### Introduction

This ontology extends NIE (Nepomuk Information Element ontology) and NFO (Nepomuk File Ontology) into the domains of multimedia, including Images, Videos, Music and Radio, and includes a couple of properties to support uPnP sharing.

This ontology replaces/complements NID3 and NEXIF. Those ontologies are a direct map of the respective metadata standards, which makes very difficult to map cleanly other standards (like gstreamer metadata, mp4, ogg, and so on). Besides, those ontologies contain a lot of very low level technical information that is useless to the average user of the desktop.

Our approach in NMM is to keep the minimum properties that make sense for the user, and are present in all (or almost all) specific metadata formats. A profesional photographer (or musician) who needs more fine-grained details for its documents, is free to add also nID3 information or other extensions to the ontology.

### Images domain

The core of images in NMM ontology is the class nmm:Photo. It is (through a long hierarchy) a nie:InformationElement, an interpretation of some bytes. It has properties to store the basic information (camera, metering mode, white balance, flash), and inherits from nfo:Image orientation (nfo:orientation) and resolution (nfo:verticalResolution and nfo:horizontalResolution).

Note that for tags, nie:keywords (from nie:InformationElement) can be used, or the NAO ontology.

Graphical Overview (images domain)

Notation defined in this page

### Music domain

Graphical Overview (music domain)

Notation defined in this page

### Radio domain

NMM includes classes and properties to represent analog and digital radio stations. There is a class nmm:RadioStation on the nie:InformationElement side of the ontology, representing what the user sees about that station (genre via PTY codes, icon, plus title inherited from nie:InformationElement)

A nmm:RadioStation can have one or more nmm:carrier properties representing the different frequencies (or links when it is digitial) it can be tuned. This property links the station with nfo:MediaStream, but usually it will point to one of the subclasses: nmm:DigitalRadio (if digital) or nmm:AnalogRadio (if analog). An analog station has properties as modulation and frequency, while the digial station has streaming bitrate, encoding or protocol.

Note that nfo:MediaStream refers to a flux of bytes/data, and it is on the nie:DataObject side of the ontology

Graphical Overview (radio domain)

Notation defined in this page

## NMM Ontology Classes

### nmm:Artist

An artist.

Superclasses :

  nco:Role, nie:InformationElement,

Subclasses :

  --

In domain of :

  nmm:artistName,

In range of :

  nmm:leadActor, nmm:producedBy, nmm:director, nmm:lyricist, nmm:composer, nmm:performer, nmm:albumArtist,

Note:

This class notifies about changes

### nmm:Flash

Enumeration of the possible values of flash property

Superclasses :

  rdfs:Resource,

Subclasses :

  --

In domain of :

  --

In range of :

  nmm:flash,

Predefined instances :

  nmm:flash-off, nmm:flash-on,

### nmm:AnalogRadio

FM Radio carrier signal data. Basically the frequency

Superclasses :

  nfo:MediaStream,

Subclasses :

  --

In domain of :

  nmm:frequency, nmm:modulation,

In range of :

  --

### nmm:Video

Superclasses :

  nfo:Audio, nfo:Video,

Subclasses :

  --

In domain of :

  nmm:isContentEncrypted, nmm:subtitle, nmm:hasSubtitle, nmm:leadActor, nmm:producedBy, nmm:director, nmm:category, nmm:MPAARating, nmm:synopsis, nmm:runTime, nmm:episodeNumber, nmm:season, nmm:isSeries, nmm:videoAlbum,

In range of :

  --

Note:

This class notifies about changes

### nmm:ImageList

An album of images

Superclasses :

  nfo:MediaList,

Subclasses :

  --

In domain of :

  --

In range of :

  --

Note:

This class notifies about changes

### nmm:MusicPiece

Superclasses :

  nfo:Media,

Subclasses :

  --

In domain of :

  nmm:internationalStandardRecordingCode, nmm:trackNumber, nmm:lyrics, nmm:lyricist, nmm:composer, nmm:performer, nmm:beatsPerMinute, nmm:musicAlbumDisc, nmm:musicAlbum,

In range of :

  --

Note:

This class notifies about changes

### nmm:MusicAlbum

Superclasses :

  nfo:MediaList,

Subclasses :

  --

In domain of :

  nmm:albumPeakGain, nmm:albumGain, nmm:albumDuration, nmm:albumTitle, nmm:albumTrackCount, nmm:albumArtist,

In range of :

  nmm:musicAlbum, nmm:albumDiscAlbum,

Note:

This class notifies about changes

### nmm:Playlist

Specific class to split MediaList in Albums and playlists.

Superclasses :

  nfo:MediaList,

Subclasses :

  --

In domain of :

  --

In range of :

  --

Note:

This class notifies about changes

### nmm:WhiteBalance

Camera's white balance setting

Superclasses :

  rdfs:Resource,

Subclasses :

  --

In domain of :

  --

In range of :

  nmm:whiteBalance,

Predefined instances :

  nmm:white-balance-manual, nmm:white-balance-auto,

### nmm:Photo

A photo

Superclasses :

  nfo:Image,

Subclasses :

  --

In domain of :

  nmm:isColorCorrected, nmm:isCropped, nmm:whiteBalance, nmm:meteringMode, nmm:isoSpeed, nmm:focalLength, nmm:fnumber, nmm:flash, nmm:exposureTime,

In range of :

  --

Note:

This class notifies about changes

### nmm:RadioModulation

Set of instances for analog radio modulation

Superclasses :

  rdfs:Resource,

Subclasses :

  --

In domain of :

  --

In range of :

  nmm:modulation,

Predefined instances :

  nmm:radio-modulation-fm, nmm:radio-modulation-am,

### nmm:DigitalRadio

Online Radio Stream data object (i.e. as a raw flow of bytes)

Superclasses :

  nfo:MediaStream,

Subclasses :

  --

In domain of :

  nmm:protocol, nmm:encoding, nmm:streamingBitrate,

In range of :

  --

### nmm:RadioStation

The Radio station in user terms: BBC3, Radio5, YLEX, ... It is linked with 1 or more carriers (different FM frenquencies, online sources in different qualities, etc.). Some RDS information is represented with nie properties, nie:identifier for PI, nie:title for PS

Superclasses :

  nfo:Audio,

Subclasses :

  --

In domain of :

  nmm:carrier, nmm:radioPTY, nmm:radioIcon,

In range of :

  --

Note:

This class notifies about changes

### nmm:SynchronizedText

Superclasses :

  nfo:PlainTextDocument,

Subclasses :

  --

In domain of :

  nmm:isForHearingImpaired,

In range of :

  nmm:subtitle, nmm:lyrics,

### nmm:MusicAlbumDisc

Superclasses :

  nie:InformationElement,

Subclasses :

  --

In domain of :

  nmm:setNumber, nmm:musicCDIdentifier, nmm:albumDiscAlbum,

In range of :

  nmm:musicAlbumDisc,

### nmm:MeteringMode

Enumeration of different ways a camera determines exposure.

Superclasses :

  rdfs:Resource,

Subclasses :

  --

In domain of :

  --

In range of :

  nmm:meteringMode,

Predefined instances :

  nmm:metering-mode-other, nmm:metering-mode-partial, nmm:metering-mode-pattern, nmm:metering-mode-multispot, nmm:metering-mode-spot, nmm:metering-mode-center-weighted-average, nmm:metering-mode-average,

## NMM Ontology Properties

### nmm:streamingBitrate

Bitrate indicating the quality of the stream in Kbits (usual values 32, 64, 128...)

Type :

  --

Domain :

  nmm:DigitalRadio,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:whiteBalance

Type :

  --

Domain :

  nmm:Photo,

Range :

  nmm:WhiteBalance,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:musicAlbumDisc

album disc the music belongs to

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  nmm:MusicAlbumDisc,

Superproperties :

  nie:isLogicalPartOf,

Subproperties :

  --

Cardinality :

  1

### nmm:lyrics

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  nmm:SynchronizedText,

Superproperties :

  --

Subproperties :

  --

### nmm:musicCDIdentifier

Music CD identifier to for databases like FreeDB.org. This frame is intended for music that comes from a CD, so that the CD can be identified in databases such as the CDDB. The frame consists of a binary dump of the Table Of Contents, TOC, from the CD, which is a header of 4 bytes and then 8 bytes/track on the CD plus 8 bytes for the 'lead out' making a maximum of 804 bytes. The offset to the beginning of every track on the CD should be described with a four bytes absolute CD-frame address per track, and not with absolute time.

Type :

  --

Domain :

  nmm:MusicAlbumDisc,

Range :

  xsd:string,

Superproperties :

  nie:identifier,

Subproperties :

  --

Cardinality :

  1

### nmm:leadActor

Type :

  --

Domain :

  nmm:Video,

Range :

  nmm:Artist,

Superproperties :

  --

Subproperties :

  --

### nmm:focalLength

A measure of how strongly the lens converges light

Type :

  --

Domain :

  nmm:Photo,

Range :

  xsd:double,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:albumDuration

Duration of the album

Type :

  --

Domain :

  nmm:MusicAlbum,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:setNumber

Disc number of album disc

Type :

  --

Domain :

  nmm:MusicAlbumDisc,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:isSeries

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:boolean,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:category

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:string,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

Text indexed :

  This property is indexed, so it can provide results on text search

### nmm:synopsis

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:string,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:frequency

Frequency in the Radio spectrum in Khz (note that usually FM frequencies are in MHz)

Type :

  --

Domain :

  nmm:AnalogRadio,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:skipCounter

Type :

  --

Domain :

  nfo:Media,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:carrier

Signal where a radio can be tuned in. There can be more than one.

Type :

  --

Domain :

  nmm:RadioStation,

Range :

  nfo:MediaStream,

Superproperties :

  --

Subproperties :

  --

### nmm:modulation

Modulation used in the frequency (AM or FM)

Type :

  --

Domain :

  nmm:AnalogRadio,

Range :

  nmm:RadioModulation,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:isForHearingImpaired

Does text stream contain helper tags for hearing-impaired such as <steps in hallway>

Type :

  --

Domain :

  nmm:SynchronizedText,

Range :

  xsd:boolean,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:isContentEncrypted

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:boolean,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:composer

Composer

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  nmm:Artist,

Superproperties :

  nco:contributor,

Subproperties :

  --

Cardinality :

  1

### nmm:albumTrackCount

Track count of album

Type :

  --

Domain :

  nmm:MusicAlbum,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:director

Type :

  --

Domain :

  nmm:Video,

Range :

  nmm:Artist,

Superproperties :

  --

Subproperties :

  --

### nmm:isoSpeed

Measure of a photographic film's sensitivity to light as ISO value

Type :

  --

Domain :

  nmm:Photo,

Range :

  xsd:double,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:albumTitle

nmm:albumTitle is deprecated, use nie:title instead, extractors still need updating

Type :

  --

Domain :

  nmm:MusicAlbum,

Range :

  xsd:string,

Superproperties :

  nie:title,

Subproperties :

  --

Cardinality :

  1

Text indexed :

  This property is indexed, so it can provide results on text search

Note:

This property is deprecated

### nmm:exposureTime

Exposure time of the photo

Type :

  --

Domain :

  nmm:Photo,

Range :

  xsd:double,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:dlnaProfile

DLNA profile of the content, like MP3, MPEG_TS_HD_US, LPCM etc

Type :

  --

Domain :

  nfo:Media,

Range :

  xsd:string,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:meteringMode

Metering mode refers to the way in which a camera determines the exposure.

Type :

  --

Domain :

  nmm:Photo,

Range :

  nmm:MeteringMode,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:radioPTY

PTY Code (content description) as integer. RDS specs define the translations into human readable descriptions for various languages

Type :

  --

Domain :

  nmm:RadioStation,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:fnumber

The diameter of the entrance pupil in terms of the focal length of the lens

Type :

  --

Domain :

  nmm:Photo,

Range :

  xsd:double,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:MPAARating

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:string,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:episodeNumber

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:isColorCorrected

Type :

  --

Domain :

  nmm:Photo,

Range :

  xsd:boolean,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:runTime

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:producedBy

Type :

  --

Domain :

  nmm:Video,

Range :

  nmm:Artist,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:hasSubtitle

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:boolean,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:albumArtist

main artists of the album

Type :

  --

Domain :

  nmm:MusicAlbum,

Range :

  nmm:Artist,

Superproperties :

  --

Subproperties :

  --

### nmm:genre

Type :

  --

Domain :

  nfo:Media,

Range :

  xsd:string,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

Text indexed :

  This property is indexed, so it can provide results on text search

### nmm:performer

Performer

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  nmm:Artist,

Superproperties :

  nco:contributor,

Subproperties :

  --

Cardinality :

  1

### nmm:albumPeakGain

Peak Gain of album

Type :

  --

Domain :

  nmm:MusicAlbum,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:uPnPShared

Tells the uPnP MediaServer (e.g. Rygel) whether to export/share the resource or not

Type :

  --

Domain :

  nfo:Media,

Range :

  xsd:boolean,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:protocol

Protocol used for the streaming (HTTP, RTSP)

Type :

  --

Domain :

  nmm:DigitalRadio,

Range :

  xsd:string,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:radioIcon

Image used as logo for a radio station

Type :

  --

Domain :

  nmm:RadioStation,

Range :

  nfo:Image,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:flash

Specifies whether flash was used

Type :

  --

Domain :

  nmm:Photo,

Range :

  nmm:Flash,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:albumDiscAlbum

Album of the disc

Type :

  --

Domain :

  nmm:MusicAlbumDisc,

Range :

  nmm:MusicAlbum,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:beatsPerMinute

beats per minute

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:lyricist

Lyricist

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  nmm:Artist,

Superproperties :

  nco:contributor,

Subproperties :

  --

Cardinality :

  1

### nmm:videoAlbum

Type :

  --

Domain :

  nmm:Video,

Range :

  nfo:MediaList,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:artistName

Name of the artist

Type :

  --

Domain :

  nmm:Artist,

Range :

  xsd:string,

Superproperties :

  dc:title,

Subproperties :

  --

Cardinality :

  1

Text indexed :

  This property is indexed, so it can provide results on text search

### nmm:dlnaMime

Mimetypes as defined for DLNA (occasional differences compared to xdg-mime)

Type :

  --

Domain :

  nfo:Media,

Range :

  xsd:string,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:albumGain

Gain of album

Type :

  --

Domain :

  nmm:MusicAlbum,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:musicAlbum

album the music belongs to

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  nmm:MusicAlbum,

Superproperties :

  nie:isLogicalPartOf,

Subproperties :

  --

Cardinality :

  1

### nmm:trackNumber

Track number of the music in its album

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:season

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:internationalStandardRecordingCode

ISRC ID. Format: 'CC-XXX-YY-NNNNN'

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  xsd:string,

Superproperties :

  nie:identifier,

Subproperties :

  --

Cardinality :

  1

### nmm:isCropped

Type :

  --

Domain :

  nmm:Photo,

Range :

  xsd:boolean,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:subtitle

Type :

  --

Domain :

  nmm:Video,

Range :

  nmm:SynchronizedText,

Superproperties :

  --

Subproperties :

  --

### nmm:alternativeMedia

Link between to different version of the same media. This is used for instances in uPnp where the server can provide the same video in different resolutions and codecs

Type :

  --

Domain :

  nfo:Media,

Range :

  nfo:Media,

Superproperties :

  --

Subproperties :

  --

### nmm:encoding

Encoding of the radio. It is a property of the streaming, that it is known before hand, so the applications can choose the encoding they understand.

Type :

  --

Domain :

  nmm:DigitalRadio,

Range :

  xsd:string,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1