WEDEL Model and Language
 
Integration image scores and symbolic music *

Integration of music notation sources and audio formats *

WEDEL distribution format, WDF, specification *

Identification *

Classification *

Symbolic Section in WDF objects *


In this section, the problems of integration among music in symbolic and image score formats with the audio produced by the symbolic format (for example in MIDI) or acquired as auxiliary audio files are discussed.

Integration image scores and symbolic music

The integration of images of music and music in symbolic format is a big problem. Symbolic music presents a collection of information related to single music symbols and considering their relationships and semantics.

In this sense, from symbolic music it is possible to

Images of music scores present a strongly limited number of functionalities, and some relevant drawback. The main problems are: The above functionalities possible for symbolic music are all infeasible on images of music scores. On that format it is only possible to: Images of music scores presents some benefits with respect to the symbolic music. Image of music scores: This analysis means that both formats: images of music sheets and symbolic music are needed. Presently the former is much more interesting for publishers since it means low cost to go on the Internet distribution.

The latter substitute the first in the future, and probably not for all aspects. Very old and hand made scores remain in paper or image formats for several years and may be forever.

For this reason, it is interesting to study a format such as WEDEL Distribution format, WDF, that is capable of integrating both aspects.

In WDF, the images of music scores is prepared for allowing the organisation of the single staff lines on the computer screen. In addition, the resolution of the image is arranged according to the screen dimensions by starting from a strong enough resolution. In this way the visualisation of images of music is more flexible, reducing the problems of images of music scores. This allows the implementation of an acceptable mechanism for executing image score music on the basis of an auxiliary audio, or on the MIDI audio produced by the symbolic part.

In WDF, the integration of symbolic music and image score music is only formal in the sense that the format allow the inclusion of both aspects in the same WEDEL music object but the interactions between these aspects is minimum. They is linked via:

The definition of relationships between symbolic elements, such as measures, and the specific image that contains the corresponding measure image it is interesting. For example for showing: (i) the correct/ modified/arranged music notation code of eventual critical pieces in the original music score (passing from music image to symbolic); (ii) for see the original notation or passage related to a symbolic aspect (passing from the symbolic notation to the corresponding image part).

More detailed relationships (for instance at level of single figures of the music notation) are totally un-useful. Compute screen can typically visualise several music measures at the same time and thus the resolution at level of single measure is not mandatory. To pass from a measure of the symbolic score to the same on the image score is enough to present the image containing the selected measure. For the same reasons also the synchronisation of a music score image or a symbolic music at the level of the single figure (note or rest) is not useful since during the music score visualisation with listening the screen present the a set of measures. It is enough to provide an approximate indication of were the musicians are to play the single music notation symbols. This can be done by simply having the synchronisation at level of measures or segment of measures (in the case of score images) and interpolating inside the available structures.

In this view, it has to be possible to:

Integration of music notation sources and audio formats

In this section the integration of auxiliary audio files and music in (i) symbolic format, and (ii) images of music score. Please note that the production of MIDI files from symbolic music does not present problems of synchronisation and it is given for granted since it is an operation available on all music editors. MIDI files can be produced stored and played in a second phase or can be played while produced.

In the following the interesting functionalities are reported:

  1. to synchronise music in symbolic format with an auxiliary audio file for presenting on the screen music pages and listening the audio produced by famous authors and conductors.
  2. to synchronise music in symbolic format with several different auxiliary audio files. This allow the user to compare different performances of different musicians and orchestras.
  3. to synchronise music in image score format with an auxiliary audio file for presenting on the screen music pages and listening the audio produced by famous authors and conductors.
  4. To reproduce music in both image or symbolic format synchronised with the audio and allowing the presentation of the right music piece in the right time instant according to the synchronisation decided.
  5. To allow the decrement and increment of execution velocity adjusting the velocity of audio and of the music presented on the screen.
Please note that the synchronisation of an auxiliary audio for the purpose of simple visualisation can be approximated, for example at level of measure. It is very hard to synchronise symbolic music with an available recording of the music piece. In certain conditions, the synchronisation can performed automatically (for example when the rhythmic base of the piece is well marked, see ICMC 1995, 96, 97, 98, 99).

In general, the precise synchronisation at level of single figures is quite hard even for an expert. For this reason, in the project problems of synchronisation is studied by starting from a first manual synchronisation of audio and music in both symbolic and image formats. This allow to verify the real needs of synchronisation. Automatic synchronisation is studied but it is out of the scope of the project.

It is quite obvious that the synchronisation of an auxiliary audio with symbolic score can be much more precise than that with the images of the music score. In fact, each image or image slice may contain typically more measures and not only one. To improve the synchronisation it can be supposed to associate with the single images of music scores also the dimension and the position of the included measures.

The above mentioned needs of synchronisation can be satisfied by implementing a simple synchronisation file in which the time spent by each measure is registered. These files can be used as a basis for executing music as auxiliary audio and presenting the right music page in the correct time instant for both image score music and symbolic music.
 
 

WEDEL distribution format, WDF, specification

WEDEL Distribution Format and language includes constructs for the integrated description of the following aspects:

In the following these aspects are shortly discussed, while a detailed view of each aspects is analysed in a separate section for its corresponding specification:
  1. Identification, which allows the identification of the WDF piece. Typical identification mechanisms have to be used such as ISMN. In addition, each WDF has to provide a unique WDFID, such as every its component.
  2. Classification, which allows the classification of a WDF piece according to archive mechanisms. The information included into the classification is general, no details about the single components of the WDF have to be included. These are contained in the specific components. This classification is only for the whole object and it doesn’t confused with the classification of the symbolic version, image score version, audio files, etc. which are the components of the WDF object.
  3. Protection which includes the protection aspects of encryption, watermark at high level, only the codes are stored. In addition, a table about the manipulation permission is available. This part also include the aspects related to the permission of music manipulation in the several state of the WDF object. When it is demo, when it is a rented object, when it has been sold, when the renting period has been expired.
  4. Printing which includes the default description for printing the music contained in the WDF object. These have to include format, presence of cover, set of documents to be printed, specific fingerprints. Details about printing of symbolic, image score and Braille can be possible.
  5. Symbolic Music, which describes the scoring information, musical notation symbols, and their relationships. The idea is to allow the execution in MOODS manner presenting the score pages with a replacement mechanism on a large set of visualization device types, allowing the synchronization of audio files provided in WAVE or MIDI formats.
  1. Image of Music Sheets, which allows to distribute images of music scores without converting them into symbolic format. The idea is to allow also in this case the execution in MOODS manner presenting the score pages with a replacement mechanism on a large set of visualization device types, allowing the synchronisation of audio files provided in WAVE, MIDI or MP formats. Images of Music Sheets can be distributed in GIF or compressed TIF formats starting from PDF, TIFF, BMP, GIF, PIC, PCX, TGA, etc. and any other image format. Images of music scores can be at different resolution depending on the purpose for which the WDF is acquired from the publishers (see the previous section for discussion). These can be from 1200/600 dpi (master image) to 100/70 dpi (computer screen resolution). The resolution also influences the printing quality and reliability/robustness of watermark. Images of music sheets have to be protected with a specific watermark. Each image has to be accompanied by a description file, which includes an ID, a reference to the WDFID, a description, a type and other information to maintain images of music sheet linked to the rest of the WDF components. Images can be of main score and of parts. Single images include a staff line (comprised of several measures) for single parts or a the single systems of parts for the main score. For each score image the number of included measures is collected. Mechanism for reducing their dimensions according to the adopted computer have to be provided. This allow to present music in image format in a suitable manner according to the dimension of the computer used for visualising the music. In addition in this manner a more detailed control on the music consumption/execution can be performed since each small piece of image have a range of included measures.
  2. Performance. This aspect deals with the execution rate of music during a performance with the aim of providing on the computer screen the symbolic or the image version of music synchronously with the available auxiliary audio files or with a generated MIDI from the symbolic music. To this end, a solution similar to that has been proposed for the same purpose in MOODS has been adopted. It is based on the definition of a synchronisation file that include cross references between the symbolic/image version and the auxiliary file. This files contain the so called Execution Time Trend, ETT. It includes aspects related to the generation of sounds and for page turning during performances; These aspect put in relationship symbolic score with audio, or the image score with an audio file. Audio files can be MIDI, WAVE and MP3 in any cases the execution is performed with the WAVE format or MIDI. Each ETT has an ID, a reference to the WDFID, a description, a reference to the synchronised files and a type.
  3. Documents. Each WDF file may include none, one or more structured documents. Each documents has an ID, the ID of the owner WDF, a description and a type, etc. These may include author biography, critical description of the piece, description of the music piece, description of the performing orchestras, etc. For this reason several different documents can be included for each WDF file. In general, their format can be PDF, WORD, Textual (TXT, in ASCII), HTML, etc. No limitation are imposed on their format. Documents on different languages could be included as well. This section could include also a document version of the Music score. It can be in PDF or PostScript as well.
  4. Lyric. Each lyric has an ID, an ID of the WDF owner, and a description. Each music piece may have none, one or more lyrics associated with. In general, the lyric can be associated with
  1. Audio. A WDF file may include none, one or more audio files. Each audio file has an ID, a description, the ID of the WDF owner, and a type. Their format In general, their format can be WAVE, MIDI, MP3, SND, etc. No limitations are imposed on their format, only WAVE, MIDI and MP3 file can be used for the synchronisation with symbolic or image music. Audio files on different languages could be included as well. The synchronisation of audio file allows the adjusting of execution rate during visualisation and listening of music score with the selected audio.
  2. Video. A WDF file may include none, one or more video files. Each video file has an ID, a description, the WDFID, and a type. These may be included via HTML files. No limitations are imposed on their format: AVI, MPEG, etc., size and image rate. This depends on the hardware and software available on the publisher and client sites. Video files can include their audio this could be synchronised with music score. This aspect is out of the scope of the project. With this synchronisation not be possible to adjusting the execution rate during visualisation of music score and the visualisation of video and listening of the selected video.
  3. Image. A WDF file may include none, one or more images. Each image file has an ID, a description, the WDFID, and a type. These images has to be distinguished from the images of music score. The first are typically used for showing the portrait of the author/performer, the picture related to the music or opera, or performer, the home/city of the author/performer, a picture of the instrument. These may be visualised via HTML files. No limitation are imposed on their format: GIF, TIF, BMP, PCX, etc. The same images can be referred by the document section.
Each component of the above described WDF may be missing except for some parts of the identification and classification sections. Depending on the missing parts the available functionalities of the WDF can be different. Details on these aspects are reported in the following. In addition, a WDF include also the description of its structure.
 
 

Identification

The Identification section of the WDF object contains several identification details. The same structure is contained into the WDF components, for instance into the symbolic main score and parts and into the image score: main score and parts. In the following the table reporting the list of fields is presented.
 
 
 
WDFIR
WDF Identification Record for WDF objects and/or components
Field
Structure
Example/note
*WDFID <WDFID>  WDFID of the father if WDFIR is into a component
ISxx1 <type> <string> ISBN 9-384-2456987463
Isxx2 <type> <string> ISMN 9345934-342s32
Isxx3 <type> <string> ISRC (60 bit)
Isxx4 <type> <string>  
*Publishing Status <enum> published | unpublished | master | distributed via internet …..
*Publisher <string>  set in automatic according to the installation
Music Geographic Area <string> Asia | USA | Europe | ITALY 
Catalogue identification <string> A code
Second Publisher <string> A name
Server URL,  <url> Location download
Location Publishing <string> Florence, Italy
Local Distributor <LocalDistributorID>  Al443d
Local Distrib. Name <string> Ricordi, Suvini-Zerboni
*Date of preparation <xml-date>  hhhh-mm-gg, date of preparation
*Version Major <major> Max 99, min 0
*Version Minor <minor> Max 99999, min 00000
Responsible Name <string> Tom Kiercos
Quality level <number>  from 0 to 100

The mandatory fields have been market with an *.

where:

All the above pieces of information can be used for identifying the single WDF object into the databases, sever or local distributors. Some of this information is also used for building the code for watermarking the single object.
 
 

Classification

Classification has to allows the cataloguing of a WDF piece according to archive mechanisms. The information included into the classification part of a WDF object contains in general no details about the single WDF components. The classification details about the components are contained in specific description files associated with each component/aspects. These description/header files are moved together with the specific component file.

The Z39.50 and UNIMARK standards have been included.

All the following fields included in the classification record are much more important for Libraries, and conservatories rather than for publishers. They typically need less information for cataloguing their music. On the other hand, that information is needed when the music is printed. The information is typically included in printed music. For this reason it has to be included also into the WDF objects classification records.

The fields of the classification can be those reported in the following table. The fields included have been selected from the above reviewed classification mechanisms and formats and according to the discussions performed with the end-users which are present into the projects as partners. The classification record contains information that can be present at level of WDF object and also at level of each component.

This information can be different. The "duplication" of the WDFCR is also needed since


 
 
 
WDFCR
WDF Classification Record for each Language
Field
Type
Example
Author
<string>
W. A. Mozart
*Title
<string>
The serenade in G 
Parallel Title
<string>
Trio in G 
Act
<string>
First 
Movement
<string>
First
Piece type or ensemble
<string>
Symphony, quintet, overture, aria, trio, ….
*Genre
<string>
None | Baroque | classical | romantic | modern …
*Style
<string>
None | Bebop | rock’n’roll | rep …
Purpose
<string>
Education | effective | simplified
Extracted from
<string>
…………
A sequence number
<string>
N.35, ….
Piece Tonality
<string>
G Major, ………
Instrument (if any)
<string>
 
Instrument Tonality
<enum>
Notes: A, B, G, C….
Alphanumeric numbering
<string>
K 581, …..
*Unique short name
<string>
Haffner, primavera, Mozart TRIO………
*Original Language
<string>
Unknown | I | UK | FR | ………
*Language of this classification
<string>
Unknown | I | UK | FR | GR | ……
Duration
<UINT>
Duration in seconds
Date of composition
<xml-date>
hhhh-mm-gg
Époque
<year>/<year>
1970/1734
Location of composition
<string>
……..
Critical review 
<string>
Description
Reviewer 
<string>
……..
Nationality
<string>
Unknown | I | UK | FR | ………
Date of review 
<xml-date>
hhhh-mm-gg
Dedicated to
<string>
In dedica di mio padre
Commitment
<string>
For the Duke of Florence
First execution
<string>
………..
A textual description
<string>
…….

The above information is needed for the classification of a WDF object and its management into the database. A WDF object has to present at least a Classification Record as the above for the original language.

In the above record some fields can be missing, while other are absolutely mandatory.

The absolutely mandatory fields have been marked with an *. According to the fields of the above table:

A WDF object may have several classification records and these have to present different languages.

The classification is also present inside the single parts and main score files for both symbolic and image score versions. Parts and main score files contain also their own identification record. For example, the following figures describe a case in which a WDF item refers to a symbolic WDF file, SWF, containing a main score or a part, that includes a WDFIR and some different WDFCRs, one for each language.
 
 

Symbolic Section in WDF objects

The symbolic section of a WDF includes several aspects as reported in the following table.
 
WDF Symbolic components
Part
description
Classifcation classification aspects, name of the part, etc.
Identification identification aspects ID code, WDFID of the related main score, etc.
Logic logic aspects are the music specification of each part and main score details.
Visualization Rule for visualisation in a sort of improved MILLA such as in MOODS. Visual arrangement of symbols when specific exceptions must be imposed with respect to standards defined by the rules, and the music fonts. Visual rules can be different for the main score and parts, from a music score to another. When parts are visualised distinct visualisation rules may be used for formatting music according to different styles. These can be imposed by the publisher on the basis of its preferences and on the basis of the delivered music;
Font can be different from a music score to another. Standard fonts can be used. Specific fonts can be defined and attached to the symbolic part of the WDF file. The definition of new fonts can be performed by the publisher interacting with the WEDEL editor and integrator, has decided to add a font/symbol. Fonts include tables, font in vectorial format, font for the computer screen, and fonts for printing in postscript.
Versioning which supports monitoring the evolution of music pieces while considering logic performance and visual evolution. Changes performed on the main scores and parts (for logical aspects) can be collected, classified and reapplied according to a mechanism of versioning via CWF command List. The versioning is also applied to the performance aspects in the sense that several synchronisation files can be included in the WDF object..