4 @c A menu is needed before every deeper *section nesting of @nodes
5 @c Run M-x texinfo-all-menus-update
6 @c to automagically fill in these menus
7 @c before saving changes
11 @chapter Advanced Topics
14 When translating the input to notation, there are number of distinct
15 phases. We list them here:
17 @c todo: moved from refman.
19 The purpose of LilyPond is explained informally by the term `music
20 typesetter'. This is not a fully correct name: Not only does the
21 program print musical symbols, it also makes aesthetic decisions.
22 Symbols and their placements are @emph{generated} from a high-level
23 musical description. In other words, LilyPond would be best described
24 to be a `music compiler' or `music to notation compiler'.
26 LilyPond is linked to GUILE, GNU's Scheme library for extension
27 programming. The Scheme library provides the glue that holds together
28 the low-level routines and separate modules which are written in C++.
30 When lilypond is run to typeset sheet music, the following happens:
33 @item GUILE initialization: Various scheme files are read.
35 @item Parsing: First standard @code{ly} initialization files are read,
36 then the user @file{ly} file is read.
38 @item Interpretation: The music in the file is processed `in playing
39 order', i.e., the order that you use to read sheet music, or the
40 order in which notes are played. The result of this step is a
41 typesetting specification.
43 @item Typesetting: The typesetting specification is solved: positions
44 and formatting is calculated.
46 @item The visible results ("virtual ink") are written to the output file.
49 During these stages different types of data play the the main role:
50 During parsing, @strong{Music} objects are created. During the
51 interpretation, @strong{contexts} are constructed, and with these
52 contexts a network of @strong{graphical objects} (`grobs') is
53 created. These grobs contain unknown variables, and the network forms a
54 set of equations. After solving the equations and filling in these
55 variables, the printed output is written to an output file.
57 These threemanship of tasks (parsing, translating, typesetting) and
58 data-structures (music, context, graphical objects) permeates the entire
59 design of the program.
66 The @code{ly} file is read and converted to a list of @code{Scores}, which
67 each contain @code{Music} and paper/midi-definitions. Here @code{Music},
68 @code{Pitch}, and @code{Duration} objects are created.
70 @item Interpreting music
71 @cindex interpreting music
73 All music events are `read' in the same order as they would be played
74 (or read from paper). At every step of the interpretation, musical
75 events are delivered to interpretation contexts,
77 which use them to build @code{Grob}s (or MIDI objects for MIDI output).
79 In this stage @code{Music_iterators} do a traversal of the @code{Music}
80 structure. The music events thus encountered are reported to
81 @code{Translator}s, a set of objects that collectively form interpretation
87 At places where line breaks may occur, clefs and bars are prepared for
88 a possible line break.
93 In this stage, all information that is needed to determine line breaking
96 @item Break calculation
98 The lines and horizontal positions of the columns are determined.
102 Relations between all grobs are modified to reflect line breaks: When a
103 spanner, e.g. a slur, crosses a line break, then the spanner is `broken
104 into pieces'; for every line that the spanner is in, a copy of the grob
105 is made. A substitution process redirects all grob references so that
106 each spanner grob will only reference other grobs in the same line.
110 All vertical dimensions and spanning objects are computed, and all grobs
111 are output, line by line. The output is encoded in the form of
116 The data types that are mentioned here are all discussed in this
120 @c FIXME: Note entry vs Music entry at top level menu is confusing.
123 * Interpretation context::
124 * Syntactic details::
130 @node Interpretation context
131 @section Interpretation context
134 * Creating contexts::
136 * Context properties::
137 * Engravers and performers::
138 * Changing context definitions::
139 * Defining new contexts::
143 Interpretation contexts are objects that only exist during a run of
144 LilyPond. During the interpretation phase of LilyPond (when it prints
145 @code{interpreting music} to standard output), the music expression in
146 a @code{\score} block is interpreted in time order. This is the same
147 order that humans hear and play the music.
149 During this interpretation, the interpretation context holds the
150 state for the current point within the music. It contains information
154 @item What notes are playing at this point?
156 @item What symbols will be printed at this point?
158 @item What is the current key signature, time signature, point within
162 Contexts are grouped hierarchically: A @internalsref{Voice} context is
163 contained in a @internalsref{Staff} context (because a staff can contain
164 multiple voices at any point), a @internalsref{Staff} context is contained in
165 @internalsref{Score}, @internalsref{StaffGroup}, or
166 @internalsref{ChoirStaff} context.
168 Contexts associated with sheet music output are called @emph{notation
169 contexts}, those for sound output are called @emph{performance
170 contexts}. The default definitions of the standard notation and
171 performance contexts can be found in @file{ly/engraver-init.ly} and
172 @file{ly/performer-init.ly}, respectively.
175 @node Creating contexts
176 @subsection Creating contexts
177 @cindex @code{\context}
178 @cindex context selection
180 Contexts for a music expression can be selected manually, using the
181 following music expression.
184 \context @var{contexttype} [= @var{contextname}] @var{musicexpr}
188 This instructs lilypond to interpret @var{musicexpr} within the context
189 of type @var{contexttype} and with name @var{contextname}. If this
190 context does not exist, it will be created.
192 @lilypond[verbatim,singleline]
194 \notes \relative c'' {
195 c4 <d4 \context Staff = "another" e4> f
201 In this example, the @code{c} and @code{d} are printed on the
202 default staff. For the @code{e}, a context Staff called
203 @code{another} is specified; since that does not exist, a new
204 context is created. Within @code{another}, a (default) Voice context
205 is created for the @code{e4}. When all music referring to a
206 context is finished, the context is ended as well. So after the
207 third quarter, @code{another} is removed.
210 @node Default contexts
211 @subsection Default contexts
213 Most music expressions don't need an explicit @code{\context}
214 declaration: they inherit the notation context from their parent. Each
215 note is a music expression, and as you can see in the following example,
216 only the sequential music enclosing the three notes has an explicit context.
218 @lilypond[verbatim,singleline]
219 \score { \notes \context Voice = goUp { c'4 d' e' } }
222 There are some quirks that you must keep in mind when dealing with
225 First, every top level music is interpreted by the Score context; in other
226 words, you may think of @code{\score} working like
230 \context Score @var{music}
234 Second, contexts are created automatically to be able to interpret the
235 music expressions. Consider the following example.
237 @lilypond[verbatim, singleline]
238 \score { \context Score \notes { c'4 ( d' )e' } }
242 The sequential music is interpreted by the Score context initially
243 (notice that the @code{\context} specification is redundant), but when a
244 note is encountered, contexts are setup to accept that note. In this
245 case, a Thread, Voice, and Staff context are created. The rest of the
246 sequential music is also interpreted with the same Thread, Voice, and
247 Staff context, putting the notes on the same staff, in the same voice.
249 This is a convenient mechanism, but do not expect opening chords to work
250 without @code{\context}. For every note, a separate staff is
253 @cindex explicit context
254 @cindex starting with chords
255 @cindex chords, starting with
257 @lilypond[verbatim, singleline]
258 \score { \notes <c'4 es'> }
261 Of course, if the chord is preceded by a normal note in sequential
262 music, the chord will be interpreted by the Thread of the preceding
265 @lilypond[verbatim,singleline]
266 \score { \notes { c'4 <c'4 es'> } }
270 @node Context properties
271 @subsection Context properties
273 Notation contexts have properties. These properties are from
274 the @file{.ly} file using the following expression:
275 @cindex @code{\property}
278 \property @var{contextname}.@var{propname} = @var{value}
282 Sets the @var{propname} property of the context @var{contextname} to the
283 specified Scheme expression @var{value}. All @var{propname} and
284 @var{contextname} are strings, which are typically unquoted.
286 Properties that are set in one context are inherited by all of the
287 contained contexts. This means that a property valid for the
288 @internalsref{Voice} context can be set in the @internalsref{Score} context
289 (for example) and thus take effect in all @internalsref{Voice} contexts.
291 @cindex @code{Current}
292 If you don't wish to specify the name of the context in the
293 @code{\property}-expression itself, you can refer to the abstract context
294 name, @code{Current}. The @code{Current} context is the latest
295 used context. This will typically mean the @internalsref{Thread}
296 context, but you can force another context with the
297 @code{\property}-command. Hence the expressions
300 \property @var{contextname}.@var{propname} = @var{value}
307 \context @var{contextname}
308 \property Current.@var{propname} = @var{value}
313 The main use for this is in macros -- allowing the specification of a
314 property-setting without restriction to a specific context.
316 Properties can be unset using the following expression:
319 \property @var{contextname}.@var{propname} \unset
322 @cindex properties, unsetting
323 @cindex @code{\unset}
326 This removes the definition of @var{propname} in @var{contextname}. If
327 @var{propname} was not defined in @var{contextname} (but was inherited
328 from a higher context), then this has no effect.
332 The syntax of @code{\unset} is asymmetric: @code{\property \unset} is not
333 the inverse of @code{\property \set}.
336 @node Engravers and performers
337 @subsection Engravers and performers
341 Basic building blocks of translation are called engravers; they are
345 @node Changing context definitions
346 @subsection Changing context definitions
347 @cindex context definition
348 @cindex translator definition
350 The most common way to define a context is by extending an existing
351 context. You can change an existing context from the paper block by
352 first initializing a translator with an existing context identifier:
357 @var{context-identifier}
363 Then you can add and remove engravers using the following syntax:
366 \remove @var{engravername}
367 \consists @var{engravername}
371 Here @var{engravername} is a string, the name of an engraver in the
374 @lilypond[verbatim,singleline]
382 \remove Clef_engraver
390 You can also set properties in a translator definition. The syntax is as
394 @var{propname} = @var{value}
395 @var{propname} \set @var{grob-propname} = @var{pvalue}
396 @var{propname} \override @var{grob-propname} = @var{pvalue}
397 @var{propname} \revert @var{grob-propname}
401 @var{propname} is a string, @var{grob-propname} a symbol, @var{value}
402 and @code{pvalue} are Scheme expressions. These types of property
403 assignments happen before interpretation starts, so a @code{\property}
404 command will override any predefined settings.
406 To simplify editing translators, all standard contexts have standard
407 identifiers called @var{name}@code{Context}, e.g. @code{StaffContext},
408 @code{VoiceContext}; see @file{ly/engraver-init.ly}.
411 @node Defining new contexts
412 @subsection Defining new contexts
414 If you want to build a context from scratch, you must also supply the
415 following extra information:
418 @item A name, specified by @code{\name @var{contextname}}.
420 @item A cooperation module. This is specified by @code{\type
428 \type "Engraver_group_engraver"
431 \consists "Staff_symbol_engraver"
432 \consists "Note_head_engraver"
433 \consistsend "Axis_group_engraver"
438 The argument of @code{\type} is the name for a special engraver that
439 handles cooperation between simple engravers such as
440 @code{Note_head_engraver} and @code{Staff_symbol_engraver}. Alternatives
441 for this engraver are the following:
444 @cindex @code{Engraver_group_engraver}
446 @item @code{Engraver_group_engraver}
447 The standard cooperation engraver.
449 @cindex @code{Score_engraver}
450 @item @code{Score_engraver}
451 This is a cooperation module that should be in the top level context.
457 @item @code{\alias} @var{alternate-name}:
458 This specifies a different name. In the above example,
459 @code{\property Staff.X = Y} will also work on @code{SimpleStaff}s
461 @item @code{\consistsend} @var{engravername}:
462 Analogous to @code{\consists}, but makes sure that
463 @var{engravername} is always added to the end of the list of
466 Some engraver types need to be at the end of the list; this
467 insures they stay there even if a user adds or removes engravers.
468 End-users generally don't need this command.
470 @item @code{\accepts} @var{contextname}:
471 Add @var{contextname} to the list of contexts this context can
472 contain in the context hierarchy. The first listed context is the
473 context to create by default.
475 @item @code{\denies}:
476 The opposite of @code{\accepts}. Added for
477 completeness, but is never used in practice.
479 @item @code{\name} @var{contextname}:
480 This sets the type name of the context, e.g. @internalsref{Staff},
481 @internalsref{Voice}. If the name is not specified, the translator won't do
485 In the @code{\paper} block, it is also possible to define translator
486 identifiers. Like other block identifiers, the identifier can only
487 be used as the very first item of a translator. In order to define
488 such an identifier outside of @code{\score}, you must do
492 foo = \translator @{ @dots{} @}
499 \translator @{ \foo @dots{} @}
504 @cindex paper types, engravers, and pre-defined translators
507 @node Syntactic details
508 @section Syntactic details
509 @cindex Syntactic details
511 This section describes details that were too boring to be put elsewhere.
515 * Music expressions::
516 * Manipulating music expressions::
524 @subsection Identifiers
528 What has this section got to do with identifiers?
529 It seems more appropriate in the introduction to Chapter 4,
535 All of the information in a LilyPond input file is internally
536 represented as a Scheme value. In addition to normal Scheme data types
537 (such as pair, number, boolean, etc.), LilyPond has a number of
538 specialized data types,
549 @item Music_output_def
550 @item Moment (rational number)
553 LilyPond also includes some transient object types. Objects of these
554 types are built during a LilyPond run, and do not `exist' per se within
555 your input file. These objects are created as a result of your input
556 file, so you can include commands in the input to manipulate them,
557 during a LilyPond run.
560 @item Grob: short for `Graphical object'.
562 @item Molecule: Device-independent page output object,
563 including dimensions. Produced by some Grob functions.
565 @item Translator: An object that produces audio objects or Grobs. This is
566 not yet user-accessible.
568 @item Font_metric: An object representing a font.
572 @node Music expressions
573 @subsection Music expressions
574 @cindex music expressions
576 Music in LilyPond is entered as a music expression. Notes, rests, lyric
577 syllables are music expressions, and you can combine music expressions
578 to form new ones, for example by enclosing a list of expressions in
579 @code{\sequential @{ @}} or @code{< >}. In the following example, a
580 compound expression is formed out of the quarter note @code{c} and a
581 quarter note @code{d}:
584 \sequential @{ c4 d4 @}
587 @cindex Sequential music
588 @cindex @code{\sequential}
589 @cindex sequential music
592 @cindex Simultaneous music
593 @cindex @code{\simultaneous}
595 The two basic compound music expressions are simultaneous and
599 \sequential @code{@{} @var{musicexprlist} @code{@}}
600 \simultaneous @code{@{} @var{musicexprlist} @code{@}}
603 For both, there is a shorthand:
606 @code{@{} @var{musicexprlist} @code{@}}
613 @code{<} @var{musicexprlist} @code{>}
617 for simultaneous music.
618 In principle, the way in which you nest sequential and simultaneous to
619 produce music is not relevant. In the following example, three chords
620 are expressed in two different ways:
622 @lilypond[fragment,verbatim,center]
623 \notes \context Voice {
624 <a c'> <b d'> <c' e'>
625 < { a b c' } { c' d' e' } >
629 Other compound music expressions include
633 \transpose @var{from} @var{to} @var{expr}
634 \apply @var{func} @var{expr}
635 \context @var{type} = @var{id} @var{expr}
636 \times @var{fraction} @var{expr}
640 @c . {Manipulating music expressions}
641 @node Manipulating music expressions
642 @subsection Manipulating music expressions
644 The @code{\apply} mechanism gives you access to the internal
645 representation of music. You can write Scheme-functions that operate
646 directly on it. The syntax is
649 \apply #@var{func} @var{music}
653 This means that @var{func} is applied to @var{music}. The function
654 @var{func} should return a music expression.
656 This example replaces the text string of a script. It also shows a dump
657 of the music it processes, which is useful if you want to know more
658 about how music is stored.
660 @lilypond[verbatim,singleline]
661 #(define (testfunc x)
662 (if (equal? (ly:get-mus-property x 'text) "foo")
663 (ly:set-mus-property! x 'text "bar"))
665 (ly:set-mus-property! x 'elements
666 (map testfunc (ly:get-mus-property x 'elements)))
672 \apply #testfunc { c'4_"foo" }
676 For more information on what is possible, see the automatically
677 generated documentation.
679 Directly accessing internal representations is dangerous: The
680 implementation is subject to changes, so you should avoid this feature
683 A final example is a function that reverses a piece of music in time:
685 @lilypond[verbatim,singleline]
686 #(define (reverse-music music)
687 (let* ((elements (ly:get-mus-property music 'elements))
688 (reversed (reverse elements))
689 (span-dir (ly:get-mus-property music 'span-direction)))
690 (ly:set-mus-property! music 'elements reversed)
691 (if (ly:dir? span-dir)
692 (ly:set-mus-property! music 'span-direction (- span-dir)))
693 (map reverse-music reversed)
696 music = \notes { c'4 d'4( e'4 f'4 }
701 \apply #reverse-music \music
706 More examples are given in the distributed example files in
711 @subsection Assignments
714 Identifiers allow objects to be assigned to names during the parse
715 stage. To assign an identifier, use @var{name}@code{=}@var{value}.
716 To refer to an identifier, precede its name with a backslash:
717 `@code{\}@var{name}'. @var{value} is any valid Scheme value or any of
718 the input-types listed above. Identifier assignments can appear at top
719 level in the LilyPond file, but also in @code{\paper} blocks.
721 An identifier can be created with any string for its name, but you will
722 only be able to refer to identifiers whose names begin with a letter,
723 being entirely alphabetical. It is impossible to refer to an identifier
724 whose name is the same as the name of a keyword.
726 The right hand side of an identifier assignment is parsed completely
727 before the assignment is done, so it is allowed to redefine an
728 identifier in terms of its old value, e.g.
734 When an identifier is referenced, the information it points to is
735 copied. For this reason, an identifier reference must always be the
736 first item in a block.
741 \paperIdent % wrong and invalid
747 \paperIdent % correct
755 @subsection Lexical modes
756 @cindex Lexical modes
759 @cindex @code{\notes}
760 @cindex @code{\chords}
761 @cindex @code{\lyrics}
763 To simplify entering notes, lyrics, and chords, LilyPond has three
764 special input modes in addition to the default mode: note, lyrics, and
765 chords mode. These input modes change the way that normal, unquoted
766 words are interpreted: For example, the word @code{cis} may be
767 interpreted as a C-sharp, as a lyric syllable `cis' or as a C-sharp
768 major triad respectively.
770 A mode switch is entered as a compound music expression
773 @code{\notes} @var{musicexpr}
774 @code{\chords} @var{musicexpr}
775 @code{\lyrics} @var{musicexpr}
779 In each of these cases, these expressions do not add anything to the
780 meaning of their arguments. They just instruct the parser in what mode
781 to parse their arguments.
783 Different input modes may be nested.
788 @subsection Ambiguities
792 The grammar contains a number of ambiguities. We hope to resolve them at
803 is interpreted as the string identifier assignment. However,
804 it can also be interpreted as making a string identifier @code{\foo}
805 containing @code{"bar"}, or a music identifier @code{\foo} containing
806 the syllable `bar'. The former interpretation is chosen.
808 @item If you do a nested repeat like
817 then it is ambiguous to which @code{\repeat} the
818 @code{\alternative} belongs. This is the classic if-then-else
819 dilemma. It may be solved by using braces.
823 @c . {Lexical details}
824 @node Lexical details
825 @section Lexical details
827 Even more boring details, now on the lexical side of the input parser.
837 @subsection Direct Scheme
840 @cindex Scheme, in-line code
841 @cindex accessing Scheme
842 @cindex evaluating Scheme
845 LilyPond internally uses GUILE, a Scheme-interpreter. Scheme is a
846 language from the LISP family. You can learn more about Scheme at
847 @uref{http://www.scheme.org}. It is used to represent data throughout
848 the whole program. The hash-sign (@code{#}) accesses GUILE directly: The
849 code following the hash-sign is evaluated as Scheme. The boolean value
850 @var{true} is @code{#t} in Scheme, so for LilyPond @var{true} looks like
853 LilyPond contains a Scheme interpreter (the GUILE library) for
854 internal use. In some places, Scheme expressions also form valid syntax:
855 Wherever it is allowed,
862 evaluates the specified Scheme code. Example:
865 \property Staff.TestObject \override #'foobar = #(+ 1 2)
868 @code{\override} expects two Scheme expressions.
869 The first one is a symbol (@code{foobar}), the second one
870 an integer (namely, 3).
872 In-line Scheme may be used at the top level. In this case the result is
875 Scheme is a full-blown programming language, and a full discussion is
876 outside the scope of this document. Interested readers are referred to
877 the website @uref{http://www.schemers.org/} for more information on
885 Formed from an optional minus sign and a sequence of digits followed
886 by a @emph{required} decimal point and an optional exponent such as
887 @code{-1.2e3}. Reals can be built up using the usual operations:
888 `@code{+}', `@code{-}', `@code{*}', and
889 `@code{/}', with parentheses for grouping.
897 A real constant can be followed by one of the dimension keywords:
898 @code{\mm} @code{\pt}, @code{\in}, or @code{\cm}, for millimeters,
899 points, inches and centimeters, respectively. This converts the number
900 that is the internal representation of that dimension.
908 Begins and ends with the @code{"} character. To include a @code{"}
909 character in a string write @code{\"}. Various other backslash
910 sequences have special interpretations as in the C language. A string
911 that contains no spaces can be written without the quotes. Strings can
912 be concatenated with the @code{+} operator.
915 @c . {Output details}
917 @section Output details
919 LilyPond's default output format is @TeX{}. Using the option @option{-f}
920 (or @option{--format}) other output formats can be selected also, but
921 currently none of them reliably work.
923 At the beginning of the output file, various global parameters are defined.
924 It also contains a large @code{\special} call to define PostScript routines
925 to draw items not representable with @TeX{}, mainly slurs and ties. A DVI
926 driver must be able to understand such embedded PostScript, or the output
927 will be rendered incompletely.
929 Then the file @file{lilyponddefs.tex} is loaded to define the macros used
930 in the code which follows. @file{lilyponddefs.tex} includes various other
931 files, partially depending on the global parameters.
933 Now the music is output system by system (a `system' consists of all
934 staves belonging together). From @TeX{}'s point of view, a system is an
935 @code{\hbox} which contains a lowered @code{\vbox} so that it is centered
936 vertically on the baseline of the text. Between systems,
937 @code{\interscoreline} is inserted vertically to have stretchable space.
938 The horizontal dimension of the @code{\hbox} is given by the
939 @code{linewidth} parameter from LilyPond's @code{\paper} block (using the
940 natural line width if its value is@w{ }@minus{}1).
942 After the last system LilyPond emits a stronger variant of
943 @code{\interscoreline} only if the macro @code{\lilypondpaperlastpagefill}
944 is not defined (flushing the systems to the top of the page). You can
945 avoid that manually by saying
948 \def\lilypondpaperlastpagefill@{1@}
952 or by setting the variable @code{lastpagefill} in LilyPond's @code{\paper}
955 It is possible to fine-tune the vertical offset further by defining the
956 macro @code{\lilypondscoreshift}. Example:
959 \def\lilypondscoreshift@{0.25\baselineskip@}
963 @code{\baselineskip} is the distance from one text line to the next.
965 The code produced by LilyPond can be used by both @TeX{} and La@TeX{}.
967 Here an example how to embed a small LilyPond file @code{foo.ly} into
968 running La@TeX{} text without using the @code{lilypond-book} script
969 (@pxref{Integrating text and music with lilypond-book}).
972 \documentclass@{article@}
974 \def\lilypondpaperlastpagefill@{@}
976 \def\lilypondscoreshift@{0.25\baselineskip@}
979 This is running text which includes an example music file
985 The file @file{foo.tex} has been simply produced with
991 It is important to set the @code{indent} parameter to zero in the
992 @code{\paper} block of @file{foo.ly}.
994 The call to @code{\lineskip} assures that there is enough vertical space
995 between the LilyPond box and the surrounding text lines.