blob: 06a4b09baa1ae8dac93e28cf85fa5ba224d6ee92 [file] [log] [blame]
Nils Diewald7cad8402014-07-08 17:06:56 +00001% content main => begin
2
3<h2>KorAP-Tutorial: Poliqarp+</h2>
4
Nils Diewald4e9fbcb2014-07-15 11:45:09 +00005<p><%= korap_tut_link_to 'Back to Index', '/tutorial' %></p>
6
7<p>The following tutorial introduces all features provided by our version of the Poliqarp Query Language and some KorAP specific extensions.</p>
8
9<section id="tut-segments">
Nils Diewald7cad8402014-07-08 17:06:56 +000010<h3>Simple Segments</h3>
11
12<p>The atomic elements of Poliqarp queries are segments. Most of the time segments represent words and can be simply queried:</p>
13%# footnote: In the polish national corpus, Poliqarp can join multiple segments when identifying a single word.
14
15%= korap_tut_query poliqarp => 'Baum'
16
17<p>Sequences of simple segments are expressed using a space delimiter:</p>
18
19%= korap_tut_query poliqarp => 'der Baum'
20
21<p>Simple segments always refer to the surface form of a word. To search for surface forms without case sensitivity, you can use the <code>/i</code> flag.</p>
22
23%= korap_tut_query poliqarp => 'laufen/i'
24
25<p>The query above will find all occurrences of <code>laufen</code> irrespective of the capitalization of letters, so <code>wir laufen</code> will be find as well as <code>das Laufen</code> and even <code>&quot;GEH LAUFEN!&quot;</code>.
26</section>
27
Nils Diewald4e9fbcb2014-07-15 11:45:09 +000028<section id="tut-regexp">
Nils Diewald7cad8402014-07-08 17:06:56 +000029 <h3>Regular Expressions</h3>
30
Nils Diewald4e9fbcb2014-07-15 11:45:09 +000031<p>Segments can also be queried using <%= korap_tut_link_to 'regular expressions', '/tutorial/regular-expressions' %> - by surrounding the segment with double quotes.</p>
Nils Diewald7cad8402014-07-08 17:06:56 +000032
33%= korap_tut_query poliqarp => '"l(au|ie)fen"'
34
35<p>Regular expression segments will always match the whole segment, meaning the above query will find words starting with <code>l</code> and ending with <code>n</code>. To support subqueries, you can use the <code>/x</code> flag.
36
37%= korap_tut_query poliqarp => '"l(au|ie)fen"/x', cutoff => 1
38
39<p>The <code>/x</code> will search for all segments that contain a sequence of characters the regular expression matches. That means the above query is equivalent to:</p>
40
Nils Diewaldbfcf0902014-07-15 13:36:47 +000041%= korap_tut_query poliqarp => '".*?l(au|ie)fen.*?"', cutoff => 1
Nils Diewald7cad8402014-07-08 17:06:56 +000042
43<p>The <code>/x</code> flag can also be used in conjuntion with strict expressions to search for substrings:</p>
44
45%= korap_tut_query poliqarp => 'trenn/xi', cutoff => 1
46
47<p>The above query will find all occurrences of segments including the string <code>trenn</code> case insensitive, like &quot;Trennung&quot;, &quot;unzertrennlich&quot;, or &quot;Wettrennen&quot;.</p>
48
Nils Diewald4e9fbcb2014-07-15 11:45:09 +000049<blockquote class="warning">
50 <p>Beware: These kinds of queries (with prepended <code>.*</code> expressions) are extremely slow!</p>
Nils Diewald7cad8402014-07-08 17:06:56 +000051</blockquote>
52
53<p>You can again apply the <code>/i</code> flag to search case insensitive.</p>
54
55%= korap_tut_query poliqarp => '"l(au|ie)fen"/xi', cutoff => 1
56
57</section>
58
Nils Diewald4e9fbcb2014-07-15 11:45:09 +000059<section id="tut-complex">
Nils Diewald7cad8402014-07-08 17:06:56 +000060 <h3>Complex Segments</h3>
61
Nils Diewald4e9fbcb2014-07-15 11:45:09 +000062<p>Complex segments are expressed in square brackets and contain additional information on the resource of the term under scrutiny by providing key/value pairs, separated by a <code>=</code> symbol.</p>
Nils Diewald7cad8402014-07-08 17:06:56 +000063
64<p>The KorAP implementation of Poliqarp provides three special segment keys: <code>orth</code> for surface forms, <code>base</code> for lemmata, and <code>pos</code> for Part-of-Speech. The following complex query finds all surface forms of <code>Baum</code>.</p>
65
66%# There are more special keys in Poliqarp, but KorAP doesn't provide them.
67
68%= korap_tut_query poliqarp => '[orth=Baum]'
69
70<p>The query is thus equivalent to:</p>
71
72%= korap_tut_query poliqarp => 'Baum'
73
74<p>Complex segments expect simple expressions as a values, meaning that the following expression is valid as well:</p>
75
76%= korap_tut_query poliqarp => '[orth="l(au|ie)fen"/xi]', cutoff => 1
77
Nils Diewald4e9fbcb2014-07-15 11:45:09 +000078<p>Another special key is <code>base</code>, refering to the lemma annotation of the <%= korap_tut_link_to 'default foundry', '/tutorial/foundries' %>. The following query finds all occurrences of segments annotated as the lemma <code>Baum</code> by the default foundry.</p>
Nils Diewald7cad8402014-07-08 17:06:56 +000079
Nils Diewald4e9fbcb2014-07-15 11:45:09 +000080%= korap_tut_query poliqarp => '[base=baum]'
Nils Diewald7cad8402014-07-08 17:06:56 +000081
Nils Diewald4e9fbcb2014-07-15 11:45:09 +000082<p>The third special key is <code>pos</code>, refering to the part-of-speech annotation of the <%= korap_tut_link_to 'default foundry', '/tutorial/foundries' %>. The following query finds all attributive adjectives:</p>
Nils Diewald7cad8402014-07-08 17:06:56 +000083
84%= korap_tut_query poliqarp => '[pos=ADJA]'
85
Nils Diewald4e9fbcb2014-07-15 11:45:09 +000086<p>Complex segments requesting further token annotations can have keys following the <code>foundry/layer</code> notation. For example to find all occurrences of plural words in the mate foundry, you can search using the following query:</p>
Nils Diewald7cad8402014-07-08 17:06:56 +000087
88%= korap_tut_query poliqarp => '[mate/m=number:pl]'
89
Nils Diewald4e9fbcb2014-07-15 11:45:09 +000090<blockquote class="warning">
91 <p>There is currently a bug in the serialization of this query.</p>
92 <p><strong>The following stuff in the tutorial is not yet tested.</strong></p>
93</blockquote>
94
Nils Diewald7cad8402014-07-08 17:06:56 +000095</section>
96
Nils Diewald4e9fbcb2014-07-15 11:45:09 +000097<section id="tut-spans">
Nils Diewald7cad8402014-07-08 17:06:56 +000098<h3>Span Segments</h3>
99
100%= korap_tut_query poliqarp => '<s>'
101
102</section>
103
Nils Diewald4e9fbcb2014-07-15 11:45:09 +0000104<section id="tut-paradigmatic-operators">
Nils Diewald7cad8402014-07-08 17:06:56 +0000105<h3>Paradigmatic Operators</h3>
Nils Diewald4e9fbcb2014-07-15 11:45:09 +0000106%= korap_tut_query poliqarp => '[orth=laufe/i & base=lauf]'
Nils Diewald7cad8402014-07-08 17:06:56 +0000107
Nils Diewald4e9fbcb2014-07-15 11:45:09 +0000108%= korap_tut_query poliqarp => '[orth=laufe/i & base!=lauf]'
109
110<blockquote class="warning">
111 <p>There is a bug in the Lucene backend regarding the negation of matches</p>
112</blockquote>
Nils Diewald7cad8402014-07-08 17:06:56 +0000113
114<p>The following query is equivalent</p>
115
116%= korap_tut_query poliqarp => '[orth=bäume & !base=bäumen]'
117
Nils Diewald4e9fbcb2014-07-15 11:45:09 +0000118<p>Some more ...</p>
119
Nils Diewald7cad8402014-07-08 17:06:56 +0000120%= korap_tut_query poliqarp => '[base=laufen | base=gehen]'
121
122%= korap_tut_query poliqarp => '[(base=laufen | base=gehen) & tt/pos=VVFIN]'
123
124%= korap_tut_query poliqarp => '[]'
125
126</section>
127
Nils Diewald4e9fbcb2014-07-15 11:45:09 +0000128<section id="tut-syntagmatic-operators">
Nils Diewald7cad8402014-07-08 17:06:56 +0000129<h3>Syntagmatic Operators</h3>
130
131<h4>Sequences</h4>
132
133<h4>Repetition</h4>
134%= korap_tut_query poliqarp => '[base=der][][base=Baum]'
135
136%= korap_tut_query poliqarp => '[base=der][]{2}[base=Baum]'
137%= korap_tut_query poliqarp => '[base=der][]{2,3}[base=Baum]'
138%= korap_tut_query poliqarp => '[base=der][]{2,}[base=Baum]'
139%= korap_tut_query poliqarp => '[base=der][]{,3}[base=Baum]'
140
141%= korap_tut_query poliqarp => '[base=der][tt/pos=ADJA]?[base=Baum]'
142%= korap_tut_query poliqarp => '[base=der][tt/pos=ADJA]*[base=Baum]'
143%= korap_tut_query poliqarp => '[base=der][tt/pos=ADJA]+[base=Baum]'
144
145<h4>Alternation</h4>
146
147<h4>Position Operators</h4>
148
Nils Diewald4e9fbcb2014-07-15 11:45:09 +0000149<p>contains()</p>
150<p>startsWith()</p>
151<p>endsWith()</p>
152<p>overlaps()</p>
Nils Diewald7cad8402014-07-08 17:06:56 +0000153
154<blockquote>
Nils Diewald4e9fbcb2014-07-15 11:45:09 +0000155 <p>The KorAP implementation of Poliqarp also support the postfix <code>within</code> operator, that works similar to the <code>contains()</code>, but is not nestable.</p>
Nils Diewald7cad8402014-07-08 17:06:56 +0000156</blockquote>
157
158<h4>Class Operators</h4>
159
Nils Diewald4e9fbcb2014-07-15 11:45:09 +0000160<p>{}</p>
161<p>focus()</p>
162<p>...</p>
Nils Diewald7cad8402014-07-08 17:06:56 +0000163
164</section>
165
166% end