This module contains functions for parsing and evaluating XQuery strings at runtime, and to run code in parallel.
The Job Functions can be used to register and run queries as separate jobs.
All functions and errors in this module are assigned to the http://basex.org/modules/xquery namespace, which is statically bound to the xquery prefix.
Updated: Allow decimal places for timeout value.
| Signature | xquery:eval(
$query as (xs:string|xs:anyURI),
$bindings as map((xs:string|xs:QName), item()*)? := {},
$options as map(*)? := {}
) as item()* |
|---|
| Summary | Evaluates the supplied $query and returns the resulting items. If the query is of type xs:anyURI, the module located at this URI will be retrieved (a relative URI will be resolved against the static base URI).
Variables and context items can be declared via $bindings. The specified keys must be QNames or strings: - If a key is a QName, it will be directly adopted as variable name.
- It a key is a string, it may be prefixed with a dollar sign. Namespaces can be specified using the Expanded QNames notation.
- If the specified string is empty, the value will be bound to the context item.
The following $options are available:
| option | default | description |
|---|
permission | – |
The query will be evaluated with the specified permissions (see User Management).
| timeout | – |
Query execution will be interrupted after the specified number of seconds.
| memory | – |
Query execution will be interrupted if the specified number of megabytes will be exceeded. This check works best if only one process is running at the same time. Moreover, please note that this option enforces garbage collection, so it will take some additional time, and it requires GC to be enabled in your JVM.
| base-uri | – |
The base-uri property for the query. Overwrites the base URI of the query; will be used when resolving relative URIs by functions such as fn:doc.
| pass | false() |
Pass on the original error info (line and column number, optional file URI).
|
|
|---|
| Errors | |
|---|
| Examples | xquery:eval("1+3") Result: 4
xquery:eval(xs:anyURI('cleanup.xq')) If a URI is supplied, the query in the specified file will be evaluated.
xquery:eval("//country", { '': db:get('factbook') }) You can bind the context and operate on a certain database only, for example.
xquery:eval(".", { '': 'XML' }),
xquery:eval(
"declare variable $xml external; $xml",
{ 'xml': 'XML' }
),
xquery:eval(
"declare namespace pref='URI';
declare variable $pref:xml external;
$pref:xml",
{ '{URI}xml': 'XML' }
) The expressions use strings as keys. All of them return XML.
declare namespace pref = 'URI';
xquery:eval(
"declare variable $xml external; $xml",
{ #xml: 'XML' }
),
let $query := "declare namespace pref='URI';
declare variable $pref:xml external;
$pref:xml"
let $vars := { #pref:xml: 'XML' }
return xquery:eval($query, $vars) The expressions use QNames as keys. All of them return 'XML'. |
|---|
| Signature | xquery:eval-update(
$query as (xs:string|xs:anyURI),
$bindings as map((xs:string|xs:QName), item()*)? := (),
$options as map(*)? := ()
) as item()* |
|---|
| Summary | Evaluates a query as updating expression. All updates will be added to the Pending Update List of the main query and performed after the evaluation of the main query. The rules for all arguments are the same as for xquery:eval. |
|---|
| Errors | |
|---|
| Examples | xquery:eval-update("
delete node db:get('tmp')/*,
update:output('TEMPORARY DATABASE WAS CLEANED UP')
") Removes entries from a temporary databases and returns an info string. |
|---|
| Signature | xquery:parse(
$query as (xs:string|xs:anyURI),
$options as map(*)? := {}
) as item()? |
|---|
| Summary | Parses the specified $query as XQuery module and returns the resulting query plan. If the query is of type xs:anyURI, the module located at this URI will be retrieved (a relative URI will be resolved against the static base URI). The following $options are available:
| option | default | description |
|---|
compile | false() |
Additionally compile the query after parsing it.
| plan | true() |
Return an XML representation of the internal query plan. Note that the naming of the expressions in the query plan may change over time.
| pass | false() |
If an error is raised, the line/column number and the optional file uri will refer to the location of the function call. If the option is enabled, the line/column and file uri will be adopted from the raised error.
| base-uri | – |
The base-uri property for the query. This URI will be used when resolving relative URIs by functions such as fn:doc.
|
|
|---|
| Examples | xquery:parse("1 + 3") The result:<MainModule updating="false">
<QueryPlan compiled="false" updating="false">
<Arith op=" " type="xs:anyAtomicType?">
<Int type="xs:integer" size="1">1</Int>
<Int type="xs:integer" size="1">3</Int>
</Arith>
</QueryPlan>
</MainModule>
|
|---|
Parallel query execution is recommended if you have various calls that require a lot of time, but that cannot be sped up by rewriting the code. This is the case, for example, if external URLs are called. If you are parallelizing local data reads (such as the access to a database), single-threaded queries will usually be faster, because parallelized access to disk data often results in randomized access patterns, which will rarely be optimized by the caching strategies of HDDs, SSDs, or the operating system.
Added: New function.
| Signature | xquery:for-each(
$input as item()*,
$action as fn(item()) as item()*,
$options as map(*)? := {}
) as item()* |
|---|
| Summary | This function applies the supplied (non-updating) $action to every item of $input in parallel and returns the results in input order. It is the parallel counterpart of fn:for-each and saves you from wrapping each call in a separate function item. If $action accepts a second argument, it is supplied the 1-based position of the item. The same $options as for xquery:fork-join are available. |
|---|
| Errors | error | An unexpected error occurred. |
|
|---|
| Examples | xquery:for-each(
1 to 100,
fn($segment) { http:send-request((), 'http://url.com/path/' || $segment) },
{ 'parallel': 8 }
) Requests 100 URLs, use at most 8 parallel threads.
xquery:for-each(1 to 5, fn($n) { $n * $n }) Returns the squares (1, 4, 9, 16, 25), computed in parallel. |
|---|
Updated: report and timeout options added.
| Signature | xquery:fork-join(
$functions as fn(*)*,
$options as map(*)? := {}
) as item()* |
|---|
| Summary | This function executes the supplied (non-updating) $functions in parallel and returns the results in the order of the input functions. The following $options are available:
| option | default | description |
|---|
parallel | – |
Maximum number of parallel threads. If a positive value is supplied, a dedicated thread pool of this size is created. If the value is smaller than 1, or if the option is omitted, the shared thread pool with the default level of parallelism (usually the number of available processors) is used.
| results | true() |
Suppress or return the function results.
| errors | true() |
Ignore or raise errors.
| report | false() |
Return the outcome of every function as a record, in input order: a successful result as { 'value': … }, and a caught error as { 'error': … }. The error is the standard error map (the same map that a try/catch clause exposes as $err:map), with keys such as code, description, value, module, line-number, column-number, and stack-trace. With this option enabled, all errors are caught and all outcomes are reported, so the errors and results options have no effect.
| timeout | 0 |
Maximum execution time in seconds; decimal values are allowed. If the timeout is exceeded, all branches are cancelled and an xquery:timeout error is raised. A value of 0 disables the timeout.
|
If errors are ignored (errors: false()), the results of failing functions are dropped, and the returned sequence is no longer aligned with the input functions. Enable report to keep this assignment. |
|---|
| Errors | error | An unexpected error occurred. |
|
|---|
| Examples | xquery:fork-join(
for $segment in 1 to 100
let $url := 'http://url.com/path/' || $segment
return fn() { http:send-request((), $url) },
{ 'parallel': 8 }
) Requests 100 URLs, use at most 8 parallel threads.
let $f := fn() { prof:sleep(1000) }
return xquery:fork-join(($f, $f)) Parallel sleep function calls. The function is expected to finish in 1 second if the system has at least 2 cores.
xquery:fork-join(
(true#0, error#0, false#0),
{ 'report': true() }
) Returns one record per function: { 'value': true() }, { 'error': { 'code': #err:FOER0000, 'description': '…', … } }, { 'value': false() }. |
|---|
Added: New function.
| Signature | xquery:fork-any(
$functions as fn(*)*,
$options as map(*)? := {}
) as item()* |
|---|
| Summary | This function executes the supplied (non-updating) $functions in parallel and returns the result of the first one that finishes successfully; the remaining branches are cancelled. If all functions raise an error, the function fails as well. This is useful for redundant requests, such as querying several mirrors and using the fastest response. As the winning branch is not deterministic, only the parallel and timeout $options (see xquery:fork-join) are evaluated. |
|---|
| Errors | error | An unexpected error occurred. |
|
|---|
| Examples | xquery:fork-any(
for $url in ('https://mirror1.example/data', 'https://mirror2.example/data')
return fn() { http:send-request((), $url) }
) Sends a request to two mirrors in parallel and returns the response that arrives first. |
|---|
Added: New function.
| Signature | xquery:reduce(
$input as item()*,
$init as item()*,
$action as fn(item()*, item()) as item()*,
$combine as fn(item()*, item()*) as item()*,
$options as map(*)? := {}
) as item()* |
|---|
| Summary | This function aggregates $input in parallel (map-reduce). The sequence is split into chunks; each chunk is folded sequentially with $action, starting from $init (as with fn:fold-left), and the partial results are merged with the associative $combine function. For the result to be deterministic, $combine must be associative and $init must be its identity (neutral element). If $input is empty, $init is returned. Only the parallel and timeout $options (see xquery:fork-join) are evaluated. |
|---|
| Errors | error | An unexpected error occurred. |
|
|---|
| Examples | xquery:reduce(1 to 1000000, 0, op('+'), op('+')) Computes the sum 1 + 2 + … + 1000000 = 500000500000 in parallel. |
|---|
| Code | Description |
|---|
error | An unexpected error occurred. |
memory | Query execution exceeded memory limit. |
nested | Nested query evaluation is not allowed. |
permission | Insufficient permissions for evaluating the query. |
timeout | Query execution exceeded timeout. |
update | updating expression found or expected. |
Version 13.0Version 11Version 10- Updated:
xquery:parse: $query can additionally be of type xs:anyURI. - Deleted: xquery:parse-uri (merged with
xquery:parse)
Version 9.2Version 9.0- Added:
xquery:invoke-update - Updated:
xquery:eval: pass option added - Updated:
xquery:parse, xquery:parse-uri: base-uri option added - Updated: xquery:update renamed to
xquery:eval-update - Updated: error codes updated; errors now use the module namespace
Version 8.5Version 8.4- Added:
xquery:parse-uri - Updated:
xquery:parse: pass option added
Version 8.0- Added: xquery:update,
xquery:parse - Deleted: xquery:evaluate (opened databases will now be closed by main query)
Version 7.8.2Version 7.8- Added:
xquery:evaluate - Updated: used variables must be explicitly declared in the query string.
Version 7.3- Added: New module added. Functions have been adopted from the obsolete Utility Module.