Database Module
This XQuery Module contains functions for processing databases from within XQuery. Existing databases can be opened and listed, its contents can be directly accessed, documents can be added to and removed, etc.
Conventions[edit]
All functions and errors in this module are assigned to the http://basex.org/modules/db
namespace, which is statically bound to the db
prefix.
Database Nodes[edit]
In BaseX, two internal representations exist for XML nodes:
1. Database nodes are:
- stored in a persistent database on disk;
- nodes of a document that has been generated temporarily with
fn:doc
,fn:parse-xml
and other functions; or - the result of a main-memory update.
2. Fragments are similar to DOM structures. They are created when XQuery node constructors are used (<a/>
, element a { }
, etc.).
Fragments require less memory for small XML structures, but database nodes are more efficient for larger amounts of data. Fragments nodes can be converted to database nodes by applying a main-memory update with an empty body to a node:
<xml>hello world</xml> update { }
Updating Functions[edit]
Various functions in this module are updating. Updating functions will not be immediately executed, but queued on the Pending Update List, and processed after the remaining query has been evaluated. This means that the order in which the functions are specified in the query often does not reflect the order in which they will eventually be executed.
General Functions[edit]
db:system[edit]
Signature | db:system() as element(system) |
Summary | Returns general information on the database system the current values of all global and local Options. The INFO command returns similar output.
|
db:option[edit]
Signature | db:option( $name as xs:string ) as xs:string |
Summary | Returns the current value (string, integer, boolean, map) of a global or local Option with the specified $name . The SHOW OPTIONS command returns similar output.
|
Errors | option : the specified option is unknown.
|
Examples |
|
db:info[edit]
Signature | db:info( $database as xs:string ) as element(database) |
Summary | Returns meta information on the specified $database . The output is similar to the INFO DB command.
|
Errors | open : the addressed database does not exist or could not be opened.
|
db:property[edit]
Signature | db:property( $database as xs:string, $name as xs:string ) as xs:anyAtomicType |
Summary | Returns the value (string, boolean, integer) of a property with the specified $name in the specified $database . The available properties are the ones returned by db:info .
|
Errors | property : the specified property is unknown.
|
Examples |
|
db:list[edit]
Signature | db:list( $database as xs:string := (), $path as xs:string := () ) as xs:string* |
Summary | Without arguments, the names of all databases are returned that are accessible to the current user. If $database is specified, paths to all resources of this database are returned. The results can be restricted to resources starting with the specified $path .
|
Errors | open : the addressed database does not exist or could not be opened.
|
Examples |
|
db:list-details[edit]
Signature | db:list-details( $database as xs:string := (), $path as xs:string := () ) as element()* |
Summary | Without arguments, an element is returned for each database that is accessible to the current user:
If
|
Errors | open : the addressed database does not exist or could not be opened.
|
Examples |
|
db:dir[edit]
Signature | db:dir( $database as xs:string, $path as xs:string ) as element()* |
Summary | Returns metadata on all directories and resources of a $database in the specified $path . Two types of elements are returned:
The directories are not stored in the internal database layout. Instead, they result implicitly from the paths of stored resources. |
Errors | open : the addressed database does not exist or could not be opened.path : the specified path is invalid.
|
Examples |
|
Read Operations[edit]
db:get[edit]
Signature | db:get( $database as xs:string, $path as xs:string := () ) as document-node()* |
Summary | Returns all documents from the specified $database , or only documents matching the specified $path .
|
Errors | open : the addressed database does not exist or could not be opened.
|
Examples |
|
db:get-pre[edit]
Signature | db:get-pre( $database as xs:string, $values as xs:integer* ) as node()* |
Summary | Returns all nodes from a $database with the specified PRE values in distinct document order.The PRE value provides very fast access to an existing database node, but it will change whenever a node with a smaller pre values is added to or deleted from a database. |
Errors | open : the addressed database does not exist or could not be opened.range : the specified PRE value does not exist in the database.
|
Examples |
|
db:get-id[edit]
Signature | db:get-id( $database as xs:string, $values as xs:integer* ) as node()* |
Summary | Returns all nodes from a $database with the specified ID $values in distinct document order.Each database node has a persistent ID value. Access to the node ID can be sped up by turning on the UPDINDEX option.
|
Errors | open : the addressed database does not exist or could not be opened.range : the specified ID value does not exist in the database.
|
db:get-binary[edit]
Signature | db:get-binary( $database as xs:string, $path as xs:string ) as item() |
Summary | Returns a map with the paths and binary items of all resources in the specified $database . A single xs:base64Binary item is returned if a $path is specified. All items are lazy, i.e., the actual data will only be retrieved if it is processed.
|
Errors | open : the addressed database does not exist or could not be opened.mainmem : the database is not persistent (stored on disk).
|
Examples |
|
db:get-value[edit]
Signature | db:get-value( $database as xs:string, $path as xs:string ) as item()* |
Summary | Returns a map with the paths and values of all resources in the specified $database . A single value is returned if a $path is specified.
|
Errors | open : the addressed database does not exist or could not be opened.mainmem : the database is not persistent (stored on disk).
|
Examples |
|
db:node-pre[edit]
Signature | db:node-pre( $nodes as node()* ) as xs:integer* |
Summary | Returns the PRE values of the specified $nodes , which must all be database nodes.The PRE value provides very fast access to an existing database node, but it will change whenever a node with a smaller pre values is added to or deleted from a database. |
Errors | node : $nodes contains a node which is not stored in a database.
|
Examples |
|
db:node-id[edit]
Signature | db:node-id( $nodes as node()* ) as xs:integer* |
Summary | Returns the ID values of the specified $nodes , which must all be database nodes.Each database node has a persistent ID value. Access to the node id can be sped up by turning on the UPDINDEX option.
|
Errors | node : $nodes contains a node which is not stored in a database.
|
db:export[edit]
Signature | db:export( $database as xs:string, $path as xs:string, $options as map(*)? := map { } ) as empty-sequence() |
Summary | Exports the specified $database to the specified file $path . Existing files will be overwritten.The $options argument contains serialization parameters (see fn:serialize).
|
Errors | open : the addressed database does not exist or could not be opened.
|
Examples | Export all files as text:db:export("DB", "/home/john/xml/texts", map { 'method': 'text' })
The following code can be used to export parts of the database: let $target := '/home/john/xml/target'
for $doc in db:get('DB', 'collection')
let $path := $target || db:path($doc)
return (
file:create-dir(file:parent($path)),
file:write($path, $doc)
)
|
Value Indexes[edit]
db:text[edit]
Signature | db:text( $database as xs:string, $values as xs:string* ) as text()* |
Summary | Returns all text nodes of a $database that match one of the specified $values and that are stored in the text index.
|
Errors | open : the addressed database does not exist or could not be opened.no-index : the index is not available. |
Examples |
|
db:text-range[edit]
Signature | db:text-range( $database as xs:string, $min as xs:string, $max as xs:string ) as text()* |
Summary | Returns all text nodes of a $database whose values are larger than or equal to $min and smaller than or equal to $max and that are stored in the text index.
|
Errors | open : the addressed database does not exist or could not be opened.no-index : the index is not available. |
Examples |
|
db:attribute[edit]
Signature | db:attribute( $database as xs:string, $values as xs:string*, $name as xs:string := () ) as attribute()* |
Summary | Returns all attribute nodes of a $database that match one of the specified $values and that are stored in the attribute index.If $name is specified, the resulting attribute nodes are filtered by their attribute name.
|
Errors | open : the addressed database does not exist or could not be opened.no-index : the index is not available. |
Examples |
|
db:attribute-range[edit]
Signature | db:attribute-range( $database as xs:string, $min as xs:string, $max as xs:string, $name as xs:string := () ) as attribute()* |
Summary | Returns all attributes of a $database whose values are larger than or equal to $min and smaller than or equal to $max and that are stored in the attribute index.
|
Errors | open : the addressed database does not exist or could not be opened.no-index : the index is not available. |
Examples |
|
db:token[edit]
Signature | db:token( $database as xs:string, $tokens as xs:string*, $name as xs:string := () ) as attribute()* |
Summary | Returns all attribute nodes of a $database the values of which contain one of the specified $tokens .If $name is specified, the resulting attribute nodes are filtered by their attribute name.
|
Errors | open : the addressed database does not exist or could not be opened.no-index : the index is not available. |
Examples |
|
Updates[edit]
All functions in this section are Updating Functions.
db:create[edit]
Signature | db:create( $database as xs:string, $inputs as item()* := (), $paths as xs:string* := (), $options as map(*)? := map { } ) as empty-sequence() |
Summary | Creates a new $database and adds the supplied $inputs to the specified $paths :
|
Errors | lock : a database is opened by another process.name : the specified name is not a valid database name.conflict : the same database was addressed more than once.args : the number of specified inputs and paths differs.
|
Examples |
|
db:add[edit]
Signature | db:add( $database as xs:string, $input as item(), $path as xs:string? := (), $options as map(*)? := map { } ) as empty-sequence() |
Summary | Adds the specified $input to a $database with the specified $path :
|
Errors | open : the addressed database does not exist or could not be opened.
|
Examples |
|
db:put[edit]
Signature | db:put( $database as xs:string, $input as item(), $path as xs:string, $options as map(*)? := map { } ) as empty-sequence() |
Summary | Replaces a resource, specified by $path , in a $database with the contents of $input , or adds it as a new resource:
|
Errors | open : the addressed database does not exist or could not be opened.target : the path points to a directory.
|
Examples |
The following query can be used to import files from a directory to a database: let $source := '/home/john/xml/source'
for $file in file:list($source, true())
let $path := $source || $file
where not(file:is-dir($path))
return db:put('db', doc($path), $file)
|
db:put-binary[edit]
Signature | db:put-binary( $database as xs:string, $input as item(), $path as xs:string ) as empty-sequence() |
Summary | Stores a binary resource specified by $input in a $database at the specified $path . Existing resources are overwritten.
|
Errors | open : the addressed database does not exist or could not be opened.mainmem : the database is not persistent (stored on disk).
|
Examples |
let $db := 'db'
let $src-path := 'src/'
let $trg-path := 'trg/'
for $src in db:list($db, $src-path)
where db:type($db, $src) = 'binary'
let $trg := $trg-path || substring-after($src, $src-path)
return db:put-binary($db, db:get-binary($db, $src), $trg)
|
db:put-value[edit]
Signature | db:put-value( $database as xs:string, $input as item()*, $path as xs:string ) as empty-sequence() |
Summary | Stores an $input value in a $database at the specified $path . Existing resources are overwritten. The value can be an arbitrary sequence of atomic items, nodes, maps, and arrays.
|
Errors | open : the addressed database does not exist or could not be opened.mainmem : the database is not persistent (stored on disk).
|
Examples |
db:put-value(
'factbook',
map:merge(
for $country in db:get('factbook')//country
return map:entry($country/@name, $country//city/name ! string())
),
'cities'
)
|
db:delete[edit]
Signature | db:delete( $database as xs:string, $path as xs:string ) as empty-sequence() |
Summary | Deletes resource(s), specified by $path , from the specified $database .
|
Errors | open : the addressed database does not exist or could not be opened.path : the specified path is invalid.
|
Examples |
|
db:copy[edit]
Signature | db:copy( $database as xs:string, $new-name as xs:string ) as empty-sequence() |
Summary | Creates a copy of $database , which will be called $new-name .
|
Errors | open : the addressed database does not exist or could not be opened.lock : a database is opened by another process.name : invalid database name.conflict : the same database was addressed more than once.
|
db:alter[edit]
Signature | db:alter( $database as xs:string, $new-name as xs:string ) as empty-sequence() |
Summary | Renames a $database to $new-name .
|
Errors | open : the addressed database does not exist or could not be opened.lock : a database is opened by another process.name : invalid database name.conflict : the same database was addressed more than once.
|
db:optimize[edit]
Signature | db:optimize( $database as xs:string, $all as xs:boolean? := false(), $options as map(*)? := map { } ) as empty-sequence() |
Summary | Optimizes the metadata and indexes of a $database .If $all is true , the complete database will be rebuilt.The $options argument can be used to control indexing. The syntax is identical to the db:create function: Allowed options are all indexing and full-text options. UPDINDEX is only supported if $all is true .
|
Errors | open : the addressed database does not exist or could not be opened.
|
Examples |
|
db:rename[edit]
Signature | db:rename( $database as xs:string, $source as xs:string, $target as xs:string ) as empty-sequence() |
Summary | Moves all resources(s) of a $database , which are found in the supplied $source path, to the supplied $target path. The paths may point to single resources or directories. No updates will take place if a non-existing source path is supplied.
|
Errors | open : the addressed database does not exist or could not be opened.path : the specified source or target path, or one of its descendants, is invalid.
|
Examples |
|
db:flush[edit]
Signature | db:flush( $database as xs:string ) as empty-sequence() |
Summary | Explicitly flushes the buffers of a $database . This command is only useful if AUTOFLUSH has been set to false .
|
Errors | open : the addressed database does not exist or could not be opened.
|
db:drop[edit]
Signature | db:drop( $database as xs:string ) as empty-sequence() |
Summary | Drops a $database and all connected resources.
|
Errors | open : the addressed database does not exist or could not be opened.lock : a database is opened by another process.conflict : the same database was addressed more than once.
|
Examples |
|
Backups[edit]
All functions in this section except for db:backups
are Updating Functions
.
db:create-backup[edit]
Signature | db:create-backup( $database as xs:string, $options as map(*)? := map { } ) as empty-sequence() |
Summary | Creates a backup of a $database . If no name is supplied, general data will be backed up. The following $options are available:
|
Errors | open : the addressed database does not exist or could not be opened.name : invalid database name.conflict : the same database was addressed more than once.
|
Examples |
|
db:drop-backup[edit]
Signature | db:drop-backup( $name as xs:string ) as empty-sequence() |
Summary | Drops all backups of the database with the specified $name . If the name ends with a timestamp, only the specified backup file will be deleted. If no name is supplied, backups with general data are addressed.
|
Errors | backup : No backup file found.name : invalid database name.conflict : the same database was addressed more than once.
|
Examples |
|
db:alter-backup[edit]
Signature | db:alter-backup( $name as xs:string, $new-name as xs:string ) as empty-sequence() |
Summary | Renames all backups of the database with the specified $name to $new-name . If the name ends with a date, only the specified backup file will be renamed.
|
Errors | backup : No backup file found.name : invalid database name.conflict : the same database was addressed more than once.
|
Examples |
|
db:restore[edit]
Signature | db:restore( $name as xs:string ) as empty-sequence() |
Summary | Restores the database with the specified $name . The $name may include the timestamp of the backup file. If no name is supplied, general data will be restored. If general data is restored, it will only be available after BaseX has been restarted.
|
Errors | lock : a database is opened by another process.name : invalid database name.no-backup : No backup found.conflict : the same database was addressed more than once.
|
Examples |
|
db:backups[edit]
Signature | db:backups( $database as xs:string := () ) as element(backup)* |
Summary | Returns an element sequence containing all available database backups with timestamp, file size and comment. If a $database is specified, the sequence will be restricted to the backups matching this database.
|
Examples |
|
Helper Functions[edit]
db:name[edit]
Signature | db:name( $node as node() ) as xs:string |
Summary | Returns the name of the database in which the specified database node $node is stored.
|
Errors | node : $nodes contains a node which is not stored in a database.
|
db:path[edit]
Signature | db:path( $node as node() ) as xs:string |
Summary | Returns the path of the database document in which the specified database node $node is stored.
|
Errors | node : $nodes contains a node which is not stored in a database.
|
db:exists[edit]
Signature | db:exists( $database as xs:string, $path as xs:string := () ) as xs:boolean |
Summary | Checks if a $database exists, or a resource located at $path in this database.
|
Examples |
|
db:type[edit]
Signature | db:type( $database as xs:string, $path as xs:string ) as xs:string |
Summary | Returns the type (xml , binary , value ) of a resource in a $database at the specified $path .
|
Errors | open : the addressed database does not exist or could not be opened.
|
Examples |
|
db:content-type[edit]
Signature | db:content-type( $database as xs:string, $path as xs:string ) as xs:string |
Summary | Retrieves the content-type of a resource in a $database at the specified $path .The file extension is used to recognize the content-type of a resource stored in the database. application/xml will be returned for any XML document stored in the database, regardless of its file name extension.
|
Errors | open : the addressed database does not exist or could not be opened.
|
Examples |
|
Errors[edit]
Code | Description |
---|---|
args
|
The number of specified inputs and paths differs. |
conflict
|
Multiple update operations point to the same target. |
lock
|
A database cannot be updated because it is opened by another process. |
mainmem
|
The addressed database is not persistent (stored on disk). |
name
|
The name of the specified database is invalid. |
no-backup
|
No backup exists for a database. |
node
|
The referenced XML node is no database node, i.e. it is neither stored in a database nor represented as database fragment. |
no-index
|
The database lacks an index structure required by the called function. |
open
|
The addressed database does not exist or could not be opened. |
option
|
The specified option is unknown. |
path
|
The specified database path is invalid. |
property
|
The specified database property is unknown. |
range
|
The addressed database ID or PRE value is out of range. |
target
|
Path points to an invalid target. |
Changelog[edit]
- Version 10
- Added:
db:get
,db:put
,db:type
. - Added: Backups: Support for general data (registered users, scheduled services and key-value stores).
- Updated:
db:get
,db:get-id
,db:get-pre
renamed (before:db:open
,db:open-id
,db:open-pre
) - Updated:
db:put
renamed (before:db:replace
); function signature aligned withdb:add
(second and third argument swapped). - Updated:
db:put-binary
renamed (before:db:store
); function signature aligned withdb:add
(second and third argument swapped). - Updated:
db:get-binary
renamed (before:db:retrieve
). - Updated:
db:backups
,db:create-backup
: Options added. - Removed:
db:is-raw
,db:is-raw
(new:db:type
).
- Version 9.3
- Added:
db:alter-backup
- Updated:
db:open-id
,db:open-pre
: support for multiple integers
- Version 9.2
- Version 9.0
- Added:
db:option
- Updated: db:output renamed to
update:output
, db:output-cache renamed toupdate:cache
- Updated: error codes updated; errors now use the module namespace
- Version 8.6
- Added:
db:property
- Version 8.4
- Version 8.3
- Updated:
db:list-details
: attributes with name of database and date of backup added to results. - Updated:
db:backups
now include attributes with name of database and date of backup. - Updated:
Value Indexes
: raise error if no index exists.
- Version 8.2
- Added:
db:output-cache
- Removed: db:event
- Version 7.9
- Updated: parsing options added to
db:create
,db:add
anddb:replace
. - Updated: allow
UPDINDEX
if$all
istrue
.
- Version 7.8.2
- Added:
db:alter
,db:copy
,db:create-backup
,db:drop-backup
,db:restore
- Version 7.8
- Removed: db:fulltext (use
ft:search
instead)
- Version 7.7
- Added:
db:export
,db:name
,db:path
- Updated:
$options
argument added todb:create
anddb:optimize
. - Updated: the functions no longer accept database nodes as reference. Instead, the name of a database must now be specified.
- Version 7.6
- Updated:
db:create
: allow more than one input and path.
- Version 7.5
- Updated:
db:add
: input nodes will be automatically converted to document nodes - Added:
db:backups
- Added:
db:create
- Added:
db:drop
- Version 7.3
- Added:
db:flush
- Version 7.2.1
- Added:
db:text-range
,db:attribute-range
,db:output
- Version 7.1
- Added:
db:list-details
,db:content-type
- Updated:
db:info
,db:system
,db:retrieve
- Version 7.0