February 2020 - BaseX-Talk - mailman.uni-konstanz.de

Should it be possible to declare a function in the client?
by Ben Engbers 27 Feb '20

27 Feb '20

Hi, My RBaseX client is finally stable enough to use it for real development. All regular commands are executed without errors. But now I am facing another problem. In a client-session, I want to use the following function: fn_get_words_txt <- "declare function local:cloudWords( $Veld as xs:string) as xs:string* { let $base := collection('IncidentRemarks/Incidents')/csv/record let $txt := string-join( $base/*[name() = $Veld]/text(), ' ') let $words := tokenize($txt,'(\\s|[,.!:;]|[n][b][s][p][;])+') return ($words)};" (Doubling the '\' in the regular expression-string is R-specific.) Session$Execute(fn_get_words_txt) returns: Gestopt bij , 1/8: Onbekend commando: declare. Probeer 'help'. Error in Session$Execute(fn_get_words_txt) : Gestopt bij , 1/8: Onbekend commando: declare. Probeer 'help'. fn_get_words_Query <- Session$Query(fn_get_words_txt) fn_get_words_Query$queryObject$ExecuteQuery() returns: Error in private$default_query_pattern(match.call()[[1]]) : Gestopt bij ., 5/20: [XPST0003] Expecting expression. Since fn_get_words_txt neither represents a regular command nor a regular function-all, I understand these errors. Before I even start trying to implement this in my package, my question is if it should be able to create local functions for that session? If so, any idea how to tackle this problem? Could the problem be genaralized to the question how a prolog can be added or changed? Cheers, Ben

3 6

Re: [basex-talk] Deactivate JSON escape
by Johannes Bauer 27 Feb '20

27 Feb '20

Am 27.02.2020 um 08:25 schrieb Johannes Bauer: > Am 27.02.2020 um 08:15 schrieb Martin Honnen: >> Am 27.02.2020 um 07:49 schrieb Johannes Bauer: >>> I'm trying to deactivate the escaping of characters for JSON >>> serialization. >>> >>> It does not work with this: >>> >>> let $json := <map xmlns="http://www.w3.org/2005/xpath-functions"> >>> <string key="url">http://some.url/path/to/somewhere</string></map> >>> return json:serialize($json, map {'format' : 'basic', 'escape': 'no'}) >>> >>> Output: >>> { >>> "url":"http:\/\/some.url\/path\/to\/somewhere" >>> } >> >> Does >> >> serialize(<map xmlns="http://www.w3.org/2005/xpath-functions"> >> <string key="url">http://some.url/path/to/somewhere</string></map>, >> map { 'method' : 'json', 'use-character-maps' : map { '/' : '/'}}) >> >> do what you want? >> unfortunately no, I still get the "\/" in the output with: serialize( <map xmlns="http://www.w3.org/2005/xpath-functions"> <string key="url">http://some.url/path/to/somewhere</string> </map>, map {'method': 'json', 'use-character-maps': map { '/' : '/'}, 'json': map {'format' : 'basic'}} ) Johannes

3 3

Deactivate JSON escape
by Johannes Bauer 27 Feb '20

27 Feb '20

Hi, I'm trying to deactivate the escaping of characters for JSON serialization. It does not work with this: let $json := <map xmlns="http://www.w3.org/2005/xpath-functions"> <string key="url">http://some.url/path/to/somewhere</string></map> return json:serialize($json, map {'format' : 'basic', 'escape': 'no'}) Output: { "url":"http:\/\/some.url\/path\/to\/somewhere" } If I use the other JSON format it works: json:serialize(<json type='object'><url>http://some.url/path/to/somewhere</url></json>, map { "escape" : "no"}) Output: { "url":"http://some.url/path/to/somewhere" } Is the "escape" parameter not supported for the basic format? Best regards Johannes

2 1

Dynamic evaluation?
by Ben Engbers 26 Feb '20

26 Feb '20

Hi, I want to declare a function that can operate on various elements of a record. It should be possible to pass the element-name as parameter to the function. I tried this: declare function local:cloudWords( $Veld as xs:string ) as xs:string* { let $base := collection('IncidentRemarks/Incidentsv')/csv/record let $txt := string-join( $base/$Veld/text(), " ") let $words := tokenize($txt,'(\s|[,.!:;]|[n][b][s][p][;])+') return ($words) }; let $retValue := local:cloudWords("INC_RM") return $retValue But I get this error: [XPTY0019] text(): node expected, xs:string found: "INC_RM". Should I use xquery:eval to transform "$base/$Veld/text()" into "$base/INC_RM/text()" Ben

3 2

BaseX GUI language settings
by Ben Engbers 26 Feb '20

26 Feb '20

Hi, My default language for basexgui is Dutch but I want to create screenshots from a GUI that uses English. How can I switch the language temporarily? Cheers, Ben

2 1

update:apply, Context is undeclared. (Newbie)
by Ben Engbers 20 Feb '20

20 Feb '20

Hi, I have a database that contains several thousand records with elements that I will never need so I want to remove them. The following code snippet returns the expected element: import module namespace functx = 'http://www.functx.com'; let $p := collection("Patterns/nl-verbs.csv")/csv/record[1] let $remove := ("onbekend1", "onbekend2", "onbekend3", "onbekend4") return functx:remove-elements($p, $remove) I tried to use update:apply to update the database but when I execute the following function, I get this message: [XPDY0002] element(functx:remove-elements): Context is undeclared import module namespace functx = 'http://www.functx.com'; declare %updating function local:clean_verbs( $old as node(), $rem as xs:string* ) as empty-sequence() { update:apply(functx:remove-elements, [$old, $rem]) }; let $p := collection("Patterns/nl-verbs.csv")/csv/record[1] let $remove := ("onbekend1", "onbekend2", "onbekend3", "onbekend4") return local:clean_verbs($p, $remove) I have two questions: 1: If I want to use the update module, how should I provide the context to the query? 2: How can I update all records without making use of update:apply or update:for-each (what is the befit of the update-module)? Cheers, Ben

2 2

how to store a result in a database?
by thufir 20 Feb '20

20 Feb '20

While I can certainly output the result to a file, and then add to a database, how would I actually send the result directly to a database? xquery version "3.0"; <xml> { for $line in db:open("people.json")//text() return if (matches($line, "[0-9]")) then <data>{$line}</data> else <record>{$line}</record> } </xml> Currently I'm running it like so: thufir@dur:~/flwor/people.json$ thufir@dur:~/flwor/people.json$ basex all.xq > all.xml thufir@dur:~/flwor/people.json$ thufir@dur:~/flwor/people.json$ basex BaseX 9.0.1 [Standalone] Try 'help' to get more information. > > create database people.all Database 'people.all' created in 234.74 ms. > > set parser xml PARSER: xml > > add all.xml Resource(s) added in 377.43 ms. > > exit Have fun. thufir@dur:~/flwor/people.json$ but that's a bit cumbersome. thanks, Thufir

3 3

empty tags when grouping with tumbling window?
by thufir 20 Feb '20

20 Feb '20

I found (another) wrinkle to parsing this data because blank lines seem to cause a problem with the grouping. The grouping should "use a tumbling window which starts with any line not containing any ASCII digit (the name of the person) followed by any line containing at least one ASCII digit (i.e. the data lines)": current output: <xml> <person> <name>joe</name> <data>phone1</data> <data>phone2</data> <data>phone3</data> <data>sue</data> <data/> <data>cell4</data> <data/> <data>home5</data> <data/> <data>ph3</data> </person> <person> <name>alice</name> <data>atrib6</data> <data>x7</data> <data>y9</data> <data>z10</data> </person> </xml> where "joe" and "sue" have been put into the same person tag. desired output, more like: <?xml version="1.0" encoding="UTF-8"?> <xml> <person> <name>joe</name> <data>phone1</data> <data>phone2</data> <data>phone3</data> </person> <person> <name>sue</name> <data>cell4</data> <data>home5</data> </person> <person> <name>alice</name> <data>atrib6</data> <data>x7</data> <data>y9</data> <data>z10</data> </person> </xml> xquery: xquery version "3.0"; declare namespace output = "http://www.w3.org/2010/xslt-xquery-serialization"; declare option output:method 'xml'; declare option output:indent 'yes'; declare variable $input := <text> <line>people</line> <line>joe</line> <line>phone1</line> <line>phone2</line> <line>phone3</line> <line>sue</line> <line/> <line>cell4</line> <line/> <line>home5</line> <line/> <line>ph3</line> <line>alice</line> <line>atrib6</line> <line>x7</line> <line>y9</line> <line>z10</line> </text>; <xml> { for tumbling window $person in $input//line start $name next $data when matches($name, '^[^0-9]+$') and matches($data, '[0-9]') return <person> { <name>{ data($name) }</name>, tail($person) ! <data>{data()}</data> } </person> } </xml> Provided the grouping is correct that would be the main goal. Unfortunately, don't fully understand how the tumbling window works as of yet, so reviewing that section of a text book. see also: https://stackoverflow.com/q/60237739/262852 thanks, Thufir

1 0

increment a variable only when a conditional is true?
by thufir 20 Feb '20

20 Feb '20

How can I increment the x variable only when numerical is false? (I've been reading how xquery isn't iterative...) current output: <xml> <person id="1" x="0" numerical="false">people</person> <person id="2" x="0" numerical="false">joe</person> <person id="3" x="0" numerical="true">phone1</person> <person id="4" x="0" numerical="true">phone2</person> <person id="5" x="0" numerical="true">phone3</person> <person id="6" x="0" numerical="false">sue</person> <person id="7" x="0" numerical="true">cell4</person> <person id="8" x="0" numerical="true">home5</person> <person id="9" x="0" numerical="false">alice</person> <person id="10" x="0" numerical="true">atrib6</person> <person id="11" x="0" numerical="true">x7</person> <person id="12" x="0" numerical="true">y9</person> <person id="13" x="0" numerical="true">z10</person> </xml> desired output: <xml> <person id="1" x="1" numerical="false">people</person> <person id="2" x="2" numerical="false">joe</person> <person id="3" x="2" numerical="true">phone1</person> <person id="4" x="2" numerical="true">phone2</person> ... </xml> Maybe with a second xquery? Here's the first: xquery version "3.0"; <xml> { variable $x:=0; for $line in db:open("foo.txt")//text() count $id return if (matches($line, "[0-9]")) then <person id='{$id}' x='{$x}' numerical="true">{$line}</person> else <person id='{$id}' x='{$x}' numerical="false">{$line}</person> } </xml> where I'm trying to use attributes because I'm not sure how to conditionally nest tags. But, this is interesting. Not quite sure on syntax to set and then conditionally increment $x, however. thanks, Thufir

3 7

how to nest tags using a conditional
by thufir 19 Feb '20

19 Feb '20

How can I start a new "record" and then nest tags in that record? but I'm getting output like: <xml> <record> if (matches($line, "[0-9]")) then <data>people</data> else <name>people</name> </record> <record> if (matches($line, "[0-9]")) then <data>joe</data> else <name>joe</name> </record> .. wheras I just want output like: <record> <name>joe</name> <data>123</data> </record> the query: xquery version "3.0"; <xml> { for $line in db:open("foo.txt")//text() return <record> if (matches($line, "[0-9]")) then <data>{$line}</data> else <name>{$line}</name> </record> } </xml> I think it's a matter of using the () and {} correctly. Pardon, yes, I'm literally reading a book on this, still trying to understand the syntax. thanks, Thufir

2 2