BaseX-Talk December 2010

basex-talk@mailman.uni-konstanz.de

25 participants
40 discussions

Out of memory bug
by Ivan Lagunov 31 Jul '13

31 Jul '13

Hello, I've got 'Out of memory' error and corrupted database again, this time it's for 6.3 version. Steps: 1. Started server, started terminal client, checked there are no text and attribute indexes. 2. Started my Java application that runs several tests on database: querying, adding, removing. 3. Then I forgot to reopen terminal client and used the one that I opened in Step 1. 4. Run optimize command for the collection and got error. 5. Cannot open the collection any more as I'm getting '… [View More]

4 8

Fwd: Re: Database creation from a directory tree
by Andreas Weiler 31 Dec '10

31 Dec '10

Forwarding to mailing-list...maybe interesting for others. -------- Original-Nachricht -------- Betreff: Re: [basex-talk] Database creation from a directory tree Datum: Fri, 31 Dec 2010 16:41:05 +0100 Von: Andreas Weiler <andreas.weiler(a)uni-konstanz.de> An: david(a)leighweb.com Hi David, thanks a lot for your tests. I couldnt fix the gui bug yet...but i can help you with command line... There is a createfilter option...it can be set with: set createfilter * so all files in … [View More]the folder are recognized for creating a database. I hope this works for now, Happy new year, Andreas Am 31.12.10 15:13, schrieb David leigh: > > Andreas, > > I just did an interesting test (using the version that the windows > installer installs: 6.3.4). > > I copied my directory tree of files and in the new copy, I gave all my > data files an extension of "xml" (previously they had NO extension). > NOW, both with the command line and the GUI, the full database is > created without any problem. To double check, I went back to the old > directory with no extensions and created a new database using a filter > of "*.*" and only 14 documents were created in the database (instead > of 5000+). > > Conclusions: > > 1.In the command line you must have input documents with an extension > of "xml" since there is no visible way to provide a filter. > > 2.The GUI interfaces differently than the command line with the basex > core since it can receive a filter as well as a path in the database > creation process > > 3.The GUI filter functionality in 6.3.4 is different than in 6.1...for > me it is "broken" vs. how it works in 6.1 > > So, I think for my project to work completely, I need new > functionality: a file name filter that works correctly on the CREATE > DB statement in the command line interface. Does this sound correct > to you? > > Unfortunately, I don't have control over the extension names of my > input files as they are created by another piece of software. Until > I can do a create database in the command line, I'll have to do manual > gui-based (6.1 version) refreshes of the data or some sort of long > copy/rename process in the background. > > Thanks! > > David > > DavidEmailSig <mailto:david@leighweb.com> > > *From:*Andreas Weiler [mailto:andreas.weiler@uni-konstanz.de] > *Sent:* Wednesday, December 29, 2010 11:26 AM > *To:* david(a)leighweb.com; BaseX-Talk(a)mailman.uni-konstanz.de > *Subject:* Re: [basex-talk] Database creation from a directory tree > > Hi David, > > the syntax of the create command changed between the releases of 6.1 > and 6.3.4. > > In release 6.1 you have to use: > > create db C:\Users\David\Documents\OpenSong\songpacks\Songs songs > > Kind regards, > Andreas > > Am 28.12.10 18:00, schrieb David leigh: > > Here are my command line results from 6.3.4: > > C:\Users\David\Documents\OpenSong\OpenSongSearch\BaseX>java -cp > BaseX.jar org.basex.BaseXClient -Uadmin -Padmin > > BaseX 6.3.5 [Client] > > Try "help" to get more information. > > > drop db songs > > Database 'songs' was dropped. > > > create db song > > Database 'song' created in 1683.61 ms. > > > info index > > Tags > > - Structure: Hash > > - Entries: 0 > > Attributes > > - Structure: Hash > > - Entries: 0 > > Text Index > > - Structure: Binary tree > > - Size: 4 Bytes > > - Entries: 0 > > Attribute Index > > - Structure: Binary tree > > - Size: 4 Bytes > > - Entries: 0 > > Full-Text Index > > - Not available > > Path Summary > > doc() 1x > > > info table > > Stopped at line 1, column 10: > > Syntax: INFO ([DATABASE|INDEX|STORAGE]) > > Show information on current database. > > Shows information on the currently opened database: > > - no argument: show global information > > - DATABASE: shows database information > > - INDEX: shows index information > > - STORAGE [start end] | [query]: show internal database table > > > info storage > > PRE DIS SIZ ATS NS KIND CONTENT > > ------------------------------------- > > 0 1 1 1 0 DOC song > > > info > > General Information > > Database Path: C:\Users\David\Documents\OpenSong\OpenSongSearch\BaseX\data > > Used Main Memory: 895 KB > > Database Creation > > Whitespace Chopping: ON > > Entity Parsing: OFF > > Indexes > > Path Summary: ON > > Text Index: ON > > Attribute Index: ON > > Full-Text Index: OFF > > > > > So, for 6.3.4, it creates from the command line, but it's empty. The > root of that path has NO files in it. The 5861 files are in all the > subdirectories. > > Then, when I try the same syntax with 6.1, I get the following results: > > > create db songs C:\Users\David\Documents\OpenSong\songpacks\Songs > > Stopped at line 1, column 17: > > Syntax: CREATE [DB|COLL|FS|INDEX|USER] [...] > > Create database, index or user. > > Creates a new database, index or user: > > - DB [path] [name?]: > > creates the database [name] for the file or directory [path] > > - COLL [name]: > > creates an empty database [name] > > - INDEX [TEXT|ATTRIBUTE|FULLTEXT|PATH]: > > creates the specified index > > - FS [path] [name] ([mountpoint] [backingstore]): > > creates filesystem database [name] for [path] > > (using [mountpoint] and [backingstore] if FUSE is activated) > > - USER [name] [password?]: > > creates the specified user > > Summary: > > 6.1 GUI -- works as I want it > > 6.1 command line -- can't get it to create > > 6.3.4 GUI -- creates but with only 14 entries > > 6.3.4 command line -- creates, but it's empty > > I don't mind staying with 6.1, but I DO want to do everything with the > command line. > > Is the ADD syntax the same, in that I can simply specify the path and > it will recurse the whole directory tree? > > Thanks!!! > > David > > DavidEmailSig <mailto:david@leighweb.com> > > *From:*Andreas Weiler [mailto:andreas.weiler@uni-konstanz.de] > *Sent:* Tuesday, December 28, 2010 01:29 PM > *To:* david(a)leighweb.com <mailto:david@leighweb.com> > *Cc:* basex-talk(a)mailman.uni-konstanz.de > <mailto:basex-talk@mailman.uni-konstanz.de> > *Subject:* Re: [basex-talk] Database creation from a directory tree > > Additional question: That was in the GUI. I'd like to do the same > thing using the command line with the .JAR file, but somewhere my > syntax is not right. Additionally, all the XML files have NO > EXTENSION so I don't know how to specify that either in the > command line. So, any help in that area would also be appreciated. > > > Could you provide your syntax? > > The syntax should be: > create db dbname path/to/folder > > The missing extension shouldnt be a problem, i just tested it. > > > > In the GUI in 6.1, I can create a database from a whole directory > hierarchy of 5,681 individual XML files. When I point to the same > source file directory and using the 6.3.4 GUI (which I installed with > a pre-release version of the installer), it only processes 14 files. > No error message (that I saw) was produced. The behavior that I'm > wanting is what 6.1 does. Glad to help in solving the problem. > > We will check for modifications between the releases. As quick > workaround you could try to create an empty database and then add the > documents with the Database/Add documents menu. > > Kind regards, > Andreas > > Am 28.12.10 12:55, schrieb David leigh: > > I've just installed 6.3.4 and I've noticed a difference from version 6.1. > > In the GUI in 6.1, I can create a database from a whole directory > hierarchy of 5,681 individual XML files. When I point to the same > source file directory and using the 6.3.4 GUI (which I installed with > a pre-release version of the installer), it only processes 14 files. > No error message (that I saw) was produced. The behavior that I'm > wanting is what 6.1 does. Glad to help in solving the problem. > > Additional question: That was in the GUI. I'd like to do the same > thing using the command line with the .JAR file, but somewhere my > syntax is not right. Additionally, all the XML files have NO > EXTENSION so I don't know how to specify that either in the command > line. So, any help in that area would also be appreciated. > > Thank you, > > David > > DavidEmailSig <mailto:david@leighweb.com> > > > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de <mailto:BaseX-Talk@mailman.uni-konstanz.de> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > [View Less]

1 0

Fwd: Re: How to retrieve HTTP request parameters and use them in XQuery with BaseX
by Andreas Weiler 31 Dec '10

31 Dec '10

Forwarding to the mailing-list... -------- Original-Nachricht -------- Betreff: Re: [basex-talk] How to retrieve HTTP request parameters and use them in XQuery with BaseX Datum: Thu, 30 Dec 2010 13:59:57 +0000 Von: software developer <computer.software.developer(a)gmail.com> An: Andreas Weiler <andreas.weiler(a)uni-konstanz.de> Well, then the problem changes to 'how to pass dynamic parameters from an HTTP client to the java class in question - java class is running on a … [View More]

3 3

Cannot execute xxforms:get-request-parameter in XPL - XSLT processor
by software developer 31 Dec '10

31 Dec '10

Hi, I get the error: XPath syntax error at ... in {...get-request-parameter('quer...}: Cannot find a matching 1-argument function named { http://orbeon.org/oxf/xml/xforms}get-request-parameter(). *Note: external function calls have been disabled* when I attempt to execute a pipeline with: <p:processor name="oxf:xslt"> <p:input name="config"> <xsl:stylesheet version="2.0"> <xsl:template match="/"> <… [View More]

1 1

Multiple producers/writers for one collection and concurrency
by Jan Vlčinský (CAD) 31 Dec '10

31 Dec '10

Hi This topic was mentioned few times before, but it is key aspect of my application, so I will try anyway. *Question*: What is recommended approach for application, where exists multiple document producers which shall store/modify documents in one, share collection. *Background* - Having *feeds*, which might deliver some new messages. - *Multiple preprocessing processes* - preprocessing the messages before storing them in collection (Python, celery and RabbitMQ to be ready for … [View More]

2 4

Big recursive XQueries
by Charles F. Munat 31 Dec '10

31 Dec '10

I have a BaseX backed website which stores all the pieces of the page in the DB. There is a significant amount of processing to be done. Pretty much any piece of the page can have effective or expiration dates (so that page parts can come and go on schedule). Some pages have dynamic elements, such as a Twitter feed. The page is build from objects which are wrapped in frames (for adding temporal and styling parameters), which are inserted into columns, which go into rows, which make up a … [View More]

6 11

How to retrieve HTTP request parameters and use them in XQuery with BaseX
by software developer 30 Dec '10

30 Dec '10

Hi, eXist DB offers this facility via HTTP related functions: http://en.wikibooks.org/wiki/XQuery/Checking_for_Required_Parameters What I want to achieve is pass parameters to XQuery dynamically (not necessarily by using HTTP request parameters, although that appears to be one way of achieving this). Is that possible in BaseX; if yes, how? Thanks.

2 1

Re: [basex-talk] Database creation from a directory tree
by Andreas Weiler 29 Dec '10

29 Dec '10

Hi David, the syntax of the create command changed between the releases of 6.1 and 6.3.4. In release 6.1 you have to use: create db C:\Users\David\Documents\OpenSong\songpacks\Songs songs Kind regards, Andreas Am 28.12.10 18:00, schrieb David leigh: > > Here are my command line results from 6.3.4: > > C:\Users\David\Documents\OpenSong\OpenSongSearch\BaseX>java -cp > BaseX.jar org.basex.BaseXClient -Uadmin -Padmin > > BaseX 6.3.5 [Client] > > Try "help" to … [View More]get more information. > > > drop db songs > > Database 'songs' was dropped. > > > create db song > > Database 'song' created in 1683.61 ms. > > > info index > > Tags > > - Structure: Hash > > - Entries: 0 > > Attributes > > - Structure: Hash > > - Entries: 0 > > Text Index > > - Structure: Binary tree > > - Size: 4 Bytes > > - Entries: 0 > > Attribute Index > > - Structure: Binary tree > > - Size: 4 Bytes > > - Entries: 0 > > Full-Text Index > > - Not available > > Path Summary > > doc() 1x > > > info table > > Stopped at line 1, column 10: > > Syntax: INFO ([DATABASE|INDEX|STORAGE]) > > Show information on current database. > > Shows information on the currently opened database: > > - no argument: show global information > > - DATABASE: shows database information > > - INDEX: shows index information > > - STORAGE [start end] | [query]: show internal database table > > > info storage > > PRE DIS SIZ ATS NS KIND CONTENT > > ------------------------------------- > > 0 1 1 1 0 DOC song > > > info > > General Information > > Database Path: C:\Users\David\Documents\OpenSong\OpenSongSearch\BaseX\data > > Used Main Memory: 895 KB > > Database Creation > > Whitespace Chopping: ON > > Entity Parsing: OFF > > Indexes > > Path Summary: ON > > Text Index: ON > > Attribute Index: ON > > Full-Text Index: OFF > > > > > So, for 6.3.4, it creates from the command line, but it's empty. The > root of that path has NO files in it. The 5861 files are in all the > subdirectories. > > Then, when I try the same syntax with 6.1, I get the following results: > > > create db songs C:\Users\David\Documents\OpenSong\songpacks\Songs > > Stopped at line 1, column 17: > > Syntax: CREATE [DB|COLL|FS|INDEX|USER] [...] > > Create database, index or user. > > Creates a new database, index or user: > > - DB [path] [name?]: > > creates the database [name] for the file or directory [path] > > - COLL [name]: > > creates an empty database [name] > > - INDEX [TEXT|ATTRIBUTE|FULLTEXT|PATH]: > > creates the specified index > > - FS [path] [name] ([mountpoint] [backingstore]): > > creates filesystem database [name] for [path] > > (using [mountpoint] and [backingstore] if FUSE is activated) > > - USER [name] [password?]: > > creates the specified user > > Summary: > > 6.1 GUI -- works as I want it > > 6.1 command line -- can't get it to create > > 6.3.4 GUI -- creates but with only 14 entries > > 6.3.4 command line -- creates, but it's empty > > I don't mind staying with 6.1, but I DO want to do everything with the > command line. > > Is the ADD syntax the same, in that I can simply specify the path and > it will recurse the whole directory tree? > > Thanks!!! > > David > > DavidEmailSig <mailto:david@leighweb.com> > > *From:*Andreas Weiler [mailto:andreas.weiler@uni-konstanz.de] > *Sent:* Tuesday, December 28, 2010 01:29 PM > *To:* david(a)leighweb.com > *Cc:* basex-talk(a)mailman.uni-konstanz.de > *Subject:* Re: [basex-talk] Database creation from a directory tree > > Additional question: That was in the GUI. I'd like to do the same > thing using the command line with the .JAR file, but somewhere my > syntax is not right. Additionally, all the XML files have NO > EXTENSION so I don't know how to specify that either in the > command line. So, any help in that area would also be appreciated. > > > Could you provide your syntax? > > The syntax should be: > create db dbname path/to/folder > > The missing extension shouldnt be a problem, i just tested it. > > > In the GUI in 6.1, I can create a database from a whole directory > hierarchy of 5,681 individual XML files. When I point to the same > source file directory and using the 6.3.4 GUI (which I installed with > a pre-release version of the installer), it only processes 14 files. > No error message (that I saw) was produced. The behavior that I'm > wanting is what 6.1 does. Glad to help in solving the problem. > > We will check for modifications between the releases. As quick > workaround you could try to create an empty database and then add the > documents with the Database/Add documents menu. > > Kind regards, > Andreas > > Am 28.12.10 12:55, schrieb David leigh: > > I've just installed 6.3.4 and I've noticed a difference from version 6.1. > > In the GUI in 6.1, I can create a database from a whole directory > hierarchy of 5,681 individual XML files. When I point to the same > source file directory and using the 6.3.4 GUI (which I installed with > a pre-release version of the installer), it only processes 14 files. > No error message (that I saw) was produced. The behavior that I'm > wanting is what 6.1 does. Glad to help in solving the problem. > > Additional question: That was in the GUI. I'd like to do the same > thing using the command line with the .JAR file, but somewhere my > syntax is not right. Additionally, all the XML files have NO > EXTENSION so I don't know how to specify that either in the command > line. So, any help in that area would also be appreciated. > > Thank you, > > David > > DavidEmailSig <mailto:david@leighweb.com> > > > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de <mailto:BaseX-Talk@mailman.uni-konstanz.de> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > [View Less]

2 1

Database creation from a directory tree
by David leigh 28 Dec '10

28 Dec '10

I've just installed 6.3.4 and I've noticed a difference from version 6.1. In the GUI in 6.1, I can create a database from a whole directory hierarchy of 5,681 individual XML files. When I point to the same source file directory and using the 6.3.4 GUI (which I installed with a pre-release version of the installer), it only processes 14 files. No error message (that I saw) was produced. The behavior that I'm wanting is what 6.1 does. Glad to help in solving the problem. Additional … [View More]

2 1

Complete control from the command line
by David leigh 25 Dec '10

25 Dec '10

Hi, I'm new to basex and NOT a java person at all. I'm creating an application where a basex database is used to search for song lyrics. I'm using the autoit3 scripting language in Windows and interfacing to basex using the basex61.jar on the command line with the output file. I'm starting the server and then using the client for the queries. So far so good. The performance is amazing in both loading the database from thousands of individual XML documents and in querying the database. … [View More]

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk December 2010