Setting multiple CSV EXPORTER options is not documented on docs.basex.org

Monday, 30 September 2024 · 6 messages · last reply 3 Oct 2024
OS
Omar Siam30 Sep 2024 16:04 #
Hi, I just tried after some time to script a CSV export with a BXS file. I forgot how to set multiple options for the csv serialization. In the end this worked: <set option="EXPORTER">method=csv,csv=header=true,,lax=false,,quotes=true</set> I can not find it on docs.basex.org. Perhaps this should be added and explained. Best regards
-- Mag. Ing. Omar Siam Austrian Center for Digital Humanities and Cultural Heritage Österreichische Akademie der Wissenschaften | Austrian Academy of Sciences Stellvertretende Behindertenvertrauensperson | Deputy representative for disabled persons Bäckerstraße 13, 1010 Wien, Österreich | Vienna, Austria T: +43 1 51581-7295 omar.siam at oeaw.ac.at | www.oeaw.ac.at/acdh
CG
Christian Grün1 Oct 2024 10:41 #
Hi Omar, Thanks for the observation. For the SERIALIZER option, there was a corresponding note which I have added to the EXPORTER option, along with a little example for exporting CSV [1]. Best, Christian [1] https://docs.basex.org/main/Options#exporter
Quoted text · Omar Siam · 24 lines
On Mon, Sep 30, 2024 at 4:04 PM Omar Siam <Omar.Siam at oeaw.ac.at> wrote: > Hi, > > I just tried after some time to script a CSV export with a BXS file. I > forgot how to set multiple options for the csv serialization. In the end > this worked: > <set > option="EXPORTER">method=csv,csv=header=true,,lax=false,,quotes=true</set> > I can not find it on docs.basex.org. Perhaps this should be added and > explained. > > Best regards > > -- > Mag. Ing. Omar Siam > Austrian Center for Digital Humanities and Cultural Heritage > Österreichische Akademie der Wissenschaften | Austrian Academy of Sciences > Stellvertretende Behindertenvertrauensperson | Deputy representative for > disabled persons > Bäckerstraße 13, 1010 Wien, Österreich | Vienna, Austria > T: +43 1 51581-7295 > omar.siam at oeaw.ac.at | www.oeaw.ac.at/acdh > >
OA
Owen Ambur2 Oct 2024 18:12 #
I'm not sure how this exchange might relate but my developer has provided CSV export capabilities for query results listings at https://search.aboutthem.info/ Any comments or suggestions on how we might enhance the functionality of our StratML-enabled query service would be most welcome. Owen Amburhttps://www.linkedin.com/in/owenambur/
Quoted text · Christian Grün · 1 line
On Tuesday, October 1, 2024 at 04:42:12 AM EDT, Christian Grün <christian.gruen at gmail.com> wrote:
Hi Omar, Thanks for the observation. For the SERIALIZER option, there was a corresponding note which I have added to the EXPORTER option, along with a little example for exporting CSV [1]. Best,Christian [1] https://docs.basex.org/main/Options#exporter
Quoted text · Omar Siam · 1 line
On Mon, Sep 30, 2024 at 4:04 PM Omar Siam <Omar.Siam at oeaw.ac.at> wrote:
Hi, I just tried after some time to script a CSV export with a BXS file. I forgot how to set multiple options for the csv serialization. In the end this worked: <set option="EXPORTER">method=csv,csv=header=true,,lax=false,,quotes=true</set> I can not find it on docs.basex.org. Perhaps this should be added and explained. Best regards
-- Mag. Ing. Omar Siam Austrian Center for Digital Humanities and Cultural Heritage Österreichische Akademie der Wissenschaften | Austrian Academy of Sciences Stellvertretende Behindertenvertrauensperson | Deputy representative for disabled persons Bäckerstraße 13, 1010 Wien, Österreich | Vienna, Austria T: +43 1 51581-7295 omar.siam at oeaw.ac.at | www.oeaw.ac.at/acdh
CG
Christian Grün2 Oct 2024 18:17 #
Hi Owen, Is it based on the BaseX XQuery CSV Module? Best, Christian
Quoted text · Owen Ambur · 54 lines
Owen Ambur <owen.ambur at verizon.net> schrieb am Mi., 2. Okt. 2024, 18:12: > I'm not sure how this exchange might relate but my developer has provided > CSV export capabilities for query results listings at > https://search.aboutthem.info/ > > Any comments or suggestions on how we might enhance the functionality of > our StratML-enabled query service would be most welcome. > > Owen Ambur > https://www.linkedin.com/in/owenambur/ > > > On Tuesday, October 1, 2024 at 04:42:12 AM EDT, Christian Grün < > christian.gruen at gmail.com> wrote: > > > Hi Omar, > > Thanks for the observation. For the SERIALIZER option, there was a > corresponding note which I have added to the EXPORTER option, along with > a little example for exporting CSV [1]. > > Best, > Christian > > [1] https://docs.basex.org/main/Options#exporter > > > > On Mon, Sep 30, 2024 at 4:04 PM Omar Siam <Omar.Siam at oeaw.ac.at> wrote: > > Hi, > > I just tried after some time to script a CSV export with a BXS file. I > forgot how to set multiple options for the csv serialization. In the end > this worked: > <set > option="EXPORTER">method=csv,csv=header=true,,lax=false,,quotes=true</set> > I can not find it on docs.basex.org. Perhaps this should be added and > explained. > > Best regards > > -- > Mag. Ing. Omar Siam > Austrian Center for Digital Humanities and Cultural Heritage > Österreichische Akademie der Wissenschaften | Austrian Academy of Sciences > Stellvertretende Behindertenvertrauensperson | Deputy representative for > disabled persons > Bäckerstraße 13, 1010 Wien, Österreich | Vienna, Austria > T: +43 1 51581-7295 > omar.siam at oeaw.ac.at | www.oeaw.ac.at/acdh > >
OA
Owen Ambur2 Oct 2024 19:24 #
Naval, can you answer Christian's question? My sense is that a lot of features have been built into BaseX that we could use but I don't have the knowledge or expertise to understand how best to do so. At least, I hope we're not reinventing capabilities that are already available to address our technical objectives as well as our broader conceptual objectives. Christian, this morning we had a very encouraging Zoom meeting with folks at GSA who are finally getting around to figuring out how to help Uncle Sam's agencies comply with section 10 of the GPRA Modernization Act. I encouraged them not to reinvent the StratML schemas and it would be great if the BaseX community could help us demonstrate the benefits of using them, not only by U.S. federal agencies but agencies at all levels of government, worldwide, as well as tax-favored organizations and others whose plans and reports should be matters of public record. There are >5.8K plans in the StratML collection and indexed in the query service. Their URLs are listed in sitemap format at https://stratml.us/docs/sitemap.xml I am contemplating whether to hire someone to convert the relevant elements of the IRS Form 990 database to StratML format, using the templates at https://stratml.us/drybridge/index.htm#MPR4CO However, I wonder how BaseX might deal with more than a million records. Owen Amburhttps://www.linkedin.com/in/owenambur/
Quoted text · Christian Grün · 1 line
On Wednesday, October 2, 2024 at 12:18:16 PM EDT, Christian Grün <christian.gruen at gmail.com> wrote:
Hi Owen, Is it based on the BaseX XQuery CSV Module? Best, Christian
Quoted text · Christian Grün · 1 line
Owen Ambur <owen.ambur at verizon.net> schrieb am Mi., 2. Okt. 2024, 18:12:
I'm not sure how this exchange might relate but my developer has provided CSV export capabilities for query results listings at StratML | | | | StratML | | | Any comments or suggestions on how we might enhance the functionality of our StratML-enabled query service would be most welcome. Owen Amburhttps://www.linkedin.com/in/owenambur/
Quoted text · Christian Grün · 1 line
On Tuesday, October 1, 2024 at 04:42:12 AM EDT, Christian Grün <christian.gruen at gmail.com> wrote:
Hi Omar, Thanks for the observation. For the SERIALIZER option, there was a corresponding note which I have added to the EXPORTER option, along with a little example for exporting CSV [1]. Best,Christian [1] https://docs.basex.org/main/Options#exporter
Quoted text · Omar Siam · 1 line
On Mon, Sep 30, 2024 at 4:04 PM Omar Siam <Omar.Siam at oeaw.ac.at> wrote:
Hi, I just tried after some time to script a CSV export with a BXS file. I forgot how to set multiple options for the csv serialization. In the end this worked: <set option="EXPORTER">method=csv,csv=header=true,,lax=false,,quotes=true</set> I can not find it on docs.basex.org. Perhaps this should be added and explained. Best regards
-- Mag. Ing. Omar Siam Austrian Center for Digital Humanities and Cultural Heritage Österreichische Akademie der Wissenschaften | Austrian Academy of Sciences Stellvertretende Behindertenvertrauensperson | Deputy representative for disabled persons Bäckerstraße 13, 1010 Wien, Österreich | Vienna, Austria T: +43 1 51581-7295 omar.siam at oeaw.ac.at | www.oeaw.ac.at/acdh
CG
Christian Grün3 Oct 2024 15:29 #
Hi Navel,
Quoted text · Owen Ambur · 1 line
> BaseX Xquery CSV module is for dealing with CSV files which we don't have.
With this module, you can serialize XML data as CSV (and parse CSV back to XML). But that’s certainly just one way to do it. Hi Owen,
Quoted text · Owen Ambur · 1 line
> However, I wonder how BaseX might deal with more than a million records.
Feel free to get back to us once you encounter any limits. Best, Christian
Quoted text · Owen Ambur · 124 lines
Naval Sarda <nsarda at epicomm.net> schrieb am Do., 3. Okt. 2024, 14:45: > Hi Owen, Christian, > > We are working on Stratml files which are in XML format. BaseX Xquery CSV > module is for dealing with CSV files which we don't have. > > We can scale up BaseX by adding more servers and splitting the data > between more servers if the record counts goes high. > > Naval > > > On 02/10/24 10:54 pm, Owen Ambur wrote: > > Naval, can you answer Christian's question? > > My sense is that a lot of features have been built into BaseX that we > could use but I don't have the knowledge or expertise to understand how > best to do so. At least, I hope we're not reinventing capabilities that > are already available to address our technical objectives > <https://aboutthem.info/SQS.xml> as well as our broader conceptual > objectives <https://aboutthem.info/ATI.xml>. > > Christian, this morning we had a very encouraging Zoom meeting with folks > at GSA who are finally getting around to figuring out how to help Uncle > Sam's agencies comply with section 10 > <https://www.linkedin.com/pulse/trustworthy-institutions-owen-ambur/> of > the GPRA Modernization Act. I encouraged them not to reinvent the StratML > schemas and it would be great if the BaseX community could help us > demonstrate the benefits of using them, not only by U.S. federal agencies > but agencies at all levels of government, worldwide, as well as tax-favored > organizations and others whose plans and reports should be matters of > public record. > > There are >5.8K plans in the StratML collection > <https://stratml.us/drybridge/index.htm> and indexed in the query > service. Their URLs are listed in sitemap format at > https://stratml.us/docs/sitemap.xml > > I am contemplating whether to hire someone to convert the relevant > elements of the IRS Form 990 database > <https://www.irs.gov/charities-non-profits/tax-exempt-organization-search-bulk-data-downloads> > to StratML format, using the templates at > https://stratml.us/drybridge/index.htm#MPR4CO However, I wonder how > BaseX might deal with more than a million records. > > Owen Ambur > https://www.linkedin.com/in/owenambur/ > > > On Wednesday, October 2, 2024 at 12:18:16 PM EDT, Christian Grün > <christian.gruen at gmail.com> <christian.gruen at gmail.com> wrote: > > > Hi Owen, > > Is it based on the BaseX XQuery CSV Module? > > Best, > Christian > > > > > Owen Ambur <owen.ambur at verizon.net> schrieb am Mi., 2. Okt. 2024, 18:12: > > I'm not sure how this exchange might relate but my developer has provided > CSV export capabilities for query results listings at StratML > <https://search.aboutthem.info/> > > > StratML <https://search.aboutthem.info/> > > > > Any comments or suggestions on how we might enhance the functionality of > our StratML-enabled query service would be most welcome. > > Owen Ambur > https://www.linkedin.com/in/owenambur/ > > > On Tuesday, October 1, 2024 at 04:42:12 AM EDT, Christian Grün < > christian.gruen at gmail.com> wrote: > > > Hi Omar, > > Thanks for the observation. For the SERIALIZER option, there was a > corresponding note which I have added to the EXPORTER option, along with > a little example for exporting CSV [1]. > > Best, > Christian > > [1] https://docs.basex.org/main/Options#exporter > > > > On Mon, Sep 30, 2024 at 4:04 PM Omar Siam <Omar.Siam at oeaw.ac.at> wrote: > > Hi, > > I just tried after some time to script a CSV export with a BXS file. I > forgot how to set multiple options for the csv serialization. In the end > this worked: > <set > option="EXPORTER">method=csv,csv=header=true,,lax=false,,quotes=true</set> > I can not find it on docs.basex.org. Perhaps this should be added and > explained. > > Best regards > > -- > Mag. Ing. Omar Siam > Austrian Center for Digital Humanities and Cultural Heritage > Österreichische Akademie der Wissenschaften | Austrian Academy of Sciences > Stellvertretende Behindertenvertrauensperson | Deputy representative for > disabled persons > Bäckerstraße 13, 1010 Wien, Österreich | Vienna, Austria > T: +43 1 51581-7295 > omar.siam at oeaw.ac.at | www.oeaw.ac.at/acdh > >

⚡Generated with XQuery