Changes

Jump to navigation Jump to search
2,361 bytes added ,  16:57, 4 August 2022
no edit summary
This [[Module Library|XQuery Module]] contains a single function to send HTTP requests and handle HTTP responses. The function {{Code|send-request}} is based on the [http://expath.org/spec/http-client EXPath HTTP Client Module]. It gives full control over the available request and response parameters. For simple GET requests, the [[Fetch Module]] may be sufficient. If <code><http:header name="Accept-Encoding" value="gzip"/></code> is specified and if the addressed web server provides support for the {{Code|gzip}} compression algorithm, the response will automatically be decompressed. {{Announce|Updated with Version 10:}} The Implementation of the module is now based on the new [https://openjdk.org/groups/net/httpclient/intro.html Java HTTP Client], which provides a better overall performance, uses internal connection pools and follows redirects across different protocols (http, https).
=Conventions=
All functions in this module are assigned to the {{Code|<code><nowiki>http://expath.org/ns/http-client}} </nowiki></code> namespace, which is statically bound to the {{Code|http}} prefix.<br/>All errors are assigned to the {{Code|<code><nowiki>http://expath.org/ns/error}} </nowiki></code> namespace, which is statically bound to the {{Code|exerrexperr}} prefix.
=Functions=
{| width='100%'
|-valign="top"
| width='120' | '''Signatures'''
|{{Func|http:send-request|$request as element(http:request)?, $href as xs:string?, $bodies as item()*|item()+}}<br/>{{Func|http:send-request|$request as element(http:request)?, $href as xs:string?|item()+}}<br />{{Func|http:send-request|$request as element(http:request)?, $href as xs:string?, $bodies as item()*|item()+}}<br />|-valign="top"
| '''Summary'''
|Sends an HTTP request and interprets the corresponding response. :* {{Code|$request}} contains the parameters of the HTTP request such as HTTP method and headers. * In addition to this it can also contain the URI to which the request will be sent and the body of the HTTP method. * If the URI is not given with the parameter {{Code|$href}}, its value in {{Code|$request}} is used instead. * The structure request body can also be supplied via the {{Code|$bodies}} parameter.* Certificate verification can be globally disabled via the {{Option|IGNORECERT}} option. Notes:* Both basic and digest authentication is supported.* While the contents of the request can be supplied as child of the {{Code|http:requestbody}} element follows , it is faster and safer to pass them on via the third argument.* For further information, please check out the [http://expath.org/spec/http-client EXPath] specification.|-valign="top"
|'''Errors'''
|{{Error|HC0001|#Errors}} an HTTP error occurred.<br/>{{Error|HC0002|#Errors}} error parsing the entity content as XML or HTML.<br/>{{Error|HC0003|#Errors}} with a multipart response, the override-media-type must be either a multipart media type or application/octet-stream.<br/>{{Error|HC0004|#Errors}} the src attribute on the body element is mutually exclusive with all other attribute (except the media-type).<br/>{{Error|HC0005|#Errors}} the request element is not valid.<br/>{{Error|HC0006|#Errors}} a timeout occurred waiting for the response.
|-
| '''Notes'''
|The attribute {{Code|auth-method}} of {{Code|$request}} is not considered in our implementation because we are handling only basic authentication.
|}
==Examples==
===Status Only===
Simple GET request. As the attribute {{Code|status-only}} is set to true, only the response element is returned.
'''Query:'''
<pre classsyntaxhighlight lang="brush:xquery">http:send-request(<http:request method='get' status-only='true'/>, 'http://basex.org')</presyntaxhighlight>
'''Result:'''
<pre classsyntaxhighlight lang="brush:xml"><http:response status="200" message="OK">
<http:header name="Date" value="Mon, 14 Mar 2011 20:55:53 GMT"/>
<http:header name="Content-Length" value="12671"/>
<http:header name="Cache-Control" value="max-age=90"/>
<http:body media-type="text/html; charset=utf-8"/>
</http:response></presyntaxhighlight>
===Google Homepage=== Retrieve the Google search home pagewith a timeout of 10 seconds. In order to [[http://home.ccil.org/~cowan/XML/tagsoup/ Parsers#HTML_Parser|parse HTML]], TagSoup] must be contained in the class path in order to parse html.
'''Query:'''
<pre classsyntaxhighlight lang="brush:xquery">http:send-request(<http:request method='get' href='http://www.google.com' timeout='10'/>)</presyntaxhighlight>
'''Result:'''
<pre classsyntaxhighlight lang="brush:xml">
<http:response status="200" message="OK">
<http:header name="Date" value="Mon, 14 Mar 2011 22:03:25 GMT"/>
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="contentContent-typeType" content="text/html; charset=ISO-8859UTF-18"/>
<title>Google</title>
<script>window.google={kEI:"rZB- ... </script> </center>
</body>
</html>
</presyntaxhighlight>
The response content type can also be overwritten in order to retrieve HTML pages and other textual data as plain string (using {{Code|text/plain}} ) or in its binary representation (using {{Code|application/octet-stream}}). The result With the {{Code|http:header}} element, a custom user agent can then be further processedset. See the following example:
'''Query:'''
<pre classsyntaxhighlight lang="brush:xquery">
let $binary := http:send-request(
<http:request method='get'
override-media-type='application/octet-stream' href='http://www.google.com'> <http:header name="User-Agent" value="Opera"/> </http:request>
)[2]
return try {
'Conversion to XML failed: ' || $err:description
}
</presyntaxhighlight>
===SVG Data===
 
Content-type ending with +xml, e.g. image/svg+xml.
'''Query:'''
<pre classsyntaxhighlight lang="brush:xquery">http:send-request(<http:request method='get'/>, 'http://upload.wikimedia.org/wikipedia/commons/6/6b/Bitmap_VS_SVG.svg')</presyntaxhighlight>
'''Result:'''
<pre classsyntaxhighlight lang="brush:xml"><http:response status="200" message="OK">
<http:header name="ETag" value="W/&quot;11b6d-4ba15ed4&quot;"/>
<http:header name="Age" value="9260"/>
</linearGradient>
...
</svg></presyntaxhighlight==POST Request==
===POST Request===
POST request to the BaseX REST Service, specifying a username and password.
'''Query:'''
<pre classsyntaxhighlight lang="brush:xquery">let $http:send-request :=( <http:request href='http://localhost:8984/rest' method='post' username='admin' password='admin' send-authorization='true'> <http:body media-type='application/xml'/> <query xmlns="/http:request>, 'http://basex.orglocalhost:8080/rest"', <query> <text><![CDATA[ <html>{ for $i in 1 to 3 return <div>Section {$i }</div> }</html> ]]> </text> </query> </http:body> </http:request>return http:send-request($request)</presyntaxhighlight>
'''Result:'''
<pre classsyntaxhighlight lang="brush:xml">
<http:response xmlns:http="http://expath.org/ns/http-client" status="200" message="OK">
<http:header name="Content-Length" value="135"/>
<div>Section 3</div>
</html>
</presyntaxhighlight> ==File Upload== Performs an HTML file upload. In the RESTXQ code, the uploaded file is written to the temporary directory: '''Query:''' <syntaxhighlight lang="xquery">let $path := 'file-to-be.uploaded'return http:send-request( <http:request method='POST'> <http:multipart media-type='multipart/form-data'> <http:header name='content-disposition' value='form-data; name="files"; filename="{ file:name($path) }"'/> <http:body media-type='application/octet-stream'/> </http:multipart> </http:request>, 'http://localhost:8080/write-to-temp', file:read-binary($path))</syntaxhighlight> '''RESTXQ service:''' <syntaxhighlight lang="xquery">declare %rest:POST %rest:path('/write-to-temp') %rest:form-param('files', '{$files}')function dba:file-upload( $files as map(xs:string, xs:base64Binary)) as empty-sequence() { map:for-each($files, function($file, $content) { file:write-binary(file:temp-dir() || $file, $content) });};</syntaxhighlight>
=Errors=
! width="110"|Code
|Description
|-valign="top"
|{{Code|HC0001}}
|An HTTP error occurred.
|-valign="top"
|{{Code|HC0002}}
|Error parsing the entity content as XML or HTML.
|-valign="top"
|{{Code|HC0003}}
|With a multipart response, the override-media-type must be either a multipart media type or application/octet-stream.
|-valign="top"
|{{Code|HC0004}}
|The src attribute on the body element is mutually exclusive with all other attribute (except the media-type).
|-valign="top"
|{{Code|HC0005}}
|The request element is not valid.
|-valign="top"
|{{Code|HC0006}}
|A timeout occurred waiting for the response.
=Changelog=
 
;Version 10.0
* Updated: Implementation based on the new [https://openjdk.org/groups/net/httpclient/intro.html Java HTTP Client].
 
;Version 9.0
* Updated: support for gzipped content encoding
 
;Version 8.0
* Added: digest authentication
;Version 7.6
* Updated: [[#http:send-request{{Function||http:send-request]]}}: {{ErrorCode|HC0002|#Errors}} is raised if the input cannot be parsed, or converted to the final data type.
* Updated: errors are using {{Code|text/plain}} as media-type.
 
[[Category:XQuery]]
Bureaucrats, editor, reviewer, Administrators
13,550

edits

Navigation menu