-
Notifications
You must be signed in to change notification settings - Fork 228
/
CHANGES
484 lines (313 loc) · 21.2 KB
/
CHANGES
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
jsoup changelog
*** Release 1.7.3 [PENDING]
* Introduced FormElement, providing easy access to form controls and their data, and the ability to submit forms
with Jsoup.Connect.
*** Release 1.7.2 [2013-Jan-27]
* Added support for supplementary characters outside of the Basic Multilingual Plane.
<https://github.com/jhy/jsoup/issues/288> <https://github.com/jhy/jsoup/pull/289>
* Added support for structural pseudo CSS selectors, including :first-child, :last-child, :nth-child, :nth-last-child,
:first-of-type, :last-of-type, :nth-of-type, :nth-last-of-type, :only-child, :only-of-type, :empty, and :root
<https://github.com/jhy/jsoup/pull/208>
* Added a maximum body response size to Jsoup.Connection, to prevent running out of memory when trying to read
extremely large documents. The default is 1MB.
* Refactored the Cleaner to traverse rather than recurse child nodes, to avoid the risk of overflowing the stack.
<https://github.com/jhy/jsoup/issues/246>
* Added Element.insertChildren(), to easily insert a list of child nodes at a specific index.
<https://github.com/jhy/jsoup/issues/239>
* Added Node.childNodesCopy(), to create an independent copy of a Node's children.
* When parsing in XML mode, preserve XML declarations (<?xml ... ?>).
<https://github.com/jhy/jsoup/issues/242>
* Introduced Parser.parseXmlFragment(), to allow easy parsing of XML fragments.
<https://github.com/jhy/jsoup/issues/279>
* Allow Whitelist test methods to be extended
<https://github.com/jhy/jsoup/issues/85>
* Added Document.OutputSettings.outline mode, to aid HTML debugging by printing out in outline mode, similar to
browser HTML inspectors.
<https://github.com/jhy/jsoup/issues/273>
* When parsing, allow all tags to self-close. Tags that aren't expected to self-close will get an end tag.
<https://github.com/jhy/jsoup/issues/258>
* Fixed an issue when parsing <textarea>/RCData tags containing unescaped closing tags that would drop the traling >.
* Corrected the javadoc for Element#child() to note that it throws IndexOutOfBounds.
<https://github.com/jhy/jsoup/issues/277>
* When cloning an Element, reset the classnames set so as not to hold a pointer to the source's.
<https://github.com/jhy/jsoup/issues/278>
* Limit how far up the stack the formatting adoption agency algorithm will travel, to prevent the chance of a run-away
parse when the HTML stack is hopelessly deep.
<https://github.com/jhy/jsoup/issues/234>
* Modified Element.text() to build text by traversing child nodes rather than recursing. This avoids stack-overflow
errors when the DOM is very deep and the VM stack-size is low.
<https://github.com/jhy/jsoup/issues/271>
*** Release 1.7.1 [2012-Sep-23]
* Improved parse time, now 2.3x faster than previous release, with lower memory consumption.
* Reduced memory consumption when selecting elements.
* Introduced finer granularity of exceptions in Jsoup.connect, including HttpStatusException and
UnsupportedMimeTypeException.
<https://github.com/jhy/jsoup/issues/229>
* Fixed an issue when determining the Windows-1254 character-set from a meta tag when run in the Turkish locale.
<https://github.com/jhy/jsoup/issues/191>
* Fixed whitespace preservation in <textarea> tags.
<https://github.com/jhy/jsoup/issues/167>
* In jsoup.connect, fail faster if the return content type is not supported.
<https://github.com/jhy/jsoup/issues/153>
* In jsoup.clean, allow custom OutputSettings, to control pretty printing, character set, and entity escaping.
<https://github.com/jhy/jsoup/issues/148>
* Fixed an issue that prevented frameset documents to be cleaned by the Cleaner.
<https://github.com/jhy/jsoup/issues/154>
* Fixed an issue when normalising whitespace for strings containing high-surrogate characters.
<https://github.com/jhy/jsoup/issues/214>
* If a server doesn't specify a content-type header, treat that as OK.
<https://github.com/jhy/jsoup/issues/213>
* If a server returns an unsupported character-set header, attempt to decode the content with the default charset
(UTF8), instead of bailing with an unsupported charset exception.
<https://github.com/jhy/jsoup/issues/215>
* Removed an unnecessary synchronisation in Tag.valueOf, allowing multi-threaded parsing to run faster.
<https://github.com/jhy/jsoup/issues/238>
* Made entity decoding less greedy, so that non-entities are less likely to be incorrectly treated as entities.
<https://github.com/jhy/jsoup/issues/224>
* Whitespace normalise document.title() output.
<https://github.com/jhy/jsoup/issues/168>
* In Jsoup.connection, enforce a connection disconnect after every connect. This precludes keep-alive connections to
the same host, but in practise many implementations will leak connections, particularly on error.
*** Release 1.6.3 [2012-May-28]
* Fixed parsing of group-or commas in CSS selectors, to correctly handle sub-queries containing commas.
<https://github.com/jhy/jsoup/issues/179>
* If a node has no parent, return null on previousSibling and nextSibling instead of throwing a null pointer exception.
<https://github.com/jhy/jsoup/issues/184>
* Updated Node.siblingNodes() and Element.siblingElements() to exclude the current node (a node is not its own sibling).
* Fixed HTML entity parser to correctly parse entities like frac14 (letter + number combo).
<https://github.com/jhy/jsoup/issues/145>
* Fixed issue where contents of a script tag within a comment could be incorrectly parsed.
<https://github.com/jhy/jsoup/issues/115>
* Fixed GAE support: load HTML entities from a file on startup, instead of embedding in the class.
* Fixed NPE when HTML fragment parsing a <style> tag
<https://github.com/jhy/jsoup/issues/189>
* Fixed issue with :all pseudo-tag in HTML sanitizer when cleaning tags previously defined in whitelist
<https://github.com/jhy/jsoup/issues/156>
* Fixed NPE in Parser.parseFragment() when context parameter is null.
<https://github.com/jhy/jsoup/issues/195>
* In HTML whitelists, when defining allowed attributes for a tag, automatically add the tag to the allowed list.
*** Release 1.6.2 [2012-Mar-27]
* Added a simplified XML parsing mode, which can usefully parse valid and invalid XML, but does not enforce any HTML
document structure or special tag behaviour.
* Added the optional ability to track errors when tokenising and parsing.
* Added jsoup.connect.cookies(Map) method, to set multiple cookies at once, possibly from a prior request.
* Added Element.textNodes() and Element.dataNodes(), to easily access an element's children text nodes and data nodes.
* Added an example program that demonstrates how to format HTML as plain-text, and the use of the NodeVisitor interface.
* Added Node.traverse() and Elements.traverse() methods, to iterate through a node's descendants.
* Updated jsoup.connect so that when requests made as POSTs are redirected, the redirect is followed as a GET.
<https://github.com/jhy/jsoup/issues/120>
* Updated the Cleaner and whitelists to optionally preserve related links in elements, instead of converting them
to absolute links.
* Updated the Cleaner to support custom allowed protocols such as "cid:" and "data:".
<https://github.com/jhy/jsoup/issues/127>
* Updated handling of <base href> tags, to act on only the first one seen when parsing, to align with modern browsers.
* Updated Node.setBaseUri(), to recursively set on all the node's descendants.
* Fixed handling of null characters within comments.
<https://github.com/jhy/jsoup/issues/121>
* Tweaked escaped entity detection in attributes to not treat &entity_... as an entity form.
<https://github.com/jhy/jsoup/issues/129>
* Fixed doctype tokeniser to allow whitespace between name and public identifier.
* Fixed issue where comments within a table tag would be duplicate-fostered into body.
<https://github.com/jhy/jsoup/pull/165>
* Fixed an issue where a spurious byte-order-mark at the start of a document would cause the parser to miss head
contents.
<https://github.com/jhy/jsoup/issues/134>
* Fixed an issue where content after a frameset could cause a NPE crash. Now correctly implements spec and ignores
the trailing content.
<https://github.com/jhy/jsoup/issues/162>
* Tweaked whitespace checks to align with HTML spec
<https://github.com/jhy/jsoup/pull/175>
* Tweaked HTML output of closing script and style tags to not add an extraneous newline when pretty-printing.
* Substantially reduced default memory allocation within Node.outerHtml, to reduce memory pressure when serialising
smaller DOMs.
<https://github.com/jhy/jsoup/issues/143>
*** Release 1.6.1 [2011-Jul-02]
* Fixed Java 1.5 compatibility.
<https://github.com/jhy/jsoup/issues/103>
* Fixed an issue when parsing <script> tags in body where the tokeniser wouldn't switch to the InScript state, which
meant that data wasn't parsed correctly.
<https://github.com/jhy/jsoup/issues/104>
* Fixed an issue with a missing quote when serialising DocumentType nodes.
<https://github.com/jhy/jsoup/issues/109>
* Fixed issue where a single 0 character was lexed incorrectly as a null character.
<https://github.com/jhy/jsoup/issues/107>
* Fixed normalisation of carriage returns to newlines on input HTML.
<https://github.com/jhy/jsoup/issues/110>
* Disabled memory mapped files when loading files from disk, to improve compatibility in Windows environments.
*** Release 1.6.0 [2011-Jun-13]
* HTML5 conformant parser. Complete reimplementation of HTML tokenisation and parsing, to implement the
http://whatwg.org/html spec. This ensures jsoup parses HTML identically to current modern browsers.
* When parsing files from disk, files are loaded via memory mapping, to increase parse speed.
* Reduced memory overhead and lowered garbage collector pressure with Attribute, Node and Element model optimisations.
* Improved "abs:" absolute URL handling in Elements.attr("abs:href") and Node.hasAttr("abs:href").
<https://github.com/jhy/jsoup/issues/97>
* Fixed cookie handling issue in jsoup.Connect where empty cookies would cause a validation exception.
<https://github.com/jhy/jsoup/issues/87>
* Added jsoup.Connect configuration options to allow HTTP errors to be ignored, and the content-type to be ignored.
Contributed by Jesse Piascik (piascikj)
<https://github.com/jhy/jsoup/pull/78>
* Added Node.before(node) and Node.after(node), to allow existing nodes to be moved, or new nodes to be inserted, into
precise DOM positions.
* Added Node.unwrap() and Elements.unwrap(), to remove a node but keep its contents. Useful for e.g. removing unwanted
formatting tags.
<https://github.com/jhy/jsoup/issues/100>
* Now handles unclosed <title> tags in document by breaking out of the title at the next start tag, instead of
eating up to the end of the document.
<https://github.com/jhy/jsoup/issues/82>
* Added OSGi bundle support to the jsoup package jar.
<https://github.com/jhy/jsoup/issues/98>
*** Release 1.5.2 [2011-Feb-27]
* Fixed issue with selector parser where some boolean AND + OR combined queries (e.g. "meta[http-equiv], meta[content]")
were being parsed incorrectly as OR only queries (e.g. former as "meta, [http-equiv], meta[content]")
* Fixed issue where a content-type specified in a meta tag may not be reliably detected, due to the above issue.
* Updated Element.text() and Element.ownText() methods to ensure <br> tags output as whitespace.
* Tweaked Element.outerHtml() method to not generate initial newline on first output element.
*** Release 1.5.1 [2011-Feb-19]
* Integrated new single-pass selector evaluators, contributed by knz (Anton Kazennikov). This significantly speeds up
the execution of combined selector queries.
* Implemented workaround to fix Scala support. Contributed by bbeck (Brandon Beck).
* Added ability to change an element's tag with Element.tagName(String), and to change many at once
with Elements.tagName(String).
* Added Node.wrap(html), Node.before(html), and Node.after(html), to allow HTML to be easily added to all nodes. These
functions were previously supported on Elements only.
* Added TextNode.splitText(index), which allows a text node to be split into two nodes at a specified index point.
This is convenient if you need to surround some text in an element.
* Updated Jsoup.Connection so that cookies set on a redirect response will be included on both the redirected request
and response.
* Infinite redirection loops in Jsoup.Connect are now prevented.
* Allow Jsoup.Connect to parse application/xml and application/xhtml+xml responses.
* Modified Jsoup.Connect to always follow relative links, regardless of the underlying HTTP sub-system.
* Defined U (underline) element as an inline tag.
* Force strict entity matching (must be &xxx; and not &xxx) in element attributes.
* Implemented clone method for Elements (contributed by knz).
* Fixed tokeniser optimisation when scanning for missing data element close tags.
* Fixed issue when using descendant regex attribute selectors.
*** Release 1.4.1 [2010-Nov-23]
* Added ability to load and parse HTML from an input stream.
* Implemented Node.clone() to create deep, independent copies of Nodes, Elements, and Documents.
* Added :not() selector, to find elements that do not match the selector. E.g. div:not(.logo) finds divs that
do not have the "logo" class name.
* Added Elements.not(selector) method, to remove undesired results from selector results.
* Implemented DataNode.setWholeData() to allow updating of script and style data contents.
* Relaxed parse rules of H1 - H6, to allow nested content. This is against spec, but matches browser and publisher
behaviour.
* Relaxed parse rule of SPAN to treat as block, to allow nested block content.
* Fixed issue in jsoup.connect when extracting character set from content-type header; now supports quoted
charset declaration.
* Fixed support for jsoup.connect to follow redirects between http & https URLs.
* Document normalisation now more enthusiastically enforces the correct document structure.
* Support node.outerHtml() method when node has no parent (e.g. when it has been removed from its DOM tree)
* Fixed support for HTML entities with numbers in name (e.g. ¾, ¹).
* Fixed absolute URL generation from relative URLs which are only query strings.
*** Release 1.3.3 [2010-Sep-19]
* Implemented Elements.empty() and Elements.remove(). This allows easy element removal, like:
doc.select("iframe").remove();
* Fixed issue in Entities when unescaping $ ("$")
<http://github.com/jhy/jsoup/issues/issue/34>
* Added restricted XHTML output entity option
<http://github.com/jhy/jsoup/issues/issue/35>
*** Release 1.3.2 [2010-Aug-30]
* Treat HTTP headers as case insensitive in Jsoup.Connection. Improves compatibility for HTTP responses.
* Improved malformed table parsing by implementing ignorable end tags.
*** Release 1.3.1 [2010-Aug-23]
* Removed dependency on Apache Commons-lang. Jsoup now has no external dependencies.
* Added new Connection implementation, to enable easier and richer HTTP requests that parse to Documents. This includes
support for gzip responses, cookies, headers, data parameters, user-agent, referrer, etc.
* Added Element.ownText() method, to get only the direct text of an element, not including the text of its children.
* Added support for selectors :containsOwn(text) and :matchesOwn(regex), to supplement Element.ownText().
* Added support for non-pretty-printed HTML output, to more closely mirror the input HTML.
* Further speed optimisations for parsing and output generation.
* Fixed support for case-sensitive HTML escape entities.
<http://github.com/jhy/jsoup/issues/issue/31>
* Fixed issue when parsing tags with keyless attributes.
<http://github.com/jhy/jsoup/issues/issue/32>
*** Release 1.2.3 [2010-Aug-04]
* Added support for automatic input character set detection and decoding. Jsoup now automatically detects the encoding
character set when parsing HTML from a File or URL. The parser checks the content-type header, then the
<meta http-equiv> or <meta charset> tag, and finally falls back to UTF-8.
* Added ability to configure the document's output charset, to control which characters are HTML escaped, and which
are kept intact. The output charset defaults to the document's input charset. This simplifies non-ascii output.
* Added full support for all new HTML5 tags.
* Added support for HTML5 dataset custom data attributes, with the Element.dataset() map.
* Added support for the [^attributePrefix] selector query, to find elements with attributes starting with a prefix.
Useful for finding elements with datasets: [^data-] matches <p data-name="jsoup">
* Added support for namespaced elements (<fb:name>) and selectors to find them (fb|name)
* Implemented Node.ownerDocument DOM method
* Improved implicit table element handling (particularly around thead, tbody, and tfoot).
* Improved HTML output format for empty elements and auto-detected self closing tags
* Changed DT & DD tags to block-mode tags, to follow practice over spec
* Added support for tag names with - and _ (<abc_foo>, <abc-foo>)
* Handle tags with internal trailing space (<foo >)
* Fixed support for character class regular expressions in [attr=~regex] selector
*** Release 1.2.2 [2010-Jul-11]
* Performance optimisation:
- core HTML parser engine now 3.5 times faster
- HTML generator now 2.5 times faster
- much lower memory use and garbage collection time
* Added support for :matches(regex) selector, to find elements containing text matching regular expression
* Added support for [key~=regex] attribute selector, to find elements with attribute values matching regular expression
* Upgraded the selector query parser to allow nested selectors like 'div:has(p:matches(regex))'
*** Release 1.2.1 [2010-Jun-21]
* Added .before(html) and .after(html) methods to Element and Elements, to insert sibling HTML
* Added :contains(text) selector, to search for elements containing the specified text
* Added :has(selector) pseudo-selector
<http://github.com/jhy/jsoup/issues/issue/20>
* Added Element#parents and Elements#parents to retrieve an element's ancestor chain
<http://github.com/jhy/jsoup/issues/issue/20>
* Fixes an issue where appending / prepending rows to a table (or to similar implicit
element structures) would create a redundant wrapping elements
<http://github.com/jhy/jsoup/issues/issue/21>
* Improved implicit close tag heuristic detection when parsing malformed HTML
* Fixes an issue where text content after a script (or other data-node) was
incorrectly added to the data node.
<http://github.com/jhy/jsoup/issues/issue/22>
* Fixes an issue where text order was incorrect when parsing pre-document
HTML.
<http://github.com/jhy/jsoup/issues/issue/23>
*** Release 1.1.1 [2010-Jun-08]
* Added selector support for :eq, :lt, and :gt
<http://github.com/jhy/jsoup/issues/issue/16>
* Added TextNode#text and TextNode#text(String)
<http://github.com/jhy/jsoup/issues/issue/18>
* Throw exception if trying to parse non-text content
<http://github.com/jhy/jsoup/issues/issue/17>
* Added Node#remove and Node#replaceWith
<http://github.com/jhy/jsoup/issues/issue/19>
* Allow _ and - in CSS ID selectors (per CSS spec).
<http://github.com/jhy/jsoup/issues/issue/10>
* Relative links are resolved to absolute when cleaning, to normalize
output and to verify safe protocol. (Were previously discarded.)
<http://github.com/jhy/jsoup/issues/issue/12>
* Allow combinators at start of selector query, for query refinements
<http://github.com/jhy/jsoup/issues/issue/13>
* Added Element#val() and #val(String) methods, for form values
<http://github.com/jhy/jsoup/issues/issue/14>
* Changed textarea contents to parse as TextNodes, not DataNodes,
so contents visible to text() (and val(), as treated as form input)
* Fixed support for Java 1.5
*** Release 0.3.1 (2010-Feb-20)
* New features: supports Elements#html(), html(String),
prepend(String), append(String); bulk methods for corresponding
methods in Element.
* New feature: Jsoup.isValid(html, whitelist) method for user input
form validation.
* Improved Elements.attr(String) to find first matching element
with attribute.
* Fixed assertion error when cleaning HTML with empty attribute
<http://github.com/jhy/jsoup/issues/issue/7>
*** Release 0.2.2 (2010-Feb-07)
* jsoup packages are now available in the Maven central repository.
* New feature: supports Element#addClass, removeClass, toggleClass;
also collection class methods on Elements.
* New feature: supports Element#wrap(html) and Elements#wrap(html).
* New selector syntax: supports E + F adjacent sibling selector
* New selector systax: supports E ~ F preceding sibling selector
* New: supports Element#elementSiblingIndex()
* Improved document normalisation.
* Improved HTML string output format (pretty-print)
* Fixed absolute URL resolution issue when a base tag has no href.
*** Release 0.1.2 (2010-Feb-02)
* Fixed unrecognised tag handler to be more permissive
<http://github.com/jhy/jsoup/issues/issue/1>
*** Release 0.1.1 (2010-Jan-31)
* Initial beta release of jsoup