0.19.0 (2024-04-24)

  • Now requires attrs >= 22.2.0.

  • New deprecations:

    • zyte_common_items.components.request_list_processor (use zyte_common_items.processors.probability_request_list_processor)

    • zyte_common_items.items.RequestListCaster (use zyte_common_items.converters.to_probability_request_list)

    • zyte_common_items.util.metadata_processor (use zyte_common_items.processors.metadata_processor)

  • Added DropLowProbabilityItemPipeline that drops items with the probability value lower than a set threshold.

  • Added the BaseMetadata, ListMetadata, and DetailMetadata classes (they were previously private).

  • Added the ListMetadata.validationMessages attribute.

  • Added the ListMetadata.get_date_downloaded_parsed() method.

  • Added the zyte_common_items.converters module with useful attrs converters.

  • Reorganized the module structure.

  • Documentation improvements.

  • Test and CI fixes and improvements.

0.18.0 (2024-03-15)

0.17.1 (2024-03-13)

0.17.0 (2024-02-14)

0.16.0 (2024-02-06)

0.15.0 (2024-01-30)

0.14.0 (2024-01-16)

0.13.0 (2023-11-09)

  • Added Auto-prefixed versions of page objects, such as AutoProductPage(), that return data from Zyte API automatic extraction from their fields by default, and can be used to more easily override that data with custom parsing logic.

0.12.0 (2023-10-27)

0.11.0 (2023-09-08)

0.10.0 (2023-08-24)

0.9.0 (2023-08-03)

  • Now requires web-poet >= 0.14.0.

  • Fixed detection of the HasMetadata base class.

0.8.0 (2023-07-27)

0.7.0 (2023-07-11)

  • Now requires zyte-parsers.

  • Added navigation classes: ArticleNavigation, ProductNavigation, the page classes that produce them, and other related classes.

  • Improved the metadata field handling, also fixing some bugs:

    • Added item-specific metadata classes. The metadata item fields were changed to use them.

    • Backwards incompatible change: the DateDownloadedMetadata class was removed. The item-specific ones are now used instead.

    • Backwards incompatible change: ArticleFromList no longer has a probability field and instead has a metadata field like all other similar classes.

    • Backwards incompatible change: while in most items the old and the new type of the metadata field have the same fields, the one in Article now has probability, the one in ProductList no longer has probability, and the one in ProductFromList no longer has dateDownloaded.

    • The default probability value is now 1.0 instead of None.

    • Added the HasMetadata mixin which is used similarly to Returns to set the page metadata class.

    • Metadata objects assigned to the metadata fields of the items or returned from the metadata() methods of the pages are now converted to suitable classes.

  • Added zyte_common_items.processors.breadcrumbs_processor() and enabled it for the breadcrumbs fields.

0.6.0 (2023-07-05)

  • Added Article and ArticleList.

  • Added support for Python 3.11 and dropped support for Python 3.7.

0.5.0 (2023-05-10)

0.4.0 (2023-03-27)

  • Added support for business places.

0.3.1 (2023-03-17)

0.3.0 (2023-02-03)

0.2.0 (2022-09-22)

  • Supports web_poet.RequestUrl and web_poet.ResponseUrl and automatically convert them into a string on URL fields like Product.url.

  • Bumps the web_poet dependency version from 0.4.0 to 0.5.0 which fully supports type hints using the py.typed marker.

  • This package now also supports type hints using the py.typed marker. This means mypy would properly use the type annotations in the items when using it in your project.

  • Minor improvements in tests and annotations.

0.1.0 (2022-07-29)

Initial release.