NewApp Monitoring is liveSign up free
AgentbeamBeta
Open-source package vulnerability · PyPI

CVE-2024-1892: Scrapy vulnerable to ReDoS via XMLFeedSpider

highCVSS 3.1 7.5GHSA-cc65-xxvf-f7r9

Impact The following parts of the Scrapy API were found to be vulnerable to a ReDoS attack: - The XMLFeedSpider class or any subclass that uses the default node iterator: iternodes, as well as direct uses of the scrapy.utils.iterators.xmliter function. - Scrapy 2.6.0 to 2.11.0: The openinbrowser function for a response without a base tag.

Published Feb 15, 2024 · Updated Mar 16, 2026

Affected packages

scrapy

Ecosystem
PyPI
Affected
>= 2, < 2.11.1
Fixed in
2.11.1
Check
pip show scrapy

scrapy

Ecosystem
PyPI
Affected
< 1.8.4
Fixed in
1.8.4
Check
pip show scrapy

Advisory details

From the GitHub Advisory Database (CC BY 4.0).

Impact

The following parts of the Scrapy API were found to be vulnerable to a ReDoS attack:

  • The `XMLFeedSpider` class or any subclass that uses the default node iterator: iternodes, as well as direct uses of the scrapy.utils.iterators.xmliter function.

Handling a malicious response could cause extreme CPU and memory usage during the parsing of its content, due to the use of vulnerable regular expressions for that parsing.

Patches

Upgrade to Scrapy 2.11.1.

If you are using Scrapy 1.8 or a lower version, and upgrading to Scrapy 2.11.1 is not an option, you may upgrade to Scrapy 1.8.4 instead.

Workarounds

For XMLFeedSpider, switch the node iterator to `xml or html`.

For open_in_browser, before using the function, either manually review the response content to discard a ReDos attack or manually define the base tag to avoid its automatic definition by open_in_browser later.

Acknowledgements

This security issue was reported by @nicecatch2000 through huntr.com.

Credited to nicecatch2000.

References

How this page is made: the data panel comes from the GitHub Advisory Database, CISA’s KEV catalog, the NVD and FIRST EPSS, and updates twice a day. No analysis has been written for this entry yet. Methodology

More PyPI vulnerabilities

All PyPI entries