Repository navigation
Replace dead links with archived copies and update outdated sources - #1553
Conversation
Signed-off-by: enesbaldemir <enesbaldemir9538@gmail.com>
This comment has been minimized.
This comment has been minimized.
| ``` | ||
|
|
||
| Web spiders/robots/crawlers can [intentionally ignore](https://blog.isc2.org/isc2_blog/2008/07/the-attack-of-t.html) the `Disallow` directives specified in a `robots.txt` file. Hence, `robots.txt` should not be considered as a mechanism to enforce restrictions on how web content is accessed, stored, or republished by third parties. | ||
| Web spiders/robots/crawlers can [intentionally ignore](https://web.archive.org/web/20150929111825/http://blog.isc2.org/isc2_blog/2008/07/the-attack-of-t.html) the `Disallow` directives specified in a `robots.txt` file. Hence, `robots.txt` should not be considered as a mechanism to enforce restrictions on how web content is accessed, stored, or republished by third parties. |
There was a problem hiding this comment.
Is this refer nice worth keeping?
If so I'd suggest seeking for something newer.
There was a problem hiding this comment.
Replaced with Cloudflare's 2025 report on stealth crawlers ignoring robots.txt, which matches "intentionally ignore" directly.
| - [Chromium HSTS Preload List Source](https://chromium.googlesource.com/chromium/src/+/main/net/http/transport_security_state_static.json) | ||
| - [MDN: Strict-Transport-Security](https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Headers/Strict-Transport-Security) | ||
| - [Enable HTTP Strict Transport Security In Nginx](https://www.nginx.com/blog/http-strict-transport-security-hsts-and-nginx/) | ||
| - [Enable HTTP Strict Transport Security In Nginx](https://web.archive.org/web/20221224121012/https://www.nginx.com/blog/http-strict-transport-security-hsts-and-nginx/) |
There was a problem hiding this comment.
There's gotta be a current Nginx ref for this
There was a problem hiding this comment.
Found it, the post moved to blog.nginx.org. Updated to the live URL.
|
|
||
| - [Bypassing Web Cache Poisoning Countermeasures](https://portswigger.net/research/bypassing-web-cache-poisoning-countermeasures) | ||
| - [Path confusion: Web cache deception threatens user information online](https://portswigger.net/daily-swig/path-confusion-web-cache-deception-threatens-user-information-online) | ||
| - [Path confusion: Web cache deception threatens user information online](https://web.archive.org/web/20230120114007/https://portswigger.net/daily-swig/path-confusion-web-cache-deception-threatens-user-information-online) |
There was a problem hiding this comment.
This isn't still available?
There was a problem hiding this comment.
No, The Daily Swig was shut down and the URL now redirects to the PortSwigger homepage. I replaced it with the research paper that article was reporting on: "Cached and Confused: Web Cache Deception in the Wild" (USENIX Security 2020).
| - [Cross-site Request Forgery FAQ](https://www.cgisecurity.com/csrf-faq.html) | ||
| - [A Most-Neglected Fact About Cross Site Request Forgery (CSRF)](https://yehg.net/lab/pr0js/view.php/A_Most-Neglected_Fact_About_CSRF.pdf) | ||
| - [Multi-POST CSRF](https://www.lanmaster53.com/2013/07/17/multi-post-csrf/) | ||
| - [Multi-POST CSRF](https://web.archive.org/web/20210516151741/https://www.lanmaster53.com/2013/07/17/multi-post-csrf/) |
There was a problem hiding this comment.
Is his blog gone or just reorganized?
There was a problem hiding this comment.
Reorganized: the blog moved to a /blog/YYYY/MM/DD/ URL scheme, but these 2013/2016 posts weren't carried over (old URLs 404 or loop, and I couldn't find them under the new structure). So I kept the archive link for this one.
| ## References | ||
|
|
||
| - [XML Injection](https://www.whitehatsec.com/glossary/content/xml-injection) | ||
| - [XML Injection](https://web.archive.org/web/20210215162552/https://www.whitehatsec.com/glossary/content/xml-injection) |
There was a problem hiding this comment.
If this is just a definition (glossary entry) may as well point to Wikipedia
There was a problem hiding this comment.
Wikipedia doesn't have an article on XML injection (only on XXE), so I pointed it to PortSwigger's definition instead.
Signed-off-by: enesbaldemir <enesbaldemir9538@gmail.com>
This comment has been minimized.
This comment has been minimized.
|
Not too much at all, thanks for the detailed review! I've addressed these comments, so feel free to continue with the rest whenever you have time. |
|
Thanks @enesbaldemir I'll try to complete the rest later tonight (Saturday, eastern). |
|
Finally got back to this. |
Signed-off-by: enesbaldemir <enesbaldemir9538@gmail.com>
This comment has been minimized.
This comment has been minimized.
Signed-off-by: enesbaldemir <enesbaldemir9538@gmail.com>
|
The following links are broken: |
|
The link check flagged two pre-existing links in files this PR touches. The SEI "Securing Public Web Servers" PDF moved (SEI reorganized its site), so I've updated it to the new library page. The other one is the DEF CON 18 PDF from before, which loads fine manually. |
Part of #1550.
What did this PR accomplish?
Follow-up to #1549. This resolves most of the dead and outdated links listed in #1550.
Dead links → Wayback Machine snapshots (each snapshot checked manually and shows the original article)
web/20210107144812web/20150929111825web/20210126172623web/20230120114007web/20151205182440web/20191018083805web/20191122124952web/20210227005613web/20210516151741web/20221224121012web/20160423081903web/20191112191201web/20210215162552Replaced with the current source
draft-ietf-oauth-security-topics,-16) → RFC 9700. The section anchors#section-2.1.2(Implicit Grant) and#section-2.4(Resource Owner Password Credentials Grant) match.angular.io/guide/security(now redirects to the v17 legacy docs) → https://angular.dev/best-practices/securitysecurity-best-practices.html(redirect loop) → https://docs.aws.amazon.com/lambda/latest/dg/lambda-security.htmlwww.wikipedia.org/wiki/Local_File_Inclusion→ https://en.wikipedia.org/wiki/File_inclusion_vulnerability (canonical article)markdownlint-cli2and the terminologytextlintcheck pass on all changed files.Remaining in #1550 (changes the meaning of the text, so I left these to the maintainers): NIST SP 800-63-3 → 800-63-4 (anchors and the PBKDF2 iteration guidance changed), FIPS 140-2 → 140-3, Proactive Controls v3 C5/C10 → 2024 C3, W3C CORS → Fetch Standard, Laravel 7.x docs, the PCI DSS v3.2.x SAQ PDFs, and
blog.checkpoint.com/latest-sql-injection-trends/(loads fine in a browser).