Links.txt -

For webmasters, a links.txt file often serves as the output of a crawl.

: The download manager aria2 uses --input-file=links.txt to handle high-speed, multi-connection downloads from a list. 2. Web Auditing and SEO Links.txt

: You can use grep or wget with a spider option to crawl a website and save every discovered URL into a text file for auditing. For webmasters, a links

remove links after downloading from --input-file · Issue #971 - GitHub Links.txt