xavier
/
PythonScripts
1
0
Fork 0
Code

better explanation of the contents

This commit is contained in:
Xavier Fontanet 2024-07-10 18:27:24 +02:00
parent f7ee3b8a16
commit caf9fead83
1 changed files with 12 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

13
README.md
View File

@ -1,4 +1,13 @@
# Some Web Scrapping tools
This was a personal-use util software to help me on certain goals such as seeking a new flat with specific characteristics or getting a massive list of edonkey links from a web page.<br>
# Some Python scripts
## Web scraping
This was a personal-use "web spiders" to help me on certain goals such as seeking a new flat with specific characteristics or getting a massive list of edonkey links from a web page.
<br>
I've chosen **Python** due to the complete libraries suite for web scrapping that it offers, and the ease of using them. <br>
But of course, since it's not my main language nor workspace the code quality and design are very poor.
### Flat search
Some time ago, the real state agents fees were paid by the leaseholder, and find a flat rental comming directly from the owner meant saving a lot of money, but this was very hard to find, because the common web platforms only contained real state ads.<br>
This homemade web spider helped me on finding these exceptional deals.
### Link capturer
I've also developed one web spider that capture all the eDonkey links from a web-page so that I could copy them to a downloader manager
## Other tools
I have here also a multi-threading HTTP GET requests script, that can be used to test the performance of a system under a certain load of concurrency requests. The purpose of its development was to have a metric of reference and later improve the performance.